Duckietown Challenges Home Challenges Submissions

Evaluator 4896

ID4896
evaluatornogpu-prod-02
ownerI don't have one 😀
machinenogpu-prod_e7650f964a9f
processnogpu-prod-02_e7650f964a9f
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success19 53948
# timeout
# failed3 54644
# error2 54128
# aborted
# host-error37 53933
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5739510942Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:48:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013626745797315308
agent_compute-ego0_mean0.013274894070367232
agent_compute-ego0_median0.013342005525600106
agent_compute-ego0_min0.012788819432953414
complete-iteration_max0.34778029734050103
complete-iteration_mean0.295981762857858
complete-iteration_median0.30129087695868983
complete-iteration_min0.23356500017355125
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.4559216145968854e-06
get_duckie_state_mean1.3885748177940504e-06
get_duckie_state_median1.4093694440728918e-06
get_duckie_state_min1.279638768433532e-06
get_robot_state_max0.003909702205737366
get_robot_state_mean0.003737910254412547
get_robot_state_median0.003689635107658189
get_robot_state_min0.003662668596596444
get_state_dump_max0.004726419242395152
get_state_dump_mean0.004690059515756929
get_state_dump_median0.004691104110730478
get_state_dump_min0.0046516105991716095
get_ui_image_max0.035447697159054874
get_ui_image_mean0.030784701377922653
get_ui_image_median0.030857404701715704
get_ui_image_min0.02597629894920432
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02859741920833286, "step_physics": 0.2133099177199339, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004726419242395152, "get_robot_state": 0.003702394174199418, "sim_render-ego0": 0.00396382917869498, "get_duckie_state": 1.4416284108539109e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.013174689679618283, "complete-iteration": 0.2803717679921832, "set_robot_commands": 0.0022210247014384783, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008561869445788076, "sim_compute_performance-ego0": 0.002026692715215246}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.035447697159054874, "step_physics": 0.27048063437011616, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004683702216358804, "get_robot_state": 0.003676876041116961, "sim_render-ego0": 0.003944594695308028, "get_duckie_state": 1.3771104772918726e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013626745797315308, "complete-iteration": 0.34778029734050103, "set_robot_commands": 0.0022051558704995595, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011618671171075595, "sim_compute_performance-ego0": 0.00200853717019417}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.033117390195098545, "step_physics": 0.24911165832976911, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004698506005102153, "get_robot_state": 0.003909702205737366, "sim_render-ego0": 0.004094266176819305, "get_duckie_state": 1.4559216145968854e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.01350932137158193, "complete-iteration": 0.3222099859251964, "set_robot_commands": 0.002317860759763694, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009206814928713884, "sim_compute_performance-ego0": 0.002150887752154983}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02597629894920432, "step_physics": 0.17228834019612513, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0046516105991716095, "get_robot_state": 0.003662668596596444, "sim_render-ego0": 0.0038837743341476097, "get_duckie_state": 1.279638768433532e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012788819432953414, "complete-iteration": 0.23356500017355125, "set_robot_commands": 0.002183258880882041, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006072114845993715, "sim_compute_performance-ego0": 0.001973174593033739}}
set_robot_commands_max0.002317860759763694
set_robot_commands_mean0.002231825053145943
set_robot_commands_median0.002213090285969019
set_robot_commands_min0.002183258880882041
sim_compute_performance-ego0_max0.002150887752154983
sim_compute_performance-ego0_mean0.0020398230576495345
sim_compute_performance-ego0_median0.0020176149427047077
sim_compute_performance-ego0_min0.001973174593033739
sim_compute_sim_state_max0.011618671171075595
sim_compute_sim_state_mean0.008864867597892819
sim_compute_sim_state_median0.00888434218725098
sim_compute_sim_state_min0.006072114845993715
sim_render-ego0_max0.004094266176819305
sim_render-ego0_mean0.003971616096242481
sim_render-ego0_median0.003954211937001504
sim_render-ego0_min0.0038837743341476097
simulation-passed1
step_physics_max0.27048063437011616
step_physics_mean0.22629763765398608
step_physics_median0.2312107880248515
step_physics_min0.17228834019612513
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5728810969Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:23:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0268520741740996
survival_time_median40.34999999999979
deviation-center-line_median1.1329678400294174
in-drivable-lane_median12.275000000000174


other stats
agent_compute-ego0_max0.013943648861791795
agent_compute-ego0_mean0.013073643266131791
agent_compute-ego0_median0.013176377784348544
agent_compute-ego0_min0.011998168634038284
complete-iteration_max0.20669024135483113
complete-iteration_mean0.18345788488525797
complete-iteration_median0.18845282709793457
complete-iteration_min0.15023564399033165
deviation-center-line_max3.0679705127710553
deviation-center-line_mean1.5293519379469522
deviation-center-line_min0.7835015589579193
deviation-heading_max10.427472857676666
deviation-heading_mean5.465622703932828
deviation-heading_median4.3060016161147265
deviation-heading_min2.823014725825194
driven_any_max7.699915957365383
driven_any_mean5.309662742768639
driven_any_median5.241531957532942
driven_any_min3.0556710986432885
driven_lanedir_consec_max7.554414419454948
driven_lanedir_consec_mean3.838851682518725
driven_lanedir_consec_min1.7472881622717544
driven_lanedir_max7.554414419454948
driven_lanedir_mean3.838851682518725
driven_lanedir_median3.0268520741740996
driven_lanedir_min1.7472881622717544
get_duckie_state_max1.5823189131989926e-06
get_duckie_state_mean1.4482296522968617e-06
get_duckie_state_median1.451981326909096e-06
get_duckie_state_min1.3066370421702617e-06
get_robot_state_max0.004021696939677773
get_robot_state_mean0.003779780347598936
get_robot_state_median0.003790789111843352
get_robot_state_min0.003515846227031266
get_state_dump_max0.005157907090025272
get_state_dump_mean0.004925082733904676
get_state_dump_median0.005004134320381655
get_state_dump_min0.004534155204830122
get_ui_image_max0.03640771264513138
get_ui_image_mean0.031158191546591097
get_ui_image_median0.03164534888962499
get_ui_image_min0.024934355761983017
in-drivable-lane_max25.049999999999795
in-drivable-lane_mean12.400000000000036
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.86903375187023, "get_ui_image": 0.02900673332138592, "step_physics": 0.10486034248412662, "survival_time": 50.29999999999928, "driven_lanedir": 4.00116007453239, "get_state_dump": 0.005063146678314663, "get_robot_state": 0.003832942087576903, "sim_render-ego0": 0.0041582967934329085, "get_duckie_state": 1.494200250953288e-06, "in-drivable-lane": 25.049999999999795, "deviation-heading": 3.7455752393808006, "agent_compute-ego0": 0.012950990027207012, "complete-iteration": 0.17576399791797082, "set_robot_commands": 0.002258744235071904, "deviation-center-line": 1.0006078262016331, "driven_lanedir_consec": 4.00116007453239, "sim_compute_sim_state": 0.011381241155357325, "sim_compute_performance-ego0": 0.002158763983990727}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.614030163195654, "get_ui_image": 0.03640771264513138, "step_physics": 0.1276365461803618, "survival_time": 30.400000000000297, "driven_lanedir": 2.0525440738158096, "get_state_dump": 0.004945121962448646, "get_robot_state": 0.0037486361361098014, "sim_render-ego0": 0.004134309702906115, "get_duckie_state": 1.409762402864904e-06, "in-drivable-lane": 12.500000000000178, "deviation-heading": 4.866427992848652, "agent_compute-ego0": 0.013401765541490076, "complete-iteration": 0.20669024135483113, "set_robot_commands": 0.0022720491944862703, "deviation-center-line": 1.2653278538572017, "driven_lanedir_consec": 2.0525440738158096, "sim_compute_sim_state": 0.011976236193050892, "sim_compute_performance-ego0": 0.002078316286083904}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.0556710986432885, "get_ui_image": 0.03428396445786406, "step_physics": 0.12354999673580697, "survival_time": 25.00000000000022, "driven_lanedir": 1.7472881622717544, "get_state_dump": 0.005157907090025272, "get_robot_state": 0.004021696939677773, "sim_render-ego0": 0.004368365643743032, "get_duckie_state": 1.5823189131989926e-06, "in-drivable-lane": 12.050000000000171, "deviation-heading": 2.823014725825194, "agent_compute-ego0": 0.013943648861791795, "complete-iteration": 0.20114165627789832, "set_robot_commands": 0.002391817564973812, "deviation-center-line": 0.7835015589579193, "driven_lanedir_consec": 1.7472881622717544, "sim_compute_sim_state": 0.011148595048519904, "sim_compute_performance-ego0": 0.0021809770199591053}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.699915957365383, "get_ui_image": 0.024934355761983017, "step_physics": 0.09158621680031807, "survival_time": 59.99999999999873, "driven_lanedir": 7.554414419454948, "get_state_dump": 0.004534155204830122, "get_robot_state": 0.003515846227031266, "sim_render-ego0": 0.0037124827938413343, "get_duckie_state": 1.3066370421702617e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.427472857676666, "agent_compute-ego0": 0.011998168634038284, "complete-iteration": 0.15023564399033165, "set_robot_commands": 0.0020710671573356226, "deviation-center-line": 3.0679705127710553, "driven_lanedir_consec": 7.554414419454948, "sim_compute_sim_state": 0.005940695785662217, "sim_compute_performance-ego0": 0.0018649589608452104}}
set_robot_commands_max0.002391817564973812
set_robot_commands_mean0.0022484195379669026
set_robot_commands_median0.002265396714779087
set_robot_commands_min0.0020710671573356226
sim_compute_performance-ego0_max0.0021809770199591053
sim_compute_performance-ego0_mean0.0020707540627197367
sim_compute_performance-ego0_median0.002118540135037316
sim_compute_performance-ego0_min0.0018649589608452104
sim_compute_sim_state_max0.011976236193050892
sim_compute_sim_state_mean0.010111692045647583
sim_compute_sim_state_median0.011264918101938613
sim_compute_sim_state_min0.005940695785662217
sim_render-ego0_max0.004368365643743032
sim_render-ego0_mean0.004093363733480848
sim_render-ego0_median0.0041463032481695115
sim_render-ego0_min0.0037124827938413343
simulation-passed1
step_physics_max0.1276365461803618
step_physics_mean0.11190827555015335
step_physics_median0.1142051696099668
step_physics_min0.09158621680031807
survival_time_max59.99999999999873
survival_time_mean41.42499999999963
survival_time_min25.00000000000022
No reset possible
5727611313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-020:01:05
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5712111017Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:38:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.295215014769427
survival_time_median59.99999999999873
deviation-center-line_median2.837320356470493
in-drivable-lane_median4.274999999999892


other stats
agent_compute-ego0_max0.03565964512185788
agent_compute-ego0_mean0.030904525622638637
agent_compute-ego0_median0.03406660532971206
agent_compute-ego0_min0.019825246709272527
complete-iteration_max0.2417684381550099
complete-iteration_mean0.2121827340840698
complete-iteration_median0.21141290763931211
complete-iteration_min0.184136682902645
deviation-center-line_max3.821740626642996
deviation-center-line_mean2.9063145184532475
deviation-center-line_min2.1288767342290087
deviation-heading_max20.293331801522996
deviation-heading_mean14.790328017281617
deviation-heading_median14.336060700967735
deviation-heading_min10.195858865667995
driven_any_max9.699258585782962
driven_any_mean9.299283473998472
driven_any_median9.27439180192301
driven_any_min8.949091706364904
driven_lanedir_consec_max9.283751511714373
driven_lanedir_consec_mean5.881992521573319
driven_lanedir_consec_min3.653788545040048
driven_lanedir_max9.283751511714373
driven_lanedir_mean8.192043664586846
driven_lanedir_median8.128125426895073
driven_lanedir_min7.228172292842862
get_duckie_state_max1.670518187460157e-06
get_duckie_state_mean1.4210819304733848e-06
get_duckie_state_median1.3897162889263017e-06
get_duckie_state_min1.234376956580779e-06
get_robot_state_max0.0040435800941460934
get_robot_state_mean0.003810104184305539
get_robot_state_median0.003853355716606858
get_robot_state_min0.003490125209862346
get_state_dump_max0.005027233809853077
get_state_dump_mean0.004836675279047169
get_state_dump_median0.004914961488518886
get_state_dump_min0.00448954432929783
get_ui_image_max0.03726624052887852
get_ui_image_mean0.031049366150172328
get_ui_image_median0.03019513248106919
get_ui_image_min0.0265409591096724
in-drivable-lane_max5.600000000000014
in-drivable-lane_mean3.849999999999948
in-drivable-lane_min1.249999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.699258585782962, "get_ui_image": 0.0265409591096724, "step_physics": 0.10046932957353044, "survival_time": 59.99999999999873, "driven_lanedir": 9.283751511714373, "get_state_dump": 0.00448954432929783, "get_robot_state": 0.003490125209862346, "sim_render-ego0": 0.003647726838733632, "get_duckie_state": 1.234376956580779e-06, "in-drivable-lane": 1.249999999999993, "deviation-heading": 10.195858865667995, "agent_compute-ego0": 0.03294493792753831, "complete-iteration": 0.184136682902645, "set_robot_commands": 0.002074853665227199, "deviation-center-line": 2.1288767342290087, "driven_lanedir_consec": 9.283751511714373, "sim_compute_sim_state": 0.008577577279668168, "sim_compute_performance-ego0": 0.00181997666053232}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.193799149849546, "get_ui_image": 0.03726624052887852, "step_physics": 0.13912650369585405, "survival_time": 59.99999999999873, "driven_lanedir": 8.376135453619224, "get_state_dump": 0.004913242929285511, "get_robot_state": 0.0039095439879125995, "sim_render-ego0": 0.00410074576251612, "get_duckie_state": 1.513094429568784e-06, "in-drivable-lane": 2.9999999999998757, "deviation-heading": 12.52467172698044, "agent_compute-ego0": 0.03565964512185788, "complete-iteration": 0.2417684381550099, "set_robot_commands": 0.002362675114932604, "deviation-center-line": 2.950672518505998, "driven_lanedir_consec": 5.618959469088649, "sim_compute_sim_state": 0.012190763797490027, "sim_compute_performance-ego0": 0.002143526355193914}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.949091706364904, "get_ui_image": 0.0328771007944404, "step_physics": 0.13898134767562523, "survival_time": 59.99999999999873, "driven_lanedir": 7.228172292842862, "get_state_dump": 0.004916680047752259, "get_robot_state": 0.003797167445301117, "sim_render-ego0": 0.0039850722542412575, "get_duckie_state": 1.2663381482838195e-06, "in-drivable-lane": 5.549999999999909, "deviation-heading": 20.293331801522996, "agent_compute-ego0": 0.019825246709272527, "complete-iteration": 0.22076502171880896, "set_robot_commands": 0.0022565585985271064, "deviation-center-line": 3.821740626642996, "driven_lanedir_consec": 4.971470560450205, "sim_compute_sim_state": 0.011957525909195138, "sim_compute_performance-ego0": 0.0020777029756900173}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.35498445399647, "get_ui_image": 0.02751316416769798, "step_physics": 0.1149933633955194, "survival_time": 59.99999999999873, "driven_lanedir": 7.880115400170923, "get_state_dump": 0.005027233809853077, "get_robot_state": 0.0040435800941460934, "sim_render-ego0": 0.004173626609884829, "get_duckie_state": 1.670518187460157e-06, "in-drivable-lane": 5.600000000000014, "deviation-heading": 16.147449674955034, "agent_compute-ego0": 0.03518827273188582, "complete-iteration": 0.2020607935598153, "set_robot_commands": 0.002378405778235341, "deviation-center-line": 2.7239681944349887, "driven_lanedir_consec": 3.653788545040048, "sim_compute_sim_state": 0.006450233014795206, "sim_compute_performance-ego0": 0.002193042578844107}}
set_robot_commands_max0.002378405778235341
set_robot_commands_mean0.0022681232892305626
set_robot_commands_median0.002309616856729855
set_robot_commands_min0.002074853665227199
sim_compute_performance-ego0_max0.002193042578844107
sim_compute_performance-ego0_mean0.0020585621425650894
sim_compute_performance-ego0_median0.0021106146654419657
sim_compute_performance-ego0_min0.00181997666053232
sim_compute_sim_state_max0.012190763797490027
sim_compute_sim_state_mean0.009794025000287136
sim_compute_sim_state_median0.010267551594431651
sim_compute_sim_state_min0.006450233014795206
sim_render-ego0_max0.004173626609884829
sim_render-ego0_mean0.00397679286634396
sim_render-ego0_median0.004042909008378689
sim_render-ego0_min0.003647726838733632
simulation-passed1
step_physics_max0.13912650369585405
step_physics_mean0.12339263608513228
step_physics_median0.1269873555355723
step_physics_min0.10046932957353044
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5708911312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-020:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5706711283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5690411063Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:34:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.471073770401649
survival_time_median59.99999999999873
deviation-center-line_median3.412372932990175
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012493553407781823
agent_compute-ego0_mean0.012127437659048418
agent_compute-ego0_median0.01216750101284818
agent_compute-ego0_min0.01168119520271549
complete-iteration_max0.1869495407330007
complete-iteration_mean0.1688414659726431
complete-iteration_median0.1695498208221448
complete-iteration_min0.1493166815132821
deviation-center-line_max3.997769033908204
deviation-center-line_mean3.4013647750752285
deviation-center-line_min2.782944200412361
deviation-heading_max10.93796726089042
deviation-heading_mean8.771131647614387
deviation-heading_median8.861775431061844
deviation-heading_min6.4230084674434424
driven_any_max8.481679065412935
driven_any_mean7.714378215090166
driven_any_median7.575401888252175
driven_any_min7.225030018443382
driven_lanedir_consec_max8.377128793537313
driven_lanedir_consec_mean7.592491936520633
driven_lanedir_consec_min7.050691411741925
driven_lanedir_max8.377128793537313
driven_lanedir_mean7.592491936520633
driven_lanedir_median7.471073770401649
driven_lanedir_min7.050691411741925
get_duckie_state_max1.4799421375538288e-06
get_duckie_state_mean1.3984013953673452e-06
get_duckie_state_median1.3951754986892433e-06
get_duckie_state_min1.3233124465370654e-06
get_robot_state_max0.003723388508297224
get_robot_state_mean0.003647327820129141
get_robot_state_median0.0036485790710068062
get_robot_state_min0.0035687646302057247
get_state_dump_max0.00469178303790827
get_state_dump_mean0.004604771472730803
get_state_dump_median0.004583164317522518
get_state_dump_min0.004560974217969908
get_ui_image_max0.03461554564603858
get_ui_image_mean0.029919145456658712
get_ui_image_median0.029639572227725775
get_ui_image_min0.025781891725144716
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.481679065412935, "get_ui_image": 0.028378403653312383, "step_physics": 0.09511772758458475, "survival_time": 59.99999999999873, "driven_lanedir": 8.377128793537313, "get_state_dump": 0.00469178303790827, "get_robot_state": 0.003723388508297224, "sim_render-ego0": 0.003937690085316578, "get_duckie_state": 1.4799421375538288e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.3527758495261235, "agent_compute-ego0": 0.012273299902503832, "complete-iteration": 0.16206278987570072, "set_robot_commands": 0.0022695259091062014, "deviation-center-line": 3.046179935310286, "driven_lanedir_consec": 8.377128793537313, "sim_compute_sim_state": 0.009541487515121575, "sim_compute_performance-ego0": 0.0020332098205718867}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.420709318876207, "get_ui_image": 0.03461554564603858, "step_physics": 0.11182120340650624, "survival_time": 59.99999999999873, "driven_lanedir": 7.268361005900437, "get_state_dump": 0.004560974217969908, "get_robot_state": 0.003611830648633463, "sim_render-ego0": 0.00383885377253422, "get_duckie_state": 1.4027191339980354e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.370775012597564, "agent_compute-ego0": 0.012493553407781823, "complete-iteration": 0.1869495407330007, "set_robot_commands": 0.0021757799620235295, "deviation-center-line": 3.997769033908204, "driven_lanedir_consec": 7.268361005900437, "sim_compute_sim_state": 0.011781083852623424, "sim_compute_performance-ego0": 0.0019580172460144703}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.225030018443382, "get_ui_image": 0.030900740802139167, "step_physics": 0.1056625217720432, "survival_time": 59.99999999999873, "driven_lanedir": 7.050691411741925, "get_state_dump": 0.004573736460778636, "get_robot_state": 0.0035687646302057247, "sim_render-ego0": 0.0037506136866433735, "get_duckie_state": 1.3233124465370654e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.93796726089042, "agent_compute-ego0": 0.012061702123192526, "complete-iteration": 0.17703685176858894, "set_robot_commands": 0.0021021485229415957, "deviation-center-line": 3.778565930670064, "driven_lanedir_consec": 7.050691411741925, "sim_compute_sim_state": 0.01238094737984358, "sim_compute_performance-ego0": 0.0019452194687131048}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.730094457628143, "get_ui_image": 0.025781891725144716, "step_physics": 0.08922387777419015, "survival_time": 59.99999999999873, "driven_lanedir": 7.67378653490286, "get_state_dump": 0.004592592174266399, "get_robot_state": 0.0036853274933801505, "sim_render-ego0": 0.0038771899316233462, "get_duckie_state": 1.3876318633804511e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.4230084674434424, "agent_compute-ego0": 0.01168119520271549, "complete-iteration": 0.1493166815132821, "set_robot_commands": 0.0022472128284463876, "deviation-center-line": 2.782944200412361, "driven_lanedir_consec": 7.67378653490286, "sim_compute_sim_state": 0.006143889161172656, "sim_compute_performance-ego0": 0.0019933919326947393}}
set_robot_commands_max0.0022695259091062014
set_robot_commands_mean0.0021986668056294288
set_robot_commands_median0.0022114963952349588
set_robot_commands_min0.0021021485229415957
sim_compute_performance-ego0_max0.0020332098205718867
sim_compute_performance-ego0_mean0.00198245961699855
sim_compute_performance-ego0_median0.001975704589354605
sim_compute_performance-ego0_min0.0019452194687131048
sim_compute_sim_state_max0.01238094737984358
sim_compute_sim_state_mean0.009961851977190309
sim_compute_sim_state_median0.0106612856838725
sim_compute_sim_state_min0.006143889161172656
sim_render-ego0_max0.003937690085316578
sim_render-ego0_mean0.0038510868690293794
sim_render-ego0_median0.003858021852078783
sim_render-ego0_min0.0037506136866433735
simulation-passed1
step_physics_max0.11182120340650624
step_physics_mean0.1004563326343311
step_physics_median0.100390124678314
step_physics_min0.08922387777419015
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5688611425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-020:01:25
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5682311077Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:09:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3149021380472715
survival_time_median9.975000000000009
deviation-center-line_median0.12188253267766544
in-drivable-lane_median7.975000000000006


other stats
agent_compute-ego0_max0.013596708391919548
agent_compute-ego0_mean0.01309838720738422
agent_compute-ego0_median0.013108965481791432
agent_compute-ego0_min0.012578909474034464
complete-iteration_max0.2236579524146186
complete-iteration_mean0.18133061106496615
complete-iteration_median0.17384719452142322
complete-iteration_min0.15397010280239967
deviation-center-line_max1.1188749840889167
deviation-center-line_mean0.36127329964960586
deviation-center-line_min0.08245314915417581
deviation-heading_max4.524131338849149
deviation-heading_mean1.6331260530921736
deviation-heading_median0.722766321005672
deviation-heading_min0.5628402315082003
driven_any_max7.161388646499181
driven_any_mean2.807809807316765
driven_any_median1.7316424656440046
driven_any_min0.6065656514798712
driven_lanedir_consec_max1.9988457680440983
driven_lanedir_consec_mean0.6993296660964883
driven_lanedir_consec_min0.16866862024731155
driven_lanedir_max1.9988457680440983
driven_lanedir_mean0.6993296660964883
driven_lanedir_median0.3149021380472715
driven_lanedir_min0.16866862024731155
get_duckie_state_max1.3820627793908757e-06
get_duckie_state_mean1.3581731085006907e-06
get_duckie_state_median1.3556823983478518e-06
get_duckie_state_min1.3392648579161844e-06
get_robot_state_max0.003743806624795026
get_robot_state_mean0.003682958979972027
get_robot_state_median0.0036984952494417823
get_robot_state_min0.0035910387962095197
get_state_dump_max0.0048602111836805705
get_state_dump_mean0.004636162836836427
get_state_dump_median0.0046250102043261885
get_state_dump_min0.004434419755012758
get_ui_image_max0.03581649285775644
get_ui_image_mean0.0306954151068364
get_ui_image_median0.02988005105961423
get_ui_image_min0.027205065450360697
in-drivable-lane_max24.64999999999976
in-drivable-lane_mean10.799999999999942
in-drivable-lane_min2.5999999999999934
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.161388646499181, "get_ui_image": 0.027205065450360697, "step_physics": 0.0888515333975515, "survival_time": 38.69999999999994, "driven_lanedir": 1.9988457680440983, "get_state_dump": 0.004434419755012758, "get_robot_state": 0.0035910387962095197, "sim_render-ego0": 0.003831696048859627, "get_duckie_state": 1.3677535518523185e-06, "in-drivable-lane": 24.64999999999976, "deviation-heading": 4.524131338849149, "agent_compute-ego0": 0.012578909474034464, "complete-iteration": 0.15397010280239967, "set_robot_commands": 0.002193208509875882, "deviation-center-line": 1.1188749840889167, "driven_lanedir_consec": 1.9988457680440983, "sim_compute_sim_state": 0.00922894816244802, "sim_compute_performance-ego0": 0.0019704434179490613}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6065656514798712, "get_ui_image": 0.03581649285775644, "step_physics": 0.14740624251189055, "survival_time": 3.999999999999994, "driven_lanedir": 0.16866862024731155, "get_state_dump": 0.004598329096664617, "get_robot_state": 0.003689144864494418, "sim_render-ego0": 0.00405388996924883, "get_duckie_state": 1.3392648579161844e-06, "in-drivable-lane": 2.5999999999999934, "deviation-heading": 0.8045328385580822, "agent_compute-ego0": 0.013596708391919548, "complete-iteration": 0.2236579524146186, "set_robot_commands": 0.002302266933299877, "deviation-center-line": 0.08245314915417581, "driven_lanedir_consec": 0.16866862024731155, "sim_compute_sim_state": 0.01005607475469142, "sim_compute_performance-ego0": 0.002050020076610424}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.54645675618512, "get_ui_image": 0.03228139494829637, "step_physics": 0.1137640182984704, "survival_time": 9.299999999999995, "driven_lanedir": 0.32003220078866734, "get_state_dump": 0.0048602111836805705, "get_robot_state": 0.003743806624795026, "sim_render-ego0": 0.0041004642445773365, "get_duckie_state": 1.3820627793908757e-06, "in-drivable-lane": 7.2499999999999964, "deviation-heading": 0.6409998034532617, "agent_compute-ego0": 0.013404980062800931, "complete-iteration": 0.18536867814905503, "set_robot_commands": 0.002286854912252987, "deviation-center-line": 0.1176358625747966, "driven_lanedir_consec": 0.32003220078866734, "sim_compute_sim_state": 0.008752184118179077, "sim_compute_performance-ego0": 0.002082041878113772}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.9168281751028893, "get_ui_image": 0.027478707170932093, "step_physics": 0.10020480646151247, "survival_time": 10.650000000000016, "driven_lanedir": 0.3097720753058757, "get_state_dump": 0.004651691311987761, "get_robot_state": 0.0037078456343891462, "sim_render-ego0": 0.003883788518816511, "get_duckie_state": 1.3436112448433848e-06, "in-drivable-lane": 8.700000000000015, "deviation-heading": 0.5628402315082003, "agent_compute-ego0": 0.012812950900781935, "complete-iteration": 0.1623257108937914, "set_robot_commands": 0.002267493265811528, "deviation-center-line": 0.12612920278053427, "driven_lanedir_consec": 0.3097720753058757, "sim_compute_sim_state": 0.005268570418669799, "sim_compute_performance-ego0": 0.0019633357769975037}}
set_robot_commands_max0.002302266933299877
set_robot_commands_mean0.0022624559053100687
set_robot_commands_median0.0022771740890322576
set_robot_commands_min0.002193208509875882
sim_compute_performance-ego0_max0.002082041878113772
sim_compute_performance-ego0_mean0.00201646028741769
sim_compute_performance-ego0_median0.0020102317472797428
sim_compute_performance-ego0_min0.0019633357769975037
sim_compute_sim_state_max0.01005607475469142
sim_compute_sim_state_mean0.008326444363497078
sim_compute_sim_state_median0.00899056614031355
sim_compute_sim_state_min0.005268570418669799
sim_render-ego0_max0.0041004642445773365
sim_render-ego0_mean0.003967459695375576
sim_render-ego0_median0.003968839244032671
sim_render-ego0_min0.003831696048859627
simulation-passed1
step_physics_max0.14740624251189055
step_physics_mean0.11255665016735623
step_physics_median0.10698441237999144
step_physics_min0.0888515333975515
survival_time_max38.69999999999994
survival_time_mean15.662499999999987
survival_time_min3.999999999999994
No reset possible
5679511282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:18
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5675611286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:04:08
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5674511286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5673211278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:03:08
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5670411427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-020:02:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5668211289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:04:40
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5578911422Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-021:19:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.00075320404907
survival_time_median59.99999999999873
deviation-center-line_median2.8239357280733985
in-drivable-lane_median0.2499999999999898


other stats
agent_compute-ego0_max0.04328814851155785
agent_compute-ego0_mean0.04088998376876488
agent_compute-ego0_median0.04088998376876488
agent_compute-ego0_min0.03849181902597191
agent_compute-ego1_max0.043693094031201314
agent_compute-ego1_mean0.041192149441009955
agent_compute-ego1_median0.041192149441009955
agent_compute-ego1_min0.03869120485081859
agent_compute-ego2_max0.04338253110175724
agent_compute-ego2_mean0.04084059201509728
agent_compute-ego2_median0.04084059201509728
agent_compute-ego2_min0.03829865292843732
agent_compute-ego3_max0.04303700798854145
agent_compute-ego3_mean0.04081960850016064
agent_compute-ego3_median0.04081960850016064
agent_compute-ego3_min0.03860220901177984
complete-iteration_max1.1046263337830124
complete-iteration_mean1.0426254363778629
complete-iteration_median1.0426254363778629
complete-iteration_min0.9806245389727132
deviation-center-line_max6.993703781443878
deviation-center-line_mean3.936741498504513
deviation-center-line_min1.4439738685565429
deviation-heading_max42.18086494270505
deviation-heading_mean21.323538483824755
deviation-heading_median13.496171805602964
deviation-heading_min8.910009242327769
driven_any_max14.590349051823852
driven_any_mean7.927626305348715
driven_any_median8.415174702140996
driven_any_min0.49155627944869673
driven_lanedir_consec_max14.286955591091672
driven_lanedir_consec_mean7.618726402833628
driven_lanedir_consec_min0.4720865370347065
driven_lanedir_max14.286955591091672
driven_lanedir_mean7.64089806951685
driven_lanedir_median8.000755545699063
driven_lanedir_min0.4720865370347065
get_duckie_state_max1.4011310002488162e-06
get_duckie_state_mean1.2663381482838195e-06
get_duckie_state_median1.2663381482838195e-06
get_duckie_state_min1.1315452963188229e-06
get_robot_state_max0.013816469217915022
get_robot_state_mean0.01316477257842128
get_robot_state_median0.01316477257842128
get_robot_state_min0.012513075938927542
get_state_dump_max0.00905766614172282
get_state_dump_mean0.008651897472505467
get_state_dump_median0.008651897472505467
get_state_dump_min0.008246128803288113
get_ui_image_max0.04908133347167461
get_ui_image_mean0.047140783612476006
get_ui_image_median0.047140783612476006
get_ui_image_min0.0452002337532774
in-drivable-lane_max1.2999999999999954
in-drivable-lane_mean0.4374999999999939
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 14.590274250259988, "get_ui_image": 0.0452002337532774, "step_physics": 0.7106763957243577, "survival_time": 59.99999999999873, "driven_lanedir": 14.285870115338705, "get_state_dump": 0.008246128803288113, "get_robot_state": 0.012513075938927542, "sim_render-ego0": 0.0033630697455235463, "sim_render-ego1": 0.0033267646109829538, "sim_render-ego2": 0.0032966218324227696, "sim_render-ego3": 0.0032984630749882705, "get_duckie_state": 1.1315452963188229e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.65141140471916, "agent_compute-ego0": 0.03849181902597191, "agent_compute-ego1": 0.03869120485081859, "agent_compute-ego2": 0.03829865292843732, "agent_compute-ego3": 0.03860220901177984, "complete-iteration": 0.9806245389727132, "set_robot_commands": 0.0020629726381325704, "deviation-center-line": 2.869488261734872, "driven_lanedir_consec": 14.285870115338705, "sim_compute_sim_state": 0.021974682311630567, "sim_compute_performance-ego0": 0.00177611538412966, "sim_compute_performance-ego1": 0.001628550760553441, "sim_compute_performance-ego2": 0.0016562168445317176, "sim_compute_performance-ego3": 0.001628711162062112}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 2.2400890986044524, "get_ui_image": 0.0452002337532774, "step_physics": 0.7106763957243577, "survival_time": 59.99999999999873, "driven_lanedir": 1.900791696912732, "get_state_dump": 0.008246128803288113, "get_robot_state": 0.012513075938927542, "sim_render-ego0": 0.0033630697455235463, "sim_render-ego1": 0.0033267646109829538, "sim_render-ego2": 0.0032966218324227696, "sim_render-ego3": 0.0032984630749882705, "get_duckie_state": 1.1315452963188229e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 38.71500900662983, "agent_compute-ego0": 0.03849181902597191, "agent_compute-ego1": 0.03869120485081859, "agent_compute-ego2": 0.03829865292843732, "agent_compute-ego3": 0.03860220901177984, "complete-iteration": 0.9806245389727132, "set_robot_commands": 0.0020629726381325704, "deviation-center-line": 6.000862773390881, "driven_lanedir_consec": 1.900791696912732, "sim_compute_sim_state": 0.021974682311630567, "sim_compute_performance-ego0": 0.00177611538412966, "sim_compute_performance-ego1": 0.001628550760553441, "sim_compute_performance-ego2": 0.0016562168445317176, "sim_compute_performance-ego3": 0.001628711162062112}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 14.59026030567754, "get_ui_image": 0.0452002337532774, "step_physics": 0.7106763957243577, "survival_time": 59.99999999999873, "driven_lanedir": 14.286955591091672, "get_state_dump": 0.008246128803288113, "get_robot_state": 0.012513075938927542, "sim_render-ego0": 0.0033630697455235463, "sim_render-ego1": 0.0033267646109829538, "sim_render-ego2": 0.0032966218324227696, "sim_render-ego3": 0.0032984630749882705, "get_duckie_state": 1.1315452963188229e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.77473756366386, "agent_compute-ego0": 0.03849181902597191, "agent_compute-ego1": 0.03869120485081859, "agent_compute-ego2": 0.03829865292843732, "agent_compute-ego3": 0.03860220901177984, "complete-iteration": 0.9806245389727132, "set_robot_commands": 0.0020629726381325704, "deviation-center-line": 2.7783831944119246, "driven_lanedir_consec": 14.286955591091672, "sim_compute_sim_state": 0.021974682311630567, "sim_compute_performance-ego0": 0.00177611538412966, "sim_compute_performance-ego1": 0.001628550760553441, "sim_compute_performance-ego2": 0.0016562168445317176, "sim_compute_performance-ego3": 0.001628711162062112}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.9929039380973048, "get_ui_image": 0.0452002337532774, "step_physics": 0.7106763957243577, "survival_time": 59.99999999999873, "driven_lanedir": 0.8491677542940025, "get_state_dump": 0.008246128803288113, "get_robot_state": 0.012513075938927542, "sim_render-ego0": 0.0033630697455235463, "sim_render-ego1": 0.0033267646109829538, "sim_render-ego2": 0.0032966218324227696, "sim_render-ego3": 0.0032984630749882705, "get_duckie_state": 1.1315452963188229e-06, "in-drivable-lane": 0.14999999999999947, "deviation-heading": 42.18086494270505, "agent_compute-ego0": 0.03849181902597191, "agent_compute-ego1": 0.03869120485081859, "agent_compute-ego2": 0.03829865292843732, "agent_compute-ego3": 0.03860220901177984, "complete-iteration": 0.9806245389727132, "set_robot_commands": 0.0020629726381325704, "deviation-center-line": 6.993703781443878, "driven_lanedir_consec": 0.6900128436534608, "sim_compute_sim_state": 0.021974682311630567, "sim_compute_performance-ego0": 0.00177611538412966, "sim_compute_performance-ego1": 0.001628550760553441, "sim_compute_performance-ego2": 0.0016562168445317176, "sim_compute_performance-ego3": 0.001628711162062112}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 14.590349051823852, "get_ui_image": 0.04908133347167461, "step_physics": 0.8043117660169895, "survival_time": 59.99999999999873, "driven_lanedir": 14.26626045879052, "get_state_dump": 0.00905766614172282, "get_robot_state": 0.013816469217915022, "sim_render-ego0": 0.003742545173130464, "sim_render-ego1": 0.0037882740948222064, "sim_render-ego2": 0.003741088060415555, "sim_render-ego3": 0.0036643553931548336, "get_duckie_state": 1.4011310002488162e-06, "in-drivable-lane": 0.3499999999999801, "deviation-heading": 8.910009242327769, "agent_compute-ego0": 0.04328814851155785, "agent_compute-ego1": 0.043693094031201314, "agent_compute-ego2": 0.04338253110175724, "agent_compute-ego3": 0.04303700798854145, "complete-iteration": 1.1046263337830124, "set_robot_commands": 0.002422880471298637, "deviation-center-line": 2.4063982353198834, "driven_lanedir_consec": 14.266258477145486, "sim_compute_sim_state": 0.02301007127086884, "sim_compute_performance-ego0": 0.001990572796773156, "sim_compute_performance-ego1": 0.001897744790997533, "sim_compute_performance-ego2": 0.0018679750253516969, "sim_compute_performance-ego3": 0.001911321349386172}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 14.590327050880797, "get_ui_image": 0.04908133347167461, "step_physics": 0.8043117660169895, "survival_time": 59.99999999999873, "driven_lanedir": 14.100719394485392, "get_state_dump": 0.00905766614172282, "get_robot_state": 0.013816469217915022, "sim_render-ego0": 0.003742545173130464, "sim_render-ego1": 0.0037882740948222064, "sim_render-ego2": 0.003741088060415555, "sim_render-ego3": 0.0036643553931548336, "get_duckie_state": 1.4011310002488162e-06, "in-drivable-lane": 0.7999999999999794, "deviation-heading": 9.784630456195652, "agent_compute-ego0": 0.04328814851155785, "agent_compute-ego1": 0.043693094031201314, "agent_compute-ego2": 0.04338253110175724, "agent_compute-ego3": 0.04303700798854145, "complete-iteration": 1.1046263337830124, "set_robot_commands": 0.002422880471298637, "deviation-center-line": 2.7297678588323686, "driven_lanedir_consec": 14.100714711185407, "sim_compute_sim_state": 0.02301007127086884, "sim_compute_performance-ego0": 0.001990572796773156, "sim_compute_performance-ego1": 0.001897744790997533, "sim_compute_performance-ego2": 0.0018679750253516969, "sim_compute_performance-ego3": 0.001911321349386172}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.49155627944869673, "get_ui_image": 0.04908133347167461, "step_physics": 0.8043117660169895, "survival_time": 59.99999999999873, "driven_lanedir": 0.4720865370347065, "get_state_dump": 0.00905766614172282, "get_robot_state": 0.013816469217915022, "sim_render-ego0": 0.003742545173130464, "sim_render-ego1": 0.0037882740948222064, "sim_render-ego2": 0.003741088060415555, "sim_render-ego3": 0.0036643553931548336, "get_duckie_state": 1.4011310002488162e-06, "in-drivable-lane": 0.0, "deviation-heading": 33.35403920681466, "agent_compute-ego0": 0.04328814851155785, "agent_compute-ego1": 0.043693094031201314, "agent_compute-ego2": 0.04338253110175724, "agent_compute-ego3": 0.04303700798854145, "complete-iteration": 1.1046263337830124, "set_robot_commands": 0.002422880471298637, "deviation-center-line": 6.271354014345749, "driven_lanedir_consec": 0.4720865370347065, "sim_compute_sim_state": 0.02301007127086884, "sim_compute_performance-ego0": 0.001990572796773156, "sim_compute_performance-ego1": 0.001897744790997533, "sim_compute_performance-ego2": 0.0018679750253516969, "sim_compute_performance-ego3": 0.001911321349386172}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.3352504679970854, "get_ui_image": 0.04908133347167461, "step_physics": 0.8043117660169895, "survival_time": 59.99999999999873, "driven_lanedir": 0.9653330081870644, "get_state_dump": 0.00905766614172282, "get_robot_state": 0.013816469217915022, "sim_render-ego0": 0.003742545173130464, "sim_render-ego1": 0.0037882740948222064, "sim_render-ego2": 0.003741088060415555, "sim_render-ego3": 0.0036643553931548336, "get_duckie_state": 1.4011310002488162e-06, "in-drivable-lane": 1.2999999999999954, "deviation-heading": 16.21760604754207, "agent_compute-ego0": 0.04328814851155785, "agent_compute-ego1": 0.043693094031201314, "agent_compute-ego2": 0.04338253110175724, "agent_compute-ego3": 0.04303700798854145, "complete-iteration": 1.1046263337830124, "set_robot_commands": 0.002422880471298637, "deviation-center-line": 1.4439738685565429, "driven_lanedir_consec": 0.9471212503068523, "sim_compute_sim_state": 0.02301007127086884, "sim_compute_performance-ego0": 0.001990572796773156, "sim_compute_performance-ego1": 0.001897744790997533, "sim_compute_performance-ego2": 0.0018679750253516969, "sim_compute_performance-ego3": 0.001911321349386172}}
set_robot_commands_max0.002422880471298637
set_robot_commands_mean0.002242926554715603
set_robot_commands_median0.002242926554715603
set_robot_commands_min0.0020629726381325704
sim_compute_performance-ego0_max0.001990572796773156
sim_compute_performance-ego0_mean0.001883344090451408
sim_compute_performance-ego0_median0.001883344090451408
sim_compute_performance-ego0_min0.00177611538412966
sim_compute_performance-ego1_max0.001897744790997533
sim_compute_performance-ego1_mean0.0017631477757754869
sim_compute_performance-ego1_median0.0017631477757754869
sim_compute_performance-ego1_min0.001628550760553441
sim_compute_performance-ego2_max0.0018679750253516969
sim_compute_performance-ego2_mean0.0017620959349417072
sim_compute_performance-ego2_median0.0017620959349417072
sim_compute_performance-ego2_min0.0016562168445317176
sim_compute_performance-ego3_max0.001911321349386172
sim_compute_performance-ego3_mean0.001770016255724142
sim_compute_performance-ego3_median0.001770016255724142
sim_compute_performance-ego3_min0.001628711162062112
sim_compute_sim_state_max0.02301007127086884
sim_compute_sim_state_mean0.022492376791249703
sim_compute_sim_state_median0.022492376791249703
sim_compute_sim_state_min0.021974682311630567
sim_render-ego0_max0.003742545173130464
sim_render-ego0_mean0.003552807459327005
sim_render-ego0_median0.003552807459327005
sim_render-ego0_min0.0033630697455235463
sim_render-ego1_max0.0037882740948222064
sim_render-ego1_mean0.00355751935290258
sim_render-ego1_median0.00355751935290258
sim_render-ego1_min0.0033267646109829538
sim_render-ego2_max0.003741088060415555
sim_render-ego2_mean0.0035188549464191627
sim_render-ego2_median0.0035188549464191627
sim_render-ego2_min0.0032966218324227696
sim_render-ego3_max0.0036643553931548336
sim_render-ego3_mean0.003481409234071552
sim_render-ego3_median0.003481409234071552
sim_render-ego3_min0.0032984630749882705
simulation-passed1
step_physics_max0.8043117660169895
step_physics_mean0.7574940808706736
step_physics_median0.7574940808706736
step_physics_min0.7106763957243577
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5574011290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:14
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5565111281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5561111284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:33
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5557311284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:45
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5549511285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5546411291Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5537711306Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:03:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5535811299Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:32
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5530011307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:06
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5527911310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5526111310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5524011287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5522711301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:33
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5520011302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5518211302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5515211450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-020:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5513411296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5511211308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:56
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5508311303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5500611332Olga (Ge Ya) Xu 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:05:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5497911305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5492711317Marco Calì 🇮🇹template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.012195143434736464
agent_compute-ego0_mean0.01084637233452907
agent_compute-ego0_median0.01063407882104946
agent_compute-ego0_min0.00992218826128089
complete-iteration_max0.20272884766260785
complete-iteration_mean0.17061007816335613
complete-iteration_median0.16933308017732812
complete-iteration_min0.14104530463616052
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.4172659979926216e-06
get_duckie_state_mean1.3296598270020632e-06
get_duckie_state_median1.3274293911607958e-06
get_duckie_state_min1.2465145276940388e-06
get_robot_state_max0.003871344857745701
get_robot_state_mean0.003603282711986722
get_robot_state_median0.0036044132105911833
get_robot_state_min0.0033329595690188203
get_state_dump_max0.0053027404679192435
get_state_dump_mean0.004816189545554641
get_state_dump_median0.004831101713930001
get_state_dump_min0.004299814286439315
get_ui_image_max0.03193979130850898
get_ui_image_mean0.02852365645311013
get_ui_image_median0.02902617515872059
get_ui_image_min0.024102484186490376
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.026661100266854976, "step_physics": 0.09807703163050398, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004994307892232002, "get_robot_state": 0.003633680222909662, "sim_render-ego0": 0.0039052978346619423, "get_duckie_state": 1.3882600808445411e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.01087331620952751, "complete-iteration": 0.1614818014676058, "set_robot_commands": 0.002024996129772331, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.009305184400534327, "sim_compute_performance-ego0": 0.0019219389444665063}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.031391250050586204, "step_physics": 0.11250898112421452, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.004299814286439315, "get_robot_state": 0.0033329595690188203, "sim_render-ego0": 0.0035627795302349587, "get_duckie_state": 1.2465145276940388e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.00992218826128089, "complete-iteration": 0.17718435888705047, "set_robot_commands": 0.002050005871316661, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.008157271405924921, "sim_compute_performance-ego0": 0.0018772560617198112}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.03193979130850898, "step_physics": 0.13249548607402378, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.0053027404679192435, "get_robot_state": 0.003871344857745701, "sim_render-ego0": 0.004467089970906575, "get_duckie_state": 1.4172659979926216e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.012195143434736464, "complete-iteration": 0.20272884766260785, "set_robot_commands": 0.002268943521711562, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007923116286595663, "sim_compute_performance-ego0": 0.002172281344731649}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.024102484186490376, "step_physics": 0.08588629215955734, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004667895535628001, "get_robot_state": 0.003575146198272705, "sim_render-ego0": 0.003575461606184642, "get_duckie_state": 1.2665987014770508e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.010394841432571411, "complete-iteration": 0.14104530463616052, "set_robot_commands": 0.0021121452252070108, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.004710003733634949, "sim_compute_performance-ego0": 0.0019362643361091616}}
set_robot_commands_max0.002268943521711562
set_robot_commands_mean0.0021140226870018913
set_robot_commands_median0.002081075548261836
set_robot_commands_min0.002024996129772331
sim_compute_performance-ego0_max0.002172281344731649
sim_compute_performance-ego0_mean0.001976935171756782
sim_compute_performance-ego0_median0.001929101640287834
sim_compute_performance-ego0_min0.0018772560617198112
sim_compute_sim_state_max0.009305184400534327
sim_compute_sim_state_mean0.0075238939566724655
sim_compute_sim_state_median0.008040193846260292
sim_compute_sim_state_min0.004710003733634949
sim_render-ego0_max0.004467089970906575
sim_render-ego0_mean0.0038776572354970295
sim_render-ego0_median0.003740379720423292
sim_render-ego0_min0.0035627795302349587
simulation-passed1
step_physics_max0.13249548607402378
step_physics_mean0.1072419477470749
step_physics_median0.10529300637735924
step_physics_min0.08588629215955734
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5489911336Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:03:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5489011439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5487911439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5485611350Martin Cote 🇨🇦template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.01237432493103875
agent_compute-ego0_mean0.011303169626394287
agent_compute-ego0_median0.011148058653009024
agent_compute-ego0_min0.010542236268520355
complete-iteration_max0.21675552751706997
complete-iteration_mean0.1885478901385529
complete-iteration_median0.19185322013836872
complete-iteration_min0.15372959276040396
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.5497207641601562e-06
get_duckie_state_mean1.4499241940320424e-06
get_duckie_state_median1.4656116231562478e-06
get_duckie_state_min1.3187527656555176e-06
get_robot_state_max0.003893242941962348
get_robot_state_mean0.0037590946533122586
get_robot_state_median0.0037557136283142153
get_robot_state_min0.003631708414658256
get_state_dump_max0.0048496656947665745
get_state_dump_mean0.004744291468764061
get_state_dump_median0.004735638610465092
get_state_dump_min0.004656222959359487
get_ui_image_max0.03620224931965704
get_ui_image_mean0.030965722250346488
get_ui_image_median0.03084455390687398
get_ui_image_min0.025971531867980957
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02856687956218478, "step_physics": 0.10684241826021218, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004755474344084534, "get_robot_state": 0.0038342279723927943, "sim_render-ego0": 0.003844259660455245, "get_duckie_state": 1.542175872416436e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.011349060867406145, "complete-iteration": 0.17373098904573464, "set_robot_commands": 0.0022644860835015017, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.010099201262751711, "sim_compute_performance-ego0": 0.002084970474243164}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03620224931965704, "step_physics": 0.14342179246570752, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.00471580287684565, "get_robot_state": 0.003631708414658256, "sim_render-ego0": 0.00383699717728988, "get_duckie_state": 1.3890473738960598e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.010947056438611902, "complete-iteration": 0.21675552751706997, "set_robot_commands": 0.0022392402524533477, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.009596264880636463, "sim_compute_performance-ego0": 0.002074099105337392}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.03312222825156318, "step_physics": 0.13897903429137337, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.0048496656947665745, "get_robot_state": 0.003893242941962348, "sim_render-ego0": 0.004044231441285875, "get_duckie_state": 1.5497207641601562e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.01237432493103875, "complete-iteration": 0.2099754512310028, "set_robot_commands": 0.0022681819068060983, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.00818252232339647, "sim_compute_performance-ego0": 0.0021706554624769422}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.025971531867980957, "step_physics": 0.0961190362771352, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004656222959359487, "get_robot_state": 0.003677199284235636, "sim_render-ego0": 0.003704408804575602, "get_duckie_state": 1.3187527656555176e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.010542236268520355, "complete-iteration": 0.15372959276040396, "set_robot_commands": 0.0021757235129674277, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.00489749014377594, "sim_compute_performance-ego0": 0.0019053568442662556}}
set_robot_commands_max0.0022681819068060983
set_robot_commands_mean0.002236907938932094
set_robot_commands_median0.0022518631679774247
set_robot_commands_min0.0021757235129674277
sim_compute_performance-ego0_max0.0021706554624769422
sim_compute_performance-ego0_mean0.0020587704715809385
sim_compute_performance-ego0_median0.002079534789790278
sim_compute_performance-ego0_min0.0019053568442662556
sim_compute_sim_state_max0.010099201262751711
sim_compute_sim_state_mean0.008193869652640146
sim_compute_sim_state_median0.008889393602016467
sim_compute_sim_state_min0.00489749014377594
sim_render-ego0_max0.004044231441285875
sim_render-ego0_mean0.00385747427090165
sim_render-ego0_median0.003840628418872562
sim_render-ego0_min0.003704408804575602
simulation-passed1
step_physics_max0.14342179246570752
step_physics_mean0.12134057032360708
step_physics_median0.12291072627579278
step_physics_min0.0961190362771352
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5485211436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5476811367Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:13:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.237229569816706
survival_time_median18.65000000000013
deviation-center-line_median0.6213039668073084
in-drivable-lane_median5.475000000000015


other stats
agent_compute-ego0_max0.012825431107868069
agent_compute-ego0_mean0.012576690820819872
agent_compute-ego0_median0.01267531007877146
agent_compute-ego0_min0.012130712017868504
complete-iteration_max0.22187238726122627
complete-iteration_mean0.1920201882512876
complete-iteration_median0.1896320598222357
complete-iteration_min0.16694424609945277
deviation-center-line_max2.0021851664954373
deviation-center-line_mean0.8536599716985763
deviation-center-line_min0.1698467866842514
deviation-heading_max6.067328418802793
deviation-heading_mean3.004820727691959
deviation-heading_median2.6277624015218084
deviation-heading_min0.6964296889214261
driven_any_max7.619824039163689
driven_any_mean3.7997849869906384
driven_any_median3.02418232808159
driven_any_min1.5309512526356857
driven_lanedir_consec_max3.920335760315131
driven_lanedir_consec_mean2.268781188148359
driven_lanedir_consec_min0.6803298526448938
driven_lanedir_max3.920335760315131
driven_lanedir_mean2.2729539622887818
driven_lanedir_median2.245575118097552
driven_lanedir_min0.6803298526448938
get_duckie_state_max1.5724706285782444e-06
get_duckie_state_mean1.486798928494896e-06
get_duckie_state_median1.5064246311757527e-06
get_duckie_state_min1.3618758230498342e-06
get_robot_state_max0.00392658604776918
get_robot_state_mean0.003845947562786456
get_robot_state_median0.003887251464387272
get_robot_state_min0.0036827012746021
get_state_dump_max0.005157959285040794
get_state_dump_mean0.00501523691723712
get_state_dump_median0.005030769549556664
get_state_dump_min0.004841449284794355
get_ui_image_max0.03677880118045901
get_ui_image_mean0.03098518247814014
get_ui_image_median0.030478629808893203
get_ui_image_min0.026204669114315148
in-drivable-lane_max19.649999999999764
in-drivable-lane_mean8.312499999999957
in-drivable-lane_min2.6500000000000377
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.619824039163689, "get_ui_image": 0.02848123472762169, "step_physics": 0.10835270754253593, "survival_time": 39.24999999999991, "driven_lanedir": 3.920335760315131, "get_state_dump": 0.005017841741935594, "get_robot_state": 0.003871951697740239, "sim_render-ego0": 0.0039648530440779435, "get_duckie_state": 1.5724706285782444e-06, "in-drivable-lane": 19.649999999999764, "deviation-heading": 2.6455224729526545, "agent_compute-ego0": 0.012825431107868069, "complete-iteration": 0.1780523119385309, "set_robot_commands": 0.0022603670756022134, "deviation-center-line": 0.9597300826170068, "driven_lanedir_consec": 3.920335760315131, "sim_compute_sim_state": 0.011059481679028227, "sim_compute_performance-ego0": 0.002118981824879731}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5309512526356857, "get_ui_image": 0.03677880118045901, "step_physics": 0.14435653850950045, "survival_time": 10.100000000000009, "driven_lanedir": 0.7170073974282234, "get_state_dump": 0.005157959285040794, "get_robot_state": 0.00392658604776918, "sim_render-ego0": 0.003999960246344505, "get_duckie_state": 1.5644017111491688e-06, "in-drivable-lane": 4.65000000000002, "deviation-heading": 2.6100023300909627, "agent_compute-ego0": 0.012670632066397833, "complete-iteration": 0.22187238726122627, "set_robot_commands": 0.0023960538685615426, "deviation-center-line": 0.28287785099761004, "driven_lanedir_consec": 0.7003163008665312, "sim_compute_sim_state": 0.010351385389055523, "sim_compute_performance-ego0": 0.0021389435077535696}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.337473756026242, "get_ui_image": 0.03247602489016472, "step_physics": 0.12713446617126464, "survival_time": 27.20000000000025, "driven_lanedir": 3.77414283876688, "get_state_dump": 0.005043697357177734, "get_robot_state": 0.003902551231034305, "sim_render-ego0": 0.003978216976200768, "get_duckie_state": 1.4484475512023369e-06, "in-drivable-lane": 2.6500000000000377, "deviation-heading": 6.067328418802793, "agent_compute-ego0": 0.012679988091145086, "complete-iteration": 0.2012118077059405, "set_robot_commands": 0.002318300894641001, "deviation-center-line": 2.0021851664954373, "driven_lanedir_consec": 3.77414283876688, "sim_compute_sim_state": 0.011443381353255806, "sim_compute_performance-ego0": 0.002136249279757158}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7108909001369388, "get_ui_image": 0.026204669114315148, "step_physics": 0.10676312085353969, "survival_time": 9.850000000000003, "driven_lanedir": 0.6803298526448938, "get_state_dump": 0.004841449284794355, "get_robot_state": 0.0036827012746021, "sim_render-ego0": 0.0038968384867966777, "get_duckie_state": 1.3618758230498342e-06, "in-drivable-lane": 6.30000000000001, "deviation-heading": 0.6964296889214261, "agent_compute-ego0": 0.012130712017868504, "complete-iteration": 0.16694424609945277, "set_robot_commands": 0.0022374054398199526, "deviation-center-line": 0.1698467866842514, "driven_lanedir_consec": 0.6803298526448938, "sim_compute_sim_state": 0.0051614708370632595, "sim_compute_performance-ego0": 0.001935571131080088}}
set_robot_commands_max0.0023960538685615426
set_robot_commands_mean0.0023030318196561777
set_robot_commands_median0.0022893339851216073
set_robot_commands_min0.0022374054398199526
sim_compute_performance-ego0_max0.0021389435077535696
sim_compute_performance-ego0_mean0.0020824364358676367
sim_compute_performance-ego0_median0.0021276155523184447
sim_compute_performance-ego0_min0.001935571131080088
sim_compute_sim_state_max0.011443381353255806
sim_compute_sim_state_mean0.009503929814600706
sim_compute_sim_state_median0.010705433534041875
sim_compute_sim_state_min0.0051614708370632595
sim_render-ego0_max0.003999960246344505
sim_render-ego0_mean0.003959967188354974
sim_render-ego0_median0.003971535010139356
sim_render-ego0_min0.0038968384867966777
simulation-passed1
step_physics_max0.14435653850950045
step_physics_mean0.12165170826921018
step_physics_median0.11774358685690028
step_physics_min0.10676312085353969
survival_time_max39.24999999999991
survival_time_mean21.600000000000044
survival_time_min9.850000000000003
No reset possible
5470011385Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:09:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.041409524380163
survival_time_median10.125000000000009
deviation-center-line_median0.2805032465289558
in-drivable-lane_median4.374999999999993


other stats
agent_compute-ego0_max0.01287028884256123
agent_compute-ego0_mean0.012787787453586446
agent_compute-ego0_median0.012810065477842008
agent_compute-ego0_min0.012660730016100538
complete-iteration_max0.22589486717377733
complete-iteration_mean0.1877365125759122
complete-iteration_median0.18279907370946968
complete-iteration_min0.15945303571093214
deviation-center-line_max0.5989393032321834
deviation-center-line_mean0.32338629568257854
deviation-center-line_min0.13359938644021924
deviation-heading_max1.6982191035716552
deviation-heading_mean1.3935986399707825
deviation-heading_median1.5373756952376307
deviation-heading_min0.8014240658362133
driven_any_max3.170808478561816
driven_any_mean2.1597089226407067
driven_any_median2.0878570128970457
driven_any_min1.2923131862069193
driven_lanedir_consec_max2.1453537284177253
driven_lanedir_consec_mean1.2308924476253649
driven_lanedir_consec_min0.6953970133234078
driven_lanedir_max2.1453537284177253
driven_lanedir_mean1.2308924476253649
driven_lanedir_median1.041409524380163
driven_lanedir_min0.6953970133234078
get_duckie_state_max1.4993168363635172e-06
get_duckie_state_mean1.4288836099718207e-06
get_duckie_state_median1.4552208384605846e-06
get_duckie_state_min1.3057759266025972e-06
get_robot_state_max0.003901931263456409
get_robot_state_mean0.0038186197054175582
get_robot_state_median0.003855143767055823
get_robot_state_min0.003662260024102179
get_state_dump_max0.005130244581491355
get_state_dump_mean0.00502147727161439
get_state_dump_median0.005090457940470041
get_state_dump_min0.00477474862402612
get_ui_image_max0.03662992963854898
get_ui_image_mean0.03079589848451108
get_ui_image_median0.030493093866737035
get_ui_image_min0.02556747656602126
in-drivable-lane_max9.250000000000044
in-drivable-lane_mean4.912500000000013
in-drivable-lane_min1.6500000000000234
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.439997654362788, "get_ui_image": 0.02880754894680447, "step_physics": 0.110167965359158, "survival_time": 11.200000000000024, "driven_lanedir": 2.1453537284177253, "get_state_dump": 0.005103298823038737, "get_robot_state": 0.003857914606730143, "sim_render-ego0": 0.003972767723931207, "get_duckie_state": 1.4930301242404514e-06, "in-drivable-lane": 1.6500000000000234, "deviation-heading": 1.6982191035716552, "agent_compute-ego0": 0.012802908155653213, "complete-iteration": 0.17905062569512262, "set_robot_commands": 0.002280746036105686, "deviation-center-line": 0.5989393032321834, "driven_lanedir_consec": 2.1453537284177253, "sim_compute_sim_state": 0.009829290178087022, "sim_compute_performance-ego0": 0.0021317534976535374}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2923131862069193, "get_ui_image": 0.03662992963854898, "step_physics": 0.14856806697461428, "survival_time": 7.399999999999982, "driven_lanedir": 0.7699745773480864, "get_state_dump": 0.005130244581491355, "get_robot_state": 0.003901931263456409, "sim_render-ego0": 0.00389201369061566, "get_duckie_state": 1.4993168363635172e-06, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 1.4662128978219398, "agent_compute-ego0": 0.012817222800030803, "complete-iteration": 0.22589486717377733, "set_robot_commands": 0.002348773431457929, "deviation-center-line": 0.24122864568190147, "driven_lanedir_consec": 0.7699745773480864, "sim_compute_sim_state": 0.010386081349929709, "sim_compute_performance-ego0": 0.0021238663052552498}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.170808478561816, "get_ui_image": 0.0321786387866696, "step_physics": 0.11323194709045208, "survival_time": 15.05000000000008, "driven_lanedir": 1.3128444714122396, "get_state_dump": 0.005077617057901345, "get_robot_state": 0.003852372927381503, "sim_render-ego0": 0.004090418089304539, "get_duckie_state": 1.3057759266025972e-06, "in-drivable-lane": 9.250000000000044, "deviation-heading": 1.6085384926533215, "agent_compute-ego0": 0.01287028884256123, "complete-iteration": 0.18654752172381672, "set_robot_commands": 0.0022673598977903655, "deviation-center-line": 0.3197778473760101, "driven_lanedir_consec": 1.3128444714122396, "sim_compute_sim_state": 0.010752082660498208, "sim_compute_performance-ego0": 0.0021328065569037632}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.735716371431304, "get_ui_image": 0.02556747656602126, "step_physics": 0.09960903833200643, "survival_time": 9.049999999999994, "driven_lanedir": 0.6953970133234078, "get_state_dump": 0.00477474862402612, "get_robot_state": 0.003662260024102179, "sim_render-ego0": 0.0038442415195507006, "get_duckie_state": 1.4174115526807178e-06, "in-drivable-lane": 5.849999999999997, "deviation-heading": 0.8014240658362133, "agent_compute-ego0": 0.012660730016100538, "complete-iteration": 0.15945303571093214, "set_robot_commands": 0.0021986175369430373, "deviation-center-line": 0.13359938644021924, "driven_lanedir_consec": 0.6953970133234078, "sim_compute_sim_state": 0.0050187621797834125, "sim_compute_performance-ego0": 0.0020251588507013006}}
set_robot_commands_max0.002348773431457929
set_robot_commands_mean0.002273874225574254
set_robot_commands_median0.0022740529669480255
set_robot_commands_min0.0021986175369430373
sim_compute_performance-ego0_max0.0021328065569037632
sim_compute_performance-ego0_mean0.0021033963026284627
sim_compute_performance-ego0_median0.002127809901454394
sim_compute_performance-ego0_min0.0020251588507013006
sim_compute_sim_state_max0.010752082660498208
sim_compute_sim_state_mean0.008996554092074588
sim_compute_sim_state_median0.010107685764008363
sim_compute_sim_state_min0.0050187621797834125
sim_render-ego0_max0.004090418089304539
sim_render-ego0_mean0.003949860255850527
sim_render-ego0_median0.003932390707273433
sim_render-ego0_min0.0038442415195507006
simulation-passed1
step_physics_max0.14856806697461428
step_physics_mean0.11789425443905768
step_physics_median0.11169995622480502
step_physics_min0.09960903833200643
survival_time_max15.05000000000008
survival_time_mean10.675000000000018
survival_time_min7.399999999999982
No reset possible
5467411424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:11
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5464411400Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:02:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5451311476Raphael Jeansim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:33:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.611678638965657
survival_time_median59.99999999999873
deviation-center-line_median2.859357104817642
in-drivable-lane_median0.10000000000000142


other stats
agent_compute-ego0_max0.012577317146040635
agent_compute-ego0_mean0.01225594755759064
agent_compute-ego0_median0.012237232789508909
agent_compute-ego0_min0.011972007505304113
complete-iteration_max0.233968251353001
complete-iteration_mean0.20231072063158712
complete-iteration_median0.1983245561561616
complete-iteration_min0.17862551886102426
deviation-center-line_max3.344618135910853
deviation-center-line_mean2.680737456999407
deviation-center-line_min1.659617482451491
deviation-heading_max14.951637973143558
deviation-heading_mean11.135533810171026
deviation-heading_median11.525562035023786
deviation-heading_min6.5393731974929805
driven_any_max14.42779947393909
driven_any_mean11.026503057107318
driven_any_median11.899039624598483
driven_any_min5.880133505293214
driven_lanedir_consec_max14.08080239226503
driven_lanedir_consec_mean8.671313000771692
driven_lanedir_consec_min3.381092332890419
driven_lanedir_max14.08080239226503
driven_lanedir_mean10.07244171603899
driven_lanedir_median11.413936069500254
driven_lanedir_min3.381092332890419
get_duckie_state_max1.463460626069063e-06
get_duckie_state_mean1.379938184573516e-06
get_duckie_state_median1.3831652372107716e-06
get_duckie_state_min1.289961637803458e-06
get_robot_state_max0.003954645269405768
get_robot_state_mean0.003886119231044783
get_robot_state_median0.003883940691157841
get_robot_state_min0.003821950272457685
get_state_dump_max0.004922503640192636
get_state_dump_mean0.004806225768652164
get_state_dump_median0.004803696540273496
get_state_dump_min0.004695006353869029
get_ui_image_max0.03686760784088821
get_ui_image_mean0.03167674997889219
get_ui_image_median0.03105971914445431
get_ui_image_min0.027719953785771908
in-drivable-lane_max12.100000000000149
in-drivable-lane_mean3.0750000000000375
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.42779947393909, "get_ui_image": 0.029384509609898957, "step_physics": 0.11337311500117345, "survival_time": 59.99999999999873, "driven_lanedir": 14.08080239226503, "get_state_dump": 0.004837736102762468, "get_robot_state": 0.003916899826405547, "sim_render-ego0": 0.003968127264170523, "get_duckie_state": 1.4311070247653322e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.736195130186005, "agent_compute-ego0": 0.012134088068381637, "complete-iteration": 0.18234075535147712, "set_robot_commands": 0.002361922339535474, "deviation-center-line": 2.559838699912205, "driven_lanedir_consec": 14.08080239226503, "sim_compute_sim_state": 0.010128962407997506, "sim_compute_performance-ego0": 0.002142468658116934}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.753977368549371, "get_ui_image": 0.03686760784088821, "step_physics": 0.15321867253560012, "survival_time": 59.99999999999873, "driven_lanedir": 11.38501261956148, "get_state_dump": 0.004769656977784524, "get_robot_state": 0.003850981555910134, "sim_render-ego0": 0.003958093633659674, "get_duckie_state": 1.335223449656211e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.314928939861566, "agent_compute-ego0": 0.012340377510636175, "complete-iteration": 0.233968251353001, "set_robot_commands": 0.002345419843230617, "deviation-center-line": 3.1588755097230785, "driven_lanedir_consec": 11.38501261956148, "sim_compute_sim_state": 0.014380971954625217, "sim_compute_performance-ego0": 0.002149362945239014}, "LF-norm-techtrack-000-ego0": {"driven_any": 12.044101880647592, "get_ui_image": 0.03273492867900966, "step_physics": 0.14033159903940015, "survival_time": 59.99999999999873, "driven_lanedir": 11.442859519439027, "get_state_dump": 0.004695006353869029, "get_robot_state": 0.003821950272457685, "sim_render-ego0": 0.003914446755313159, "get_duckie_state": 1.289961637803458e-06, "in-drivable-lane": 0.20000000000000284, "deviation-heading": 14.951637973143558, "agent_compute-ego0": 0.011972007505304113, "complete-iteration": 0.21430835696084613, "set_robot_commands": 0.002340877979224568, "deviation-center-line": 3.344618135910853, "driven_lanedir_consec": 5.838344658369836, "sim_compute_sim_state": 0.012270679084784184, "sim_compute_performance-ego0": 0.0021393388435306596}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.880133505293214, "get_ui_image": 0.027719953785771908, "step_physics": 0.1145635317571415, "survival_time": 32.15000000000031, "driven_lanedir": 3.381092332890419, "get_state_dump": 0.004922503640192636, "get_robot_state": 0.003954645269405768, "sim_render-ego0": 0.0040175785189089566, "get_duckie_state": 1.463460626069063e-06, "in-drivable-lane": 12.100000000000149, "deviation-heading": 6.5393731974929805, "agent_compute-ego0": 0.012577317146040635, "complete-iteration": 0.17862551886102426, "set_robot_commands": 0.0024599740223854964, "deviation-center-line": 1.659617482451491, "driven_lanedir_consec": 3.381092332890419, "sim_compute_sim_state": 0.006121516597937353, "sim_compute_performance-ego0": 0.0021985410163121192}}
set_robot_commands_max0.0024599740223854964
set_robot_commands_mean0.002377048546094039
set_robot_commands_median0.0023536710913830456
set_robot_commands_min0.002340877979224568
sim_compute_performance-ego0_max0.0021985410163121192
sim_compute_performance-ego0_mean0.002157427865799682
sim_compute_performance-ego0_median0.002145915801677974
sim_compute_performance-ego0_min0.0021393388435306596
sim_compute_sim_state_max0.014380971954625217
sim_compute_sim_state_mean0.010725532511336063
sim_compute_sim_state_median0.011199820746390844
sim_compute_sim_state_min0.006121516597937353
sim_render-ego0_max0.0040175785189089566
sim_render-ego0_mean0.003964561543013078
sim_render-ego0_median0.003963110448915098
sim_render-ego0_min0.003914446755313159
simulation-passed1
step_physics_max0.15321867253560012
step_physics_mean0.1303717295833288
step_physics_median0.12744756539827082
step_physics_min0.11337311500117345
survival_time_max59.99999999999873
survival_time_mean53.03749999999913
survival_time_min32.15000000000031
No reset possible
5443511543Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:30:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.545949347088044
survival_time_median59.99999999999873
deviation-center-line_median3.6015085652763013
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013030792453902448
agent_compute-ego0_mean0.01243642347076685
agent_compute-ego0_median0.012481461155589938
agent_compute-ego0_min0.011751979117985074
complete-iteration_max0.21460590513421535
complete-iteration_mean0.1999647300977228
complete-iteration_median0.20182210400539272
complete-iteration_min0.1816088072458903
deviation-center-line_max4.1830008763998
deviation-center-line_mean2.8853252287276265
deviation-center-line_min0.15528290795810468
deviation-heading_max14.063834890310158
deviation-heading_mean10.26170416804429
deviation-heading_median13.012539453167395
deviation-heading_min0.9579028755322058
driven_any_max11.901035443353278
driven_any_mean9.061868717621769
driven_any_median10.934725818864267
driven_any_min2.4769877894052605
driven_lanedir_consec_max11.453392914037122
driven_lanedir_consec_mean8.29936655997257
driven_lanedir_consec_min0.6521746316770678
driven_lanedir_max11.453392914037122
driven_lanedir_mean8.299827108594938
driven_lanedir_median10.545949347088044
driven_lanedir_min0.6540168261665367
get_duckie_state_max1.6824291905793023e-06
get_duckie_state_mean1.5429048580558245e-06
get_duckie_state_median1.5607050250643928e-06
get_duckie_state_min1.3677801915152087e-06
get_robot_state_max0.004050027520134487
get_robot_state_mean0.003911806991985034
get_robot_state_median0.003944100017121458
get_robot_state_min0.003709000413562733
get_state_dump_max0.005336423003604073
get_state_dump_mean0.00497736227568606
get_state_dump_median0.004943722659536378
get_state_dump_min0.004685580780067412
get_ui_image_max0.034965266990820434
get_ui_image_mean0.03136178207271734
get_ui_image_median0.031534631980845176
get_ui_image_min0.02741259733835856
in-drivable-lane_max11.60000000000008
in-drivable-lane_mean2.9000000000000203
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.901035443353278, "get_ui_image": 0.029288338582581227, "step_physics": 0.12115582875863996, "survival_time": 59.99999999999873, "driven_lanedir": 11.453392914037122, "get_state_dump": 0.0049470086379611025, "get_robot_state": 0.0039594774937054, "sim_render-ego0": 0.003928210316450769, "get_duckie_state": 1.6824291905793023e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.540633249202516, "agent_compute-ego0": 0.012270955618573267, "complete-iteration": 0.18983340203811683, "set_robot_commands": 0.0023422930063951223, "deviation-center-line": 3.402476090830002, "driven_lanedir_consec": 11.453392914037122, "sim_compute_sim_state": 0.009717194265767398, "sim_compute_performance-ego0": 0.002128176049924115}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.819519570262898, "get_ui_image": 0.034965266990820434, "step_physics": 0.13827910292257775, "survival_time": 59.99999999999873, "driven_lanedir": 10.39140457777951, "get_state_dump": 0.004685580780067412, "get_robot_state": 0.003709000413562733, "sim_render-ego0": 0.003711735973945764, "get_duckie_state": 1.3677801915152087e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.063834890310158, "agent_compute-ego0": 0.011751979117985074, "complete-iteration": 0.21460590513421535, "set_robot_commands": 0.002168984734744057, "deviation-center-line": 4.1830008763998, "driven_lanedir_consec": 10.39140457777951, "sim_compute_sim_state": 0.01327347576767082, "sim_compute_performance-ego0": 0.00197136689979369}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.049932067465638, "get_ui_image": 0.03378092537910912, "step_physics": 0.13489904471182207, "survival_time": 59.99999999999873, "driven_lanedir": 10.70049411639658, "get_state_dump": 0.005336423003604073, "get_robot_state": 0.004050027520134487, "sim_render-ego0": 0.004073300429128985, "get_duckie_state": 1.532747584715374e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.484445657132278, "agent_compute-ego0": 0.013030792453902448, "complete-iteration": 0.21381080597266863, "set_robot_commands": 0.002471077749870103, "deviation-center-line": 3.8005410397226016, "driven_lanedir_consec": 10.70049411639658, "sim_compute_sim_state": 0.013867975968703143, "sim_compute_performance-ego0": 0.0021967085870874615}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.4769877894052605, "get_ui_image": 0.02741259733835856, "step_physics": 0.11881478150685627, "survival_time": 14.950000000000076, "driven_lanedir": 0.6540168261665367, "get_state_dump": 0.0049404366811116535, "get_robot_state": 0.003928722540537517, "sim_render-ego0": 0.003929907480875651, "get_duckie_state": 1.5886624654134114e-06, "in-drivable-lane": 11.60000000000008, "deviation-heading": 0.9579028755322058, "agent_compute-ego0": 0.012691966692606608, "complete-iteration": 0.1816088072458903, "set_robot_commands": 0.0024007622400919596, "deviation-center-line": 0.15528290795810468, "driven_lanedir_consec": 0.6521746316770678, "sim_compute_sim_state": 0.005301643212636312, "sim_compute_performance-ego0": 0.002090024948120118}}
set_robot_commands_max0.002471077749870103
set_robot_commands_mean0.0023457794327753105
set_robot_commands_median0.002371527623243541
set_robot_commands_min0.002168984734744057
sim_compute_performance-ego0_max0.0021967085870874615
sim_compute_performance-ego0_mean0.0020965691212313457
sim_compute_performance-ego0_median0.002109100499022116
sim_compute_performance-ego0_min0.00197136689979369
sim_compute_sim_state_max0.013867975968703143
sim_compute_sim_state_mean0.01054007230369442
sim_compute_sim_state_median0.01149533501671911
sim_compute_sim_state_min0.005301643212636312
sim_render-ego0_max0.004073300429128985
sim_render-ego0_mean0.003910788550100292
sim_render-ego0_median0.00392905889866321
sim_render-ego0_min0.003711735973945764
simulation-passed1
step_physics_max0.13827910292257775
step_physics_mean0.12828718947497403
step_physics_median0.128027436735231
step_physics_min0.11881478150685627
survival_time_max59.99999999999873
survival_time_mean48.737499999999066
survival_time_min14.950000000000076
No reset possible
5435911566Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:22:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9796683576507668
survival_time_median41.94999999999946
deviation-center-line_median0.5187958739171133
in-drivable-lane_median25.37499999999986


other stats
agent_compute-ego0_max0.013727632390767906
agent_compute-ego0_mean0.01314036133992394
agent_compute-ego0_median0.013341302508623174
agent_compute-ego0_min0.0121512079516815
complete-iteration_max0.19076999418939977
complete-iteration_mean0.17288786131441533
complete-iteration_median0.1745086981447251
complete-iteration_min0.15176405477881133
deviation-center-line_max2.707422069466323
deviation-center-line_mean1.0005629585276246
deviation-center-line_min0.25723801680994873
deviation-heading_max6.965955703974146
deviation-heading_mean3.347099446157851
deviation-heading_median2.827499860807864
deviation-heading_min0.7674423590415304
driven_any_max14.075675988260532
driven_any_mean8.569310590982166
driven_any_median8.498283869245904
driven_any_min3.2049986371763186
driven_lanedir_consec_max7.010548806162326
driven_lanedir_consec_mean2.390586603405387
driven_lanedir_consec_min0.5924608921576864
driven_lanedir_max7.010548806162326
driven_lanedir_mean2.390586603405387
driven_lanedir_median0.9796683576507668
driven_lanedir_min0.5924608921576864
get_duckie_state_max1.546485438974018e-06
get_duckie_state_mean1.3840824063960736e-06
get_duckie_state_median1.3452485439481584e-06
get_duckie_state_min1.2993470987139596e-06
get_robot_state_max0.003980464875573654
get_robot_state_mean0.003814171024070912
get_robot_state_median0.003860477062203035
get_robot_state_min0.0035552650963039225
get_state_dump_max0.004908831482889259
get_state_dump_mean0.004747129067075222
get_state_dump_median0.0047979814757359365
get_state_dump_min0.0044837218339397545
get_ui_image_max0.03586651919584886
get_ui_image_mean0.030787991583337452
get_ui_image_median0.03018641827056858
get_ui_image_min0.026912610596363788
in-drivable-lane_max51.34999999999866
in-drivable-lane_mean28.899999999999626
in-drivable-lane_min13.500000000000115
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.075675988260532, "get_ui_image": 0.026912610596363788, "step_physics": 0.08736821217501194, "survival_time": 59.99999999999873, "driven_lanedir": 7.010548806162326, "get_state_dump": 0.0044837218339397545, "get_robot_state": 0.0035552650963039225, "sim_render-ego0": 0.0036743127932457207, "get_duckie_state": 1.3052474251396948e-06, "in-drivable-lane": 30.599999999999515, "deviation-heading": 6.965955703974146, "agent_compute-ego0": 0.0121512079516815, "complete-iteration": 0.15176405477881133, "set_robot_commands": 0.002105379382537664, "deviation-center-line": 2.707422069466323, "driven_lanedir_consec": 7.010548806162326, "sim_compute_sim_state": 0.009512369082829635, "sim_compute_performance-ego0": 0.0019209380947878517}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.56903178426536, "get_ui_image": 0.03586651919584886, "step_physics": 0.10924778036233487, "survival_time": 59.99999999999873, "driven_lanedir": 1.3155083176706643, "get_state_dump": 0.0047929257179279315, "get_robot_state": 0.003839331602276017, "sim_render-ego0": 0.003984958107128032, "get_duckie_state": 1.3852496627566222e-06, "in-drivable-lane": 51.34999999999866, "deviation-heading": 3.956849500935315, "agent_compute-ego0": 0.013727632390767906, "complete-iteration": 0.19076999418939977, "set_robot_commands": 0.0023503535792392853, "deviation-center-line": 0.7773210726519036, "driven_lanedir_consec": 1.3155083176706643, "sim_compute_sim_state": 0.014693098401745392, "sim_compute_performance-ego0": 0.002176801529057714}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.2049986371763186, "get_ui_image": 0.033333091134669784, "step_physics": 0.1131332562782703, "survival_time": 17.400000000000112, "driven_lanedir": 0.5924608921576864, "get_state_dump": 0.0048030372335439424, "get_robot_state": 0.0038816225221300535, "sim_render-ego0": 0.004100206588264181, "get_duckie_state": 1.2993470987139596e-06, "in-drivable-lane": 13.500000000000115, "deviation-heading": 0.7674423590415304, "agent_compute-ego0": 0.01308287727115489, "complete-iteration": 0.18726130884492975, "set_robot_commands": 0.00234670557060351, "deviation-center-line": 0.25723801680994873, "driven_lanedir_consec": 0.5924608921576864, "sim_compute_sim_state": 0.01036034682418692, "sim_compute_performance-ego0": 0.002132251816014506}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.427535954226448, "get_ui_image": 0.02703974540646738, "step_physics": 0.0968393283995308, "survival_time": 23.900000000000205, "driven_lanedir": 0.6438283976308692, "get_state_dump": 0.004908831482889259, "get_robot_state": 0.003980464875573654, "sim_render-ego0": 0.004016871243279762, "get_duckie_state": 1.546485438974018e-06, "in-drivable-lane": 20.150000000000208, "deviation-heading": 1.6981502206804124, "agent_compute-ego0": 0.013599727746091457, "complete-iteration": 0.16175608744452044, "set_robot_commands": 0.00233148980986848, "deviation-center-line": 0.2602706751823231, "driven_lanedir_consec": 0.6438283976308692, "sim_compute_sim_state": 0.006819131230013853, "sim_compute_performance-ego0": 0.00213031081914404}}
set_robot_commands_max0.0023503535792392853
set_robot_commands_mean0.0022834820855622347
set_robot_commands_median0.002339097690235995
set_robot_commands_min0.002105379382537664
sim_compute_performance-ego0_max0.002176801529057714
sim_compute_performance-ego0_mean0.0020900755647510283
sim_compute_performance-ego0_median0.002131281317579273
sim_compute_performance-ego0_min0.0019209380947878517
sim_compute_sim_state_max0.014693098401745392
sim_compute_sim_state_mean0.01034623638469395
sim_compute_sim_state_median0.00993635795350828
sim_compute_sim_state_min0.006819131230013853
sim_render-ego0_max0.004100206588264181
sim_render-ego0_mean0.003944087182979424
sim_render-ego0_median0.0040009146752038975
sim_render-ego0_min0.0036743127932457207
simulation-passed1
step_physics_max0.1131332562782703
step_physics_mean0.10164714430378698
step_physics_median0.10304355438093282
step_physics_min0.08736821217501194
survival_time_max59.99999999999873
survival_time_mean40.32499999999944
survival_time_min17.400000000000112
No reset possible
5430611587Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:07:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5425211618Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-020:18:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5424211624Anthony Courchesne 🇨🇦TNetR1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:07
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5417111645Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:26:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.190381660444942
survival_time_median43.02499999999948
deviation-center-line_median0.6569756185962708
in-drivable-lane_median20.050000000000196


other stats
agent_compute-ego0_max0.012986171925925737
agent_compute-ego0_mean0.01254972553590228
agent_compute-ego0_median0.012513206761445132
agent_compute-ego0_min0.012186316694793116
complete-iteration_max0.2405032105092502
complete-iteration_mean0.20952100833834025
complete-iteration_median0.211180269666078
complete-iteration_min0.1752202835119547
deviation-center-line_max3.7915803013641214
deviation-center-line_mean1.311423124537823
deviation-center-line_min0.1401609595946285
deviation-heading_max16.178797054337167
deviation-heading_mean5.528127132595391
deviation-heading_median2.564488858571456
deviation-heading_min0.8047337589014875
driven_any_max12.225377269890144
driven_any_mean8.055312545531581
driven_any_median8.140468176891025
driven_any_min3.7149365584541303
driven_lanedir_consec_max8.841815653649611
driven_lanedir_consec_mean3.4755080442945916
driven_lanedir_consec_min0.6794532026388694
driven_lanedir_max8.841815653649611
driven_lanedir_mean3.4755080442945916
driven_lanedir_median2.190381660444942
driven_lanedir_min0.6794532026388694
get_duckie_state_max1.331121099202272e-06
get_duckie_state_mean1.2655137394905782e-06
get_duckie_state_median1.253434561571412e-06
get_duckie_state_min1.2240647356172174e-06
get_robot_state_max0.003834514991131353
get_robot_state_mean0.003777186842936212
get_robot_state_median0.0037785646543311226
get_robot_state_min0.003717103071951251
get_state_dump_max0.004782681429652363
get_state_dump_mean0.0047103308076701
get_state_dump_median0.004692887412844999
get_state_dump_min0.004672866975338036
get_ui_image_max0.03600083699730612
get_ui_image_mean0.031004460019892585
get_ui_image_median0.03098718155071825
get_ui_image_min0.02604263998082771
in-drivable-lane_max43.64999999999863
in-drivable-lane_mean23.74999999999971
in-drivable-lane_min11.24999999999982
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.225377269890144, "get_ui_image": 0.02915921020666626, "step_physics": 0.13114358701872686, "survival_time": 59.99999999999873, "driven_lanedir": 3.6986385935377455, "get_state_dump": 0.00470289640085187, "get_robot_state": 0.003834514991131353, "sim_render-ego0": 0.003876857614636322, "get_duckie_state": 1.2560152789138934e-06, "in-drivable-lane": 43.64999999999863, "deviation-heading": 4.295711399290396, "agent_compute-ego0": 0.012542903075905068, "complete-iteration": 0.19985037957698876, "set_robot_commands": 0.0022864859864475525, "deviation-center-line": 1.1627824299017946, "driven_lanedir_consec": 3.6986385935377455, "sim_compute_sim_state": 0.010116010978755904, "sim_compute_performance-ego0": 0.0020982784395114666}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.218781554067377, "get_ui_image": 0.03600083699730612, "step_physics": 0.16296340980498022, "survival_time": 59.99999999999873, "driven_lanedir": 8.841815653649611, "get_state_dump": 0.004672866975338036, "get_robot_state": 0.003717103071951251, "sim_render-ego0": 0.003862893750129592, "get_duckie_state": 1.2508538442289304e-06, "in-drivable-lane": 11.24999999999982, "deviation-heading": 16.178797054337167, "agent_compute-ego0": 0.0124835104469852, "complete-iteration": 0.2405032105092502, "set_robot_commands": 0.0022901847499494847, "deviation-center-line": 3.7915803013641214, "driven_lanedir_consec": 8.841815653649611, "sim_compute_sim_state": 0.012326598068161077, "sim_compute_performance-ego0": 0.00209907786633748}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.7149365584541303, "get_ui_image": 0.032815152894770244, "step_physics": 0.14845943865054298, "survival_time": 20.10000000000015, "driven_lanedir": 0.6794532026388694, "get_state_dump": 0.004782681429652363, "get_robot_state": 0.0038236702050523782, "sim_render-ego0": 0.003899758861910912, "get_duckie_state": 1.331121099202272e-06, "in-drivable-lane": 17.200000000000152, "deviation-heading": 0.8047337589014875, "agent_compute-ego0": 0.012986171925925737, "complete-iteration": 0.22251015975516725, "set_robot_commands": 0.002329653605042261, "deviation-center-line": 0.15116880729074705, "driven_lanedir_consec": 0.6794532026388694, "sim_compute_sim_state": 0.01121977008601868, "sim_compute_performance-ego0": 0.0020984698170172073}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.0621547997146745, "get_ui_image": 0.02604263998082771, "step_physics": 0.11395562882624367, "survival_time": 26.050000000000235, "driven_lanedir": 0.6821247273521394, "get_state_dump": 0.004682878424838128, "get_robot_state": 0.003733459103609867, "sim_render-ego0": 0.0038237635659988814, "get_duckie_state": 1.2240647356172174e-06, "in-drivable-lane": 22.90000000000024, "deviation-heading": 0.8332663178525156, "agent_compute-ego0": 0.012186316694793116, "complete-iteration": 0.1752202835119547, "set_robot_commands": 0.002282956550861227, "deviation-center-line": 0.1401609595946285, "driven_lanedir_consec": 0.6821247273521394, "sim_compute_sim_state": 0.006372259494445333, "sim_compute_performance-ego0": 0.0020539331253461}}
set_robot_commands_max0.002329653605042261
set_robot_commands_mean0.0022973202230751315
set_robot_commands_median0.0022883353681985184
set_robot_commands_min0.002282956550861227
sim_compute_performance-ego0_max0.00209907786633748
sim_compute_performance-ego0_mean0.0020874398120530636
sim_compute_performance-ego0_median0.0020983741282643367
sim_compute_performance-ego0_min0.0020539331253461
sim_compute_sim_state_max0.012326598068161077
sim_compute_sim_state_mean0.010008659656845246
sim_compute_sim_state_median0.01066789053238729
sim_compute_sim_state_min0.006372259494445333
sim_render-ego0_max0.003899758861910912
sim_render-ego0_mean0.0038658184481689265
sim_render-ego0_median0.0038698756823829566
sim_render-ego0_min0.0038237635659988814
simulation-passed1
step_physics_max0.16296340980498022
step_physics_mean0.13913051607512344
step_physics_median0.13980151283463493
step_physics_min0.11395562882624367
survival_time_max59.99999999999873
survival_time_mean41.53749999999946
survival_time_min20.10000000000015
No reset possible
5415211649Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:07:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9962114855168606
survival_time_median11.57500000000003
deviation-center-line_median0.3329790900548567
in-drivable-lane_median4.825000000000042


other stats
agent_compute-ego0_max0.01321097874733472
agent_compute-ego0_mean0.0126117357007694
agent_compute-ego0_median0.012525161096464585
agent_compute-ego0_min0.012185641862813708
complete-iteration_max0.2420821562409401
complete-iteration_mean0.19154260483505617
complete-iteration_median0.17887604194150925
complete-iteration_min0.16633617921626612
deviation-center-line_max0.53346798713707
deviation-center-line_mean0.35056715332945193
deviation-center-line_min0.20284244607102445
deviation-heading_max2.2429290048132113
deviation-heading_mean1.855694567375246
deviation-heading_median1.7670507552927943
deviation-heading_min1.645747754102184
driven_any_max2.8457862505649656
driven_any_mean2.2897338693226614
driven_any_median2.4007623044541413
driven_any_min1.5116246178173984
driven_lanedir_consec_max1.9734215158789332
driven_lanedir_consec_mean1.162086618011874
driven_lanedir_consec_min0.6825019851348415
driven_lanedir_max1.9734215158789332
driven_lanedir_mean1.244083583342353
driven_lanedir_median1.1108657210721518
driven_lanedir_min0.7811813753461752
get_duckie_state_max2.232297507032004e-06
get_duckie_state_mean2.0626366178761735e-06
get_duckie_state_median2.0397302595157066e-06
get_duckie_state_min1.9387884454412778e-06
get_robot_state_max0.003893342257466555
get_robot_state_mean0.003776380978051864
get_robot_state_median0.00383165302949074
get_robot_state_min0.0035488755957594196
get_state_dump_max0.005173913300267518
get_state_dump_mean0.004918462023555828
get_state_dump_median0.00490113873403151
get_state_dump_min0.004697657325892773
get_ui_image_max0.03618456870317459
get_ui_image_mean0.030560694834061097
get_ui_image_median0.02931845323763388
get_ui_image_min0.027421304157802036
in-drivable-lane_max6.600000000000063
in-drivable-lane_mean4.962500000000033
in-drivable-lane_min3.599999999999987
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.8457862505649656, "get_ui_image": 0.027421304157802036, "step_physics": 0.099857237749484, "survival_time": 13.600000000000058, "driven_lanedir": 1.9734215158789332, "get_state_dump": 0.004841901443816804, "get_robot_state": 0.003853180469610752, "sim_render-ego0": 0.003804770144787464, "get_duckie_state": 1.9387884454412778e-06, "in-drivable-lane": 4.4000000000000625, "deviation-heading": 1.8207286012434825, "agent_compute-ego0": 0.012391589063427823, "complete-iteration": 0.16633617921626612, "set_robot_commands": 0.0022098904564267115, "deviation-center-line": 0.53346798713707, "driven_lanedir_consec": 1.9734215158789332, "sim_compute_sim_state": 0.009780903875609455, "sim_compute_performance-ego0": 0.002077023188273112}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5116246178173984, "get_ui_image": 0.03618456870317459, "step_physics": 0.16594136655330655, "survival_time": 7.94999999999998, "driven_lanedir": 0.7811813753461752, "get_state_dump": 0.004960376024246216, "get_robot_state": 0.003810125589370728, "sim_render-ego0": 0.003912074863910675, "get_duckie_state": 2.0667910575866698e-06, "in-drivable-lane": 3.599999999999987, "deviation-heading": 1.7133729093421064, "agent_compute-ego0": 0.012658733129501342, "complete-iteration": 0.2420821562409401, "set_robot_commands": 0.0023071929812431336, "deviation-center-line": 0.3445354716248362, "driven_lanedir_consec": 0.6825019851348415, "sim_compute_sim_state": 0.01012466847896576, "sim_compute_performance-ego0": 0.0020847544074058533}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.0622315028598495, "get_ui_image": 0.030689509169569293, "step_physics": 0.11662293290628972, "survival_time": 10.25000000000001, "driven_lanedir": 0.9299744597117674, "get_state_dump": 0.004697657325892773, "get_robot_state": 0.0035488755957594196, "sim_render-ego0": 0.0036933584120667096, "get_duckie_state": 2.012669461444743e-06, "in-drivable-lane": 5.25000000000002, "deviation-heading": 1.645747754102184, "agent_compute-ego0": 0.012185641862813708, "complete-iteration": 0.1835870071522241, "set_robot_commands": 0.002121721656577101, "deviation-center-line": 0.20284244607102445, "driven_lanedir_consec": 0.7006659886011848, "sim_compute_sim_state": 0.007977861802554826, "sim_compute_performance-ego0": 0.001953392352872682}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.7392931060484327, "get_ui_image": 0.02794739730569847, "step_physics": 0.1090443907557307, "survival_time": 12.900000000000048, "driven_lanedir": 1.2917569824325363, "get_state_dump": 0.005173913300267518, "get_robot_state": 0.003893342257466555, "sim_render-ego0": 0.004015361940538561, "get_duckie_state": 2.232297507032004e-06, "in-drivable-lane": 6.600000000000063, "deviation-heading": 2.2429290048132113, "agent_compute-ego0": 0.01321097874733472, "complete-iteration": 0.17416507673079443, "set_robot_commands": 0.0024660443707322523, "deviation-center-line": 0.32142270848487714, "driven_lanedir_consec": 1.2917569824325363, "sim_compute_sim_state": 0.006123125783264867, "sim_compute_performance-ego0": 0.002184573287669296}}
set_robot_commands_max0.0024660443707322523
set_robot_commands_mean0.0022762123662448
set_robot_commands_median0.0022585417188349223
set_robot_commands_min0.002121721656577101
sim_compute_performance-ego0_max0.002184573287669296
sim_compute_performance-ego0_mean0.002074935809055236
sim_compute_performance-ego0_median0.0020808887978394823
sim_compute_performance-ego0_min0.001953392352872682
sim_compute_sim_state_max0.01012466847896576
sim_compute_sim_state_mean0.008501639985098728
sim_compute_sim_state_median0.008879382839082142
sim_compute_sim_state_min0.006123125783264867
sim_render-ego0_max0.004015361940538561
sim_render-ego0_mean0.003856391340325853
sim_render-ego0_median0.0038584225043490697
sim_render-ego0_min0.0036933584120667096
simulation-passed1
step_physics_max0.16594136655330655
step_physics_mean0.12286648199120272
step_physics_median0.1128336618310102
step_physics_min0.099857237749484
survival_time_max13.600000000000058
survival_time_mean11.175000000000024
survival_time_min7.94999999999998
No reset possible
5412811674Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-020:10:04
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5407911675Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:15:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7113561451256407
survival_time_median13.350000000000074
deviation-center-line_median0.7516429193407725
in-drivable-lane_median4.850000000000026


other stats
agent_compute-ego0_max0.0133464723570734
agent_compute-ego0_mean0.012996018263235506
agent_compute-ego0_median0.012974491387585867
agent_compute-ego0_min0.012688617920696884
complete-iteration_max0.315312691223927
complete-iteration_mean0.25521826878224385
complete-iteration_median0.2497247218575337
complete-iteration_min0.20611094018998097
deviation-center-line_max3.5135263755492643
deviation-center-line_mean1.312804251762938
deviation-center-line_min0.2344047928209418
deviation-heading_max16.39700949125306
deviation-heading_mean6.05741962949573
deviation-heading_median3.313928928756355
deviation-heading_min1.2048111692171493
driven_any_max23.690580422483404
driven_any_mean8.725277143084792
driven_any_median4.875872176971907
driven_any_min1.4587837959119494
driven_lanedir_consec_max5.192864830725641
driven_lanedir_consec_mean2.8022739352967156
driven_lanedir_consec_min0.5935186202099398
driven_lanedir_max14.594014233000928
driven_lanedir_mean5.270417936967766
driven_lanedir_median2.9377931037322154
driven_lanedir_min0.6120713074057056
get_duckie_state_max1.4225452213697046e-06
get_duckie_state_mean1.3729903604907368e-06
get_duckie_state_median1.376509810725641e-06
get_duckie_state_min1.3163965991419605e-06
get_robot_state_max0.004066015027233006
get_robot_state_mean0.003947986364054727
get_robot_state_median0.003968140604426796
get_robot_state_min0.003789649220132312
get_state_dump_max0.005491104322610442
get_state_dump_mean0.00507957238722597
get_state_dump_median0.005036193810966742
get_state_dump_min0.004754797604359953
get_ui_image_max0.0376633415874253
get_ui_image_mean0.03203090710935553
get_ui_image_median0.03188543449872369
get_ui_image_min0.02668941785254943
in-drivable-lane_max18.34999999999965
in-drivable-lane_mean7.574999999999923
in-drivable-lane_min2.249999999999992
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.8807691339248445, "get_ui_image": 0.02986497696942532, "step_physics": 0.16975999788907944, "survival_time": 20.90000000000016, "driven_lanedir": 5.206280480166778, "get_state_dump": 0.004982534058054194, "get_robot_state": 0.003949765658321699, "sim_render-ego0": 0.003911916851143849, "get_duckie_state": 1.4225452213697046e-06, "in-drivable-lane": 6.250000000000066, "deviation-heading": 5.223213218928393, "agent_compute-ego0": 0.012892839732204248, "complete-iteration": 0.2400518214787959, "set_robot_commands": 0.0022730019325857232, "deviation-center-line": 1.265902747996, "driven_lanedir_consec": 5.192864830725641, "sim_compute_sim_state": 0.01020976011963619, "sim_compute_performance-ego0": 0.0021126190631657058}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.8709752200189689, "get_ui_image": 0.0376633415874253, "step_physics": 0.23583938729049816, "survival_time": 5.799999999999987, "driven_lanedir": 0.6120713074057056, "get_state_dump": 0.005089853563879291, "get_robot_state": 0.003986515550531893, "sim_render-ego0": 0.004053804609510634, "get_duckie_state": 1.3163965991419605e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 1.4046446385843177, "agent_compute-ego0": 0.0133464723570734, "complete-iteration": 0.315312691223927, "set_robot_commands": 0.0023564864427615437, "deviation-center-line": 0.2344047928209418, "driven_lanedir_consec": 0.5935186202099398, "sim_compute_sim_state": 0.010760235990214553, "sim_compute_performance-ego0": 0.0021244664477486895}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4587837959119494, "get_ui_image": 0.03390589202802206, "step_physics": 0.18504834912486912, "survival_time": 4.799999999999991, "driven_lanedir": 0.6693057272976528, "get_state_dump": 0.005491104322610442, "get_robot_state": 0.004066015027233006, "sim_render-ego0": 0.004210383621687742, "get_duckie_state": 1.410848086642236e-06, "in-drivable-lane": 2.249999999999992, "deviation-heading": 1.2048111692171493, "agent_compute-ego0": 0.013056143042967492, "complete-iteration": 0.2593976222362715, "set_robot_commands": 0.0023939486631413096, "deviation-center-line": 0.23738309068554525, "driven_lanedir_consec": 0.6693057272976528, "sim_compute_sim_state": 0.008842092199423878, "sim_compute_performance-ego0": 0.0022856451801418027}, "LF-norm-small_loop-000-ego0": {"driven_any": 23.690580422483404, "get_ui_image": 0.02668941785254943, "step_physics": 0.14381316718610498, "survival_time": 59.99999999999873, "driven_lanedir": 14.594014233000928, "get_state_dump": 0.004754797604359953, "get_robot_state": 0.003789649220132312, "sim_render-ego0": 0.003779809341938867, "get_duckie_state": 1.3421715348090458e-06, "in-drivable-lane": 18.34999999999965, "deviation-heading": 16.39700949125306, "agent_compute-ego0": 0.012688617920696884, "complete-iteration": 0.20611094018998097, "set_robot_commands": 0.0022680441803181795, "deviation-center-line": 3.5135263755492643, "driven_lanedir_consec": 4.753406562953629, "sim_compute_sim_state": 0.006279607696596729, "sim_compute_performance-ego0": 0.001960971571821456}}
set_robot_commands_max0.0023939486631413096
set_robot_commands_mean0.002322870304701689
set_robot_commands_median0.0023147441876736332
set_robot_commands_min0.0022680441803181795
sim_compute_performance-ego0_max0.0022856451801418027
sim_compute_performance-ego0_mean0.0021209255657194132
sim_compute_performance-ego0_median0.002118542755457198
sim_compute_performance-ego0_min0.001960971571821456
sim_compute_sim_state_max0.010760235990214553
sim_compute_sim_state_mean0.009022924001467838
sim_compute_sim_state_median0.009525926159530034
sim_compute_sim_state_min0.006279607696596729
sim_render-ego0_max0.004210383621687742
sim_render-ego0_mean0.003988978606070273
sim_render-ego0_median0.003982860730327241
sim_render-ego0_min0.003779809341938867
simulation-passed1
step_physics_max0.23583938729049816
step_physics_mean0.1836152253726379
step_physics_median0.1774041735069743
step_physics_min0.14381316718610498
survival_time_max59.99999999999873
survival_time_mean22.874999999999716
survival_time_min4.799999999999991
No reset possible
5400311693Mo Kleit 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:21:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.983551794479826
survival_time_median39.54999999999989
deviation-center-line_median1.581787740765965
in-drivable-lane_median20.499999999999893


other stats
agent_compute-ego0_max0.012688980768146996
agent_compute-ego0_mean0.012254955793849597
agent_compute-ego0_median0.012218470613601462
agent_compute-ego0_min0.011893901180048455
complete-iteration_max0.28889321429388864
complete-iteration_mean0.25397011783640333
complete-iteration_median0.2563611603364899
complete-iteration_min0.21426493637874475
deviation-center-line_max2.0269784376011004
deviation-center-line_mean1.3511386293999157
deviation-center-line_min0.21400059846663164
deviation-heading_max9.2934071484533
deviation-heading_mean6.2146437395140275
deviation-heading_median7.232947394522342
deviation-heading_min1.0992730205581256
driven_any_max18.81967091284469
driven_any_mean12.769111393913176
driven_any_median15.245788745299372
driven_any_min1.765197172209273
driven_lanedir_consec_max7.864459642112954
driven_lanedir_consec_mean4.1227775316995725
driven_lanedir_consec_min0.659546895725684
driven_lanedir_max7.864459642112954
driven_lanedir_mean5.161852554576413
driven_lanedir_median6.061701840233507
driven_lanedir_min0.659546895725684
get_duckie_state_max1.385807991027832e-06
get_duckie_state_mean1.3472352386175922e-06
get_duckie_state_median1.3425055124885736e-06
get_duckie_state_min1.318121938465389e-06
get_robot_state_max0.003885973781961053
get_robot_state_mean0.003837396686953114
get_robot_state_median0.003864157352768919
get_robot_state_min0.0037352982603135656
get_state_dump_max0.004965805581637791
get_state_dump_mean0.004824718977875591
get_state_dump_median0.004799234343799939
get_state_dump_min0.004734601642264694
get_ui_image_max0.03678049147129059
get_ui_image_mean0.031824364736305746
get_ui_image_median0.03174376652059175
get_ui_image_min0.027029434432748887
in-drivable-lane_max28.799999999999507
in-drivable-lane_mean18.27499999999982
in-drivable-lane_min3.2999999999999883
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 13.658277859350806, "get_ui_image": 0.03019924432459012, "step_physics": 0.17584268106541162, "survival_time": 35.450000000000124, "driven_lanedir": 7.864459642112954, "get_state_dump": 0.004788866513211962, "get_robot_state": 0.003857740214173223, "sim_render-ego0": 0.003971484681250344, "get_duckie_state": 1.339509453572018e-06, "in-drivable-lane": 13.199999999999925, "deviation-heading": 8.432114304308396, "agent_compute-ego0": 0.012156653740036657, "complete-iteration": 0.245049584415597, "set_robot_commands": 0.00240470590725751, "deviation-center-line": 2.0269784376011004, "driven_lanedir_consec": 7.864459642112954, "sim_compute_sim_state": 0.009625471477777186, "sim_compute_performance-ego0": 0.0021172876089391576}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.765197172209273, "get_ui_image": 0.03678049147129059, "step_physics": 0.21247410561357225, "survival_time": 5.549999999999988, "driven_lanedir": 0.659546895725684, "get_state_dump": 0.004965805581637791, "get_robot_state": 0.003870574491364615, "sim_render-ego0": 0.003958919218608311, "get_duckie_state": 1.385807991027832e-06, "in-drivable-lane": 3.2999999999999883, "deviation-heading": 1.0992730205581256, "agent_compute-ego0": 0.012280287487166268, "complete-iteration": 0.28889321429388864, "set_robot_commands": 0.0023352312190192087, "deviation-center-line": 0.21400059846663164, "driven_lanedir_consec": 0.659546895725684, "sim_compute_sim_state": 0.010070941277912684, "sim_compute_performance-ego0": 0.0020654776266642977}, "LF-norm-techtrack-000-ego0": {"driven_any": 16.833299631247936, "get_ui_image": 0.03328828871659338, "step_physics": 0.19112253734667187, "survival_time": 43.64999999999966, "driven_lanedir": 5.496179086890747, "get_state_dump": 0.004809602174387917, "get_robot_state": 0.003885973781961053, "sim_render-ego0": 0.003975198525313109, "get_duckie_state": 1.318121938465389e-06, "in-drivable-lane": 27.799999999999866, "deviation-heading": 6.033780484736289, "agent_compute-ego0": 0.012688980768146996, "complete-iteration": 0.26767273625738286, "set_robot_commands": 0.002396227566001071, "deviation-center-line": 1.227373960518538, "driven_lanedir_consec": 5.494468216738909, "sim_compute_sim_state": 0.013221221057446652, "sim_compute_performance-ego0": 0.0021899971318190374}, "LF-norm-small_loop-000-ego0": {"driven_any": 18.81967091284469, "get_ui_image": 0.027029434432748887, "step_physics": 0.1523825394325569, "survival_time": 48.74999999999937, "driven_lanedir": 6.627224593576268, "get_state_dump": 0.004734601642264694, "get_robot_state": 0.0037352982603135656, "sim_render-ego0": 0.0038685744903126703, "get_duckie_state": 1.3455015714051297e-06, "in-drivable-lane": 28.799999999999507, "deviation-heading": 9.2934071484533, "agent_compute-ego0": 0.011893901180048455, "complete-iteration": 0.21426493637874475, "set_robot_commands": 0.0022571541246820667, "deviation-center-line": 1.936201521013392, "driven_lanedir_consec": 2.4726353722207435, "sim_compute_sim_state": 0.006273919685942228, "sim_compute_performance-ego0": 0.0019980263514596907}}
set_robot_commands_max0.00240470590725751
set_robot_commands_mean0.0023483297042399646
set_robot_commands_median0.0023657293925101403
set_robot_commands_min0.0022571541246820667
sim_compute_performance-ego0_max0.0021899971318190374
sim_compute_performance-ego0_mean0.002092697179720546
sim_compute_performance-ego0_median0.002091382617801727
sim_compute_performance-ego0_min0.0019980263514596907
sim_compute_sim_state_max0.013221221057446652
sim_compute_sim_state_mean0.009797888374769689
sim_compute_sim_state_median0.009848206377844934
sim_compute_sim_state_min0.006273919685942228
sim_render-ego0_max0.003975198525313109
sim_render-ego0_mean0.003943544228871108
sim_render-ego0_median0.003965201949929328
sim_render-ego0_min0.0038685744903126703
simulation-passed1
step_physics_max0.21247410561357225
step_physics_mean0.18295546586455316
step_physics_median0.18348260920604176
step_physics_min0.1523825394325569
survival_time_max48.74999999999937
survival_time_mean33.34999999999978
survival_time_min5.549999999999988
No reset possible
5397211714Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:11:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5269825729323203
survival_time_median18.35000000000013
deviation-center-line_median0.5071123792874171
in-drivable-lane_median10.70000000000013


other stats
agent_compute-ego0_max0.012830155463951469
agent_compute-ego0_mean0.012691601858962454
agent_compute-ego0_median0.012752869581847806
agent_compute-ego0_min0.012430512808202728
complete-iteration_max0.24902571313749483
complete-iteration_mean0.22248981102081997
complete-iteration_median0.2276076929364042
complete-iteration_min0.18571814507297668
deviation-center-line_max0.8188028876426184
deviation-center-line_mean0.5579219553548925
deviation-center-line_min0.3986601752021174
deviation-heading_max3.787999676488114
deviation-heading_mean2.4491329187368396
deviation-heading_median2.38599676572744
deviation-heading_min1.2365384670043642
driven_any_max4.775381020376003
driven_any_mean2.9429523934734156
driven_any_median2.953791684074931
driven_any_min1.088845185367797
driven_lanedir_consec_max2.002795824124016
driven_lanedir_consec_mean1.5294179165961108
driven_lanedir_consec_min1.060910696395786
driven_lanedir_max2.135688887005629
driven_lanedir_mean1.562641182316514
driven_lanedir_median1.5269825729323203
driven_lanedir_min1.060910696395786
get_duckie_state_max2.072109439508702e-06
get_duckie_state_mean2.058146714801281e-06
get_duckie_state_median2.060521616304071e-06
get_duckie_state_min2.0394341870882786e-06
get_robot_state_max0.0038528187503262456
get_robot_state_mean0.003737501539339181
get_robot_state_median0.0037154370484036433
get_robot_state_min0.003666313310223188
get_state_dump_max0.004807423216125276
get_state_dump_mean0.004723876687434169
get_state_dump_median0.004737772985537083
get_state_dump_min0.0046125375625372346
get_ui_image_max0.03675206696114889
get_ui_image_mean0.03142684569387792
get_ui_image_median0.031320356520088716
get_ui_image_min0.026314602774185365
in-drivable-lane_max17.650000000000208
in-drivable-lane_mean9.762500000000117
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.478323310307508, "get_ui_image": 0.0296053471050196, "step_physics": 0.1464345181029848, "survival_time": 14.300000000000068, "driven_lanedir": 1.783997497317086, "get_state_dump": 0.004807423216125276, "get_robot_state": 0.003729320984684217, "sim_render-ego0": 0.003910298962210944, "get_duckie_state": 2.0394341870882786e-06, "in-drivable-lane": 5.850000000000083, "deviation-heading": 2.3696055172776744, "agent_compute-ego0": 0.012757963419791298, "complete-iteration": 0.2158731126619133, "set_robot_commands": 0.002321483366165427, "deviation-center-line": 0.5375069473334839, "driven_lanedir_consec": 1.783997497317086, "sim_compute_sim_state": 0.010123541961563587, "sim_compute_performance-ego0": 0.002097404792333729}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.088845185367797, "get_ui_image": 0.03675206696114889, "step_physics": 0.17261015884275355, "survival_time": 6.099999999999986, "driven_lanedir": 1.060910696395786, "get_state_dump": 0.004673936502720282, "get_robot_state": 0.0037015531121230706, "sim_render-ego0": 0.003939721642470941, "get_duckie_state": 2.072109439508702e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.2365384670043642, "agent_compute-ego0": 0.012430512808202728, "complete-iteration": 0.24902571313749483, "set_robot_commands": 0.0022573723056452063, "deviation-center-line": 0.3986601752021174, "driven_lanedir_consec": 1.060910696395786, "sim_compute_sim_state": 0.010470793499210016, "sim_compute_performance-ego0": 0.002101663651505137}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.429260057842354, "get_ui_image": 0.03303536593515783, "step_physics": 0.1666598633296771, "survival_time": 22.400000000000183, "driven_lanedir": 1.2699676485475553, "get_state_dump": 0.0048016094683538835, "get_robot_state": 0.0038528187503262456, "sim_render-ego0": 0.003917028749971453, "get_duckie_state": 2.0570903684620336e-06, "in-drivable-lane": 15.550000000000177, "deviation-heading": 2.402388014177206, "agent_compute-ego0": 0.012830155463951469, "complete-iteration": 0.2393422732108951, "set_robot_commands": 0.0023466797342279176, "deviation-center-line": 0.4767178112413503, "driven_lanedir_consec": 1.2699676485475553, "sim_compute_sim_state": 0.0096959605779839, "sim_compute_performance-ego0": 0.0021139306321175965}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.775381020376003, "get_ui_image": 0.026314602774185365, "step_physics": 0.12363733699871308, "survival_time": 28.80000000000027, "driven_lanedir": 2.135688887005629, "get_state_dump": 0.0046125375625372346, "get_robot_state": 0.003666313310223188, "sim_render-ego0": 0.0037862213273602095, "get_duckie_state": 2.0639528641461087e-06, "in-drivable-lane": 17.650000000000208, "deviation-heading": 3.787999676488114, "agent_compute-ego0": 0.012747775743904313, "complete-iteration": 0.18571814507297668, "set_robot_commands": 0.002291446335394213, "deviation-center-line": 0.8188028876426184, "driven_lanedir_consec": 2.002795824124016, "sim_compute_sim_state": 0.006610567482959873, "sim_compute_performance-ego0": 0.0019664975138222944}}
set_robot_commands_max0.0023466797342279176
set_robot_commands_mean0.002304245435358191
set_robot_commands_median0.00230646485077982
set_robot_commands_min0.0022573723056452063
sim_compute_performance-ego0_max0.0021139306321175965
sim_compute_performance-ego0_mean0.0020698741474446895
sim_compute_performance-ego0_median0.002099534221919433
sim_compute_performance-ego0_min0.0019664975138222944
sim_compute_sim_state_max0.010470793499210016
sim_compute_sim_state_mean0.009225215880429344
sim_compute_sim_state_median0.009909751269773745
sim_compute_sim_state_min0.006610567482959873
sim_render-ego0_max0.003939721642470941
sim_render-ego0_mean0.0038883176705033873
sim_render-ego0_median0.003913663856091199
sim_render-ego0_min0.0037862213273602095
simulation-passed1
step_physics_max0.17261015884275355
step_physics_mean0.15233546931853212
step_physics_median0.15654719071633094
step_physics_min0.12363733699871308
survival_time_max28.80000000000027
survival_time_mean17.900000000000126
survival_time_min6.099999999999986
No reset possible
5394811702Mo Kleit 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:19:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.4917894849695044
survival_time_median23.4750000000002
deviation-center-line_median1.1793028407653905
in-drivable-lane_median8.275000000000091


other stats
agent_compute-ego0_max0.01320596312989994
agent_compute-ego0_mean0.01267653820422408
agent_compute-ego0_median0.012798936241228454
agent_compute-ego0_min0.01190231720453947
complete-iteration_max0.2714425428357555
complete-iteration_mean0.24716039125298456
complete-iteration_median0.25348663656484516
complete-iteration_min0.2102257490464926
deviation-center-line_max1.6783056750863683
deviation-center-line_mean1.1954193000533255
deviation-center-line_min0.744765843596152
deviation-heading_max8.495297703405818
deviation-heading_mean6.327333552873714
deviation-heading_median6.538300875927539
deviation-heading_min3.7374347562339607
driven_any_max10.025625788878376
driven_any_mean6.710110659798708
driven_any_median5.9500202363066315
driven_any_min4.914776377703196
driven_lanedir_consec_max3.6108635476143247
driven_lanedir_consec_mean3.4307019176128435
driven_lanedir_consec_min3.1283651528980396
driven_lanedir_max4.939209154660212
driven_lanedir_mean3.762788319374315
driven_lanedir_median3.4917894849695044
driven_lanedir_min3.1283651528980396
get_duckie_state_max2.1226552067970745e-06
get_duckie_state_mean2.0254157102932044e-06
get_duckie_state_median2.014825959289342e-06
get_duckie_state_min1.949355715797061e-06
get_robot_state_max0.003938968084296402
get_robot_state_mean0.0038651708214121694
get_robot_state_median0.003863508590860256
get_robot_state_min0.003794698019631765
get_state_dump_max0.00499160496556029
get_state_dump_mean0.004815606974372367
get_state_dump_median0.004842969464519309
get_state_dump_min0.004584884002890559
get_ui_image_max0.035439124720567934
get_ui_image_mean0.032031090001188305
get_ui_image_median0.032498759538137995
get_ui_image_min0.02768771620790931
in-drivable-lane_max17.349999999999792
in-drivable-lane_mean10.000000000000012
in-drivable-lane_min6.100000000000076
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.914776377703196, "get_ui_image": 0.03083276566194028, "step_physics": 0.16597658699872542, "survival_time": 19.550000000000143, "driven_lanedir": 3.1283651528980396, "get_state_dump": 0.00499160496556029, "get_robot_state": 0.003938968084296402, "sim_render-ego0": 0.0038824914669503977, "get_duckie_state": 2.1226552067970745e-06, "in-drivable-lane": 6.600000000000094, "deviation-heading": 3.7374347562339607, "agent_compute-ego0": 0.01320596312989994, "complete-iteration": 0.2384502845151084, "set_robot_commands": 0.0023923558848244803, "deviation-center-line": 0.744765843596152, "driven_lanedir_consec": 3.1283651528980396, "sim_compute_sim_state": 0.011022983156904882, "sim_compute_performance-ego0": 0.0021130168924526293}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.626975464835914, "get_ui_image": 0.035439124720567934, "step_physics": 0.19605910297547555, "survival_time": 26.00000000000023, "driven_lanedir": 3.4776698649796765, "get_state_dump": 0.004584884002890559, "get_robot_state": 0.003794698019631765, "sim_render-ego0": 0.003746445943206377, "get_duckie_state": 1.9851435626537008e-06, "in-drivable-lane": 9.950000000000088, "deviation-heading": 7.989002365037851, "agent_compute-ego0": 0.01190231720453947, "complete-iteration": 0.2714425428357555, "set_robot_commands": 0.0022501904310054375, "deviation-center-line": 1.1743659323777098, "driven_lanedir_consec": 3.4776698649796765, "sim_compute_sim_state": 0.011557236742836045, "sim_compute_performance-ego0": 0.0020208601301782646}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.273065007777348, "get_ui_image": 0.034164753414335704, "step_physics": 0.19200373944782076, "survival_time": 20.950000000000163, "driven_lanedir": 3.505909104959332, "get_state_dump": 0.0048469923791431245, "get_robot_state": 0.003804832413083031, "sim_render-ego0": 0.003882797559102376, "get_duckie_state": 1.949355715797061e-06, "in-drivable-lane": 6.100000000000076, "deviation-heading": 5.087599386817227, "agent_compute-ego0": 0.012877300807407925, "complete-iteration": 0.2685229886145819, "set_robot_commands": 0.0022284309069315594, "deviation-center-line": 1.184239749153071, "driven_lanedir_consec": 3.505909104959332, "sim_compute_sim_state": 0.012539092132023404, "sim_compute_performance-ego0": 0.00208303587777274}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.025625788878376, "get_ui_image": 0.02768771620790931, "step_physics": 0.14598803446559833, "survival_time": 38.79999999999993, "driven_lanedir": 4.939209154660212, "get_state_dump": 0.004838946549895494, "get_robot_state": 0.003922184768637481, "sim_render-ego0": 0.003941666358839744, "get_duckie_state": 2.044508355924982e-06, "in-drivable-lane": 17.349999999999792, "deviation-heading": 8.495297703405818, "agent_compute-ego0": 0.012720571675048984, "complete-iteration": 0.2102257490464926, "set_robot_commands": 0.002352463846194391, "deviation-center-line": 1.6783056750863683, "driven_lanedir_consec": 3.6108635476143247, "sim_compute_sim_state": 0.006585858503363767, "sim_compute_performance-ego0": 0.0020966109468516544}}
set_robot_commands_max0.0023923558848244803
set_robot_commands_mean0.002305860267238967
set_robot_commands_median0.0023013271385999142
set_robot_commands_min0.0022284309069315594
sim_compute_performance-ego0_max0.0021130168924526293
sim_compute_performance-ego0_mean0.002078380961813822
sim_compute_performance-ego0_median0.002089823412312197
sim_compute_performance-ego0_min0.0020208601301782646
sim_compute_sim_state_max0.012539092132023404
sim_compute_sim_state_mean0.010426292633782024
sim_compute_sim_state_median0.011290109949870465
sim_compute_sim_state_min0.006585858503363767
sim_render-ego0_max0.003941666358839744
sim_render-ego0_mean0.003863350332024724
sim_render-ego0_median0.003882644513026387
sim_render-ego0_min0.003746445943206377
simulation-passed1
step_physics_max0.19605910297547555
step_physics_mean0.175006865971905
step_physics_median0.1789901632232731
step_physics_min0.14598803446559833
survival_time_max38.79999999999993
survival_time_mean26.325000000000117
survival_time_min19.550000000000143
No reset possible
5393311734Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible