Duckietown Challenges Home Challenges Submissions

Evaluator 4768

ID4768
evaluatornogpu-prod-07
ownerI don't have one 😀
machinenogpu-prod_a945e4950c7e
processnogpu-prod-07_a945e4950c7e
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success51 53415
# timeout3 50046
# failed18 48747
# error95 47580
# aborted23 47300
# host-error50 48487
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5789110800Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:36:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 803, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 45, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 265, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 272, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 163, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 149, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/aido5-LF-sim-validation/submission10800/LFv-sim-nogpu-prod-07_a945e4950c7e-job57891-a-wd/docker-compose.yaml' -> '/tmp/tmpvzr9frz1docker-compose.yaml'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5786710788Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:17:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2489529500515857
survival_time_median22.05000000000018
deviation-center-line_median0.8541327189384941
in-drivable-lane_median7.774999999999931


other stats
agent_compute-ego0_max0.013870631756425717
agent_compute-ego0_mean0.012868106981402568
agent_compute-ego0_median0.012558516840826168
agent_compute-ego0_min0.012484762487532218
complete-iteration_max0.2161251801211818
complete-iteration_mean0.19122966677983372
complete-iteration_median0.19515689964235583
complete-iteration_min0.1584796877134414
deviation-center-line_max3.027773105450877
deviation-center-line_mean1.2298512356895066
deviation-center-line_min0.18336639943016164
deviation-heading_max16.774315184284156
deviation-heading_mean6.935937918387797
deviation-heading_median4.999845796488735
deviation-heading_min0.9697448962895636
driven_any_max10.420606691885824
driven_any_mean4.680545054547105
driven_any_median3.611842097835567
driven_any_min1.0778893306314614
driven_lanedir_consec_max8.434526317664682
driven_lanedir_consec_mean2.894123938455129
driven_lanedir_consec_min0.6440635360526623
driven_lanedir_max8.434526317664682
driven_lanedir_mean3.2753602349373123
driven_lanedir_median2.011425543015953
driven_lanedir_min0.6440635360526623
get_duckie_state_max2.5479971957044537e-06
get_duckie_state_mean2.079955563311458e-06
get_duckie_state_median1.951666308604519e-06
get_duckie_state_min1.86849244033234e-06
get_robot_state_max0.004122330217945332
get_robot_state_mean0.003765797066228135
get_robot_state_median0.003662003541168251
get_robot_state_min0.0036168509646307065
get_state_dump_max0.004966816934598547
get_state_dump_mean0.004688148762694553
get_state_dump_median0.004611382641925965
get_state_dump_min0.0045630128323277345
get_ui_image_max0.03501851649224004
get_ui_image_mean0.03057441131127257
get_ui_image_median0.030608167302437185
get_ui_image_min0.02606279414797586
in-drivable-lane_max9.550000000000136
in-drivable-lane_mean6.899999999999998
in-drivable-lane_min2.499999999999991
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.420606691885824, "get_ui_image": 0.027664275093936205, "step_physics": 0.1146215935928637, "survival_time": 59.99999999999873, "driven_lanedir": 8.434526317664682, "get_state_dump": 0.004586795486081748, "get_robot_state": 0.003641974618293959, "sim_render-ego0": 0.0038143681249054743, "get_duckie_state": 1.9817924023071595e-06, "in-drivable-lane": 7.249999999999812, "deviation-heading": 16.774315184284156, "agent_compute-ego0": 0.012567929483075424, "complete-iteration": 0.18033945828452896, "set_robot_commands": 0.0022001468966545215, "deviation-center-line": 3.027773105450877, "driven_lanedir_consec": 8.434526317664682, "sim_compute_sim_state": 0.009147646425169374, "sim_compute_performance-ego0": 0.002005725577907896}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.238307208667432, "get_ui_image": 0.03501851649224004, "step_physics": 0.13559965808180313, "survival_time": 31.550000000000313, "driven_lanedir": 3.33731148527317, "get_state_dump": 0.0045630128323277345, "get_robot_state": 0.0036168509646307065, "sim_render-ego0": 0.003792714469040497, "get_duckie_state": 1.86849244033234e-06, "in-drivable-lane": 9.550000000000136, "deviation-heading": 8.669290208889757, "agent_compute-ego0": 0.012484762487532218, "complete-iteration": 0.20997434100018272, "set_robot_commands": 0.0021850357327280164, "deviation-center-line": 1.4777571217170136, "driven_lanedir_consec": 1.8240572436002216, "sim_compute_sim_state": 0.010675329573546784, "sim_compute_performance-ego0": 0.0019524082352843464}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0778893306314614, "get_ui_image": 0.03355205951093816, "step_physics": 0.14088867472953537, "survival_time": 7.299999999999982, "driven_lanedir": 0.685539600758736, "get_state_dump": 0.004966816934598547, "get_robot_state": 0.004122330217945332, "sim_render-ego0": 0.004332516469112059, "get_duckie_state": 2.5479971957044537e-06, "in-drivable-lane": 2.499999999999991, "deviation-heading": 1.3304013840877136, "agent_compute-ego0": 0.013870631756425717, "complete-iteration": 0.2161251801211818, "set_robot_commands": 0.002520583924793062, "deviation-center-line": 0.23050831615997464, "driven_lanedir_consec": 0.6738486565029498, "sim_compute_sim_state": 0.00951948457834672, "sim_compute_performance-ego0": 0.002250123186176326}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.985376987003703, "get_ui_image": 0.02606279414797586, "step_physics": 0.09843826104724218, "survival_time": 12.550000000000043, "driven_lanedir": 0.6440635360526623, "get_state_dump": 0.004635969797770183, "get_robot_state": 0.0036820324640425423, "sim_render-ego0": 0.003879202736748589, "get_duckie_state": 1.921540214901879e-06, "in-drivable-lane": 8.30000000000005, "deviation-heading": 0.9697448962895636, "agent_compute-ego0": 0.012549104198576912, "complete-iteration": 0.1584796877134414, "set_robot_commands": 0.002169391465565515, "deviation-center-line": 0.18336639943016164, "driven_lanedir_consec": 0.6440635360526623, "sim_compute_sim_state": 0.0049655673995850575, "sim_compute_performance-ego0": 0.0020135783013843353}}
set_robot_commands_max0.002520583924793062
set_robot_commands_mean0.0022687895049352787
set_robot_commands_median0.002192591314691269
set_robot_commands_min0.002169391465565515
sim_compute_performance-ego0_max0.002250123186176326
sim_compute_performance-ego0_mean0.002055458825188226
sim_compute_performance-ego0_median0.0020096519396461156
sim_compute_performance-ego0_min0.0019524082352843464
sim_compute_sim_state_max0.010675329573546784
sim_compute_sim_state_mean0.008577006994161984
sim_compute_sim_state_median0.009333565501758049
sim_compute_sim_state_min0.0049655673995850575
sim_render-ego0_max0.004332516469112059
sim_render-ego0_mean0.003954700449951654
sim_render-ego0_median0.003846785430827032
sim_render-ego0_min0.003792714469040497
simulation-passed1
step_physics_max0.14088867472953537
step_physics_mean0.1223870468628611
step_physics_median0.1251106258373334
step_physics_min0.09843826104724218
survival_time_max59.99999999999873
survival_time_mean27.849999999999763
survival_time_min7.299999999999982
No reset possible
5786210790Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:03:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 25 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5785510793Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:03:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 40 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5784210797Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:04:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 57 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5780410820Raphael Jeanexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:21:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.913253506281922
survival_time_median26.700000000000244
deviation-center-line_median0.8914753952276626
in-drivable-lane_median7.825000000000111


other stats
agent_compute-ego0_max0.014102550902107889
agent_compute-ego0_mean0.013081216601211532
agent_compute-ego0_median0.013238501288082752
agent_compute-ego0_min0.011745312926572726
complete-iteration_max0.22769737243652344
complete-iteration_mean0.2024480189700389
complete-iteration_median0.21100973733378295
complete-iteration_min0.16007522877606625
deviation-center-line_max2.2436446750772236
deviation-center-line_mean1.097589651300145
deviation-center-line_min0.36376313966803103
deviation-heading_max11.866327851113752
deviation-heading_mean5.499551765887067
deviation-heading_median3.91857450272164
deviation-heading_min2.294730206991235
driven_any_max9.884343769612396
driven_any_mean5.4258661034715265
driven_any_median4.107706072270642
driven_any_min3.603708499732427
driven_lanedir_consec_max9.124313755269636
driven_lanedir_consec_mean4.115463891255434
driven_lanedir_consec_min1.511034797188256
driven_lanedir_max9.124313755269636
driven_lanedir_mean4.115986342753295
driven_lanedir_median2.913253506281922
driven_lanedir_min1.5131246031796983
get_duckie_state_max1.8154003823450369e-06
get_duckie_state_mean1.5019746669773102e-06
get_duckie_state_median1.4878946584717451e-06
get_duckie_state_min1.2167089686207132e-06
get_robot_state_max0.004205276337704917
get_robot_state_mean0.00400150924843448
get_robot_state_median0.004058222997475709
get_robot_state_min0.0036843146610815855
get_state_dump_max0.005425241019321262
get_state_dump_mean0.004989470006272813
get_state_dump_median0.004995397127921434
get_state_dump_min0.004541844749927124
get_ui_image_max0.03587141291039889
get_ui_image_mean0.031596310730161746
get_ui_image_median0.032465832382319634
get_ui_image_min0.025582165245608825
in-drivable-lane_max14.300000000000203
in-drivable-lane_mean8.162500000000069
in-drivable-lane_min2.6999999999998465
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.022005453491659, "get_ui_image": 0.030875690685686213, "step_physics": 0.1253502988076025, "survival_time": 25.75000000000023, "driven_lanedir": 2.0860177273609595, "get_state_dump": 0.00510969319084818, "get_robot_state": 0.004205276337704917, "sim_render-ego0": 0.004442318003307018, "get_duckie_state": 1.8154003823450369e-06, "in-drivable-lane": 12.500000000000178, "deviation-heading": 2.294730206991235, "agent_compute-ego0": 0.014102550902107889, "complete-iteration": 0.20085111098696096, "set_robot_commands": 0.0025930483211842616, "deviation-center-line": 0.5351557915556484, "driven_lanedir_consec": 2.0860177273609595, "sim_compute_sim_state": 0.01169814850932868, "sim_compute_performance-ego0": 0.0023615591285764707}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.603708499732427, "get_ui_image": 0.03587141291039889, "step_physics": 0.14392092335419576, "survival_time": 24.35000000000021, "driven_lanedir": 1.5131246031796983, "get_state_dump": 0.004881101064994687, "get_robot_state": 0.003954686590882599, "sim_render-ego0": 0.003976006976893691, "get_duckie_state": 1.4329542879198415e-06, "in-drivable-lane": 14.300000000000203, "deviation-heading": 2.928830638078511, "agent_compute-ego0": 0.013174173284749516, "complete-iteration": 0.22116836368060505, "set_robot_commands": 0.002310351270144103, "deviation-center-line": 0.36376313966803103, "driven_lanedir_consec": 1.511034797188256, "sim_compute_sim_state": 0.010798539783133837, "sim_compute_performance-ego0": 0.0021767396418774713}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.193406691049625, "get_ui_image": 0.03405597407895305, "step_physics": 0.14887710168473556, "survival_time": 27.650000000000254, "driven_lanedir": 3.740489285202883, "get_state_dump": 0.005425241019321262, "get_robot_state": 0.004161759404068819, "sim_render-ego0": 0.004275908108652714, "get_duckie_state": 1.542835029023649e-06, "in-drivable-lane": 3.1500000000000448, "deviation-heading": 4.908318367364769, "agent_compute-ego0": 0.013302829291415987, "complete-iteration": 0.22769737243652344, "set_robot_commands": 0.002484536773461297, "deviation-center-line": 1.2477949988996768, "driven_lanedir_consec": 3.740489285202883, "sim_compute_sim_state": 0.01263691587138262, "sim_compute_performance-ego0": 0.002364810623416832}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.884343769612396, "get_ui_image": 0.025582165245608825, "step_physics": 0.1005298033245001, "survival_time": 59.99999999999873, "driven_lanedir": 9.124313755269636, "get_state_dump": 0.004541844749927124, "get_robot_state": 0.0036843146610815855, "sim_render-ego0": 0.003737583644781184, "get_duckie_state": 1.2167089686207132e-06, "in-drivable-lane": 2.6999999999998465, "deviation-heading": 11.866327851113752, "agent_compute-ego0": 0.011745312926572726, "complete-iteration": 0.16007522877606625, "set_robot_commands": 0.0021558582137566028, "deviation-center-line": 2.2436446750772236, "driven_lanedir_consec": 9.124313755269636, "sim_compute_sim_state": 0.006058427912309506, "sim_compute_performance-ego0": 0.0019533989530717403}}
set_robot_commands_max0.0025930483211842616
set_robot_commands_mean0.002385948644636566
set_robot_commands_median0.0023974440218026997
set_robot_commands_min0.0021558582137566028
sim_compute_performance-ego0_max0.002364810623416832
sim_compute_performance-ego0_mean0.0022141270867356284
sim_compute_performance-ego0_median0.002269149385226971
sim_compute_performance-ego0_min0.0019533989530717403
sim_compute_sim_state_max0.01263691587138262
sim_compute_sim_state_mean0.01029800801903866
sim_compute_sim_state_median0.011248344146231257
sim_compute_sim_state_min0.006058427912309506
sim_render-ego0_max0.004442318003307018
sim_render-ego0_mean0.004107954183408652
sim_render-ego0_median0.004125957542773203
sim_render-ego0_min0.003737583644781184
simulation-passed1
step_physics_max0.14887710168473556
step_physics_mean0.12966953179275847
step_physics_median0.13463561108089914
step_physics_min0.1005298033245001
survival_time_max59.99999999999873
survival_time_mean34.43749999999986
survival_time_min24.35000000000021
No reset possible
5776710839Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:29:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.90490775427406
survival_time_median55.72499999999897
deviation-center-line_median1.1775391795451378
in-drivable-lane_median22.049999999999983


other stats
agent_compute-ego0_max0.01365934190964988
agent_compute-ego0_mean0.012781030057865102
agent_compute-ego0_median0.012655205499341246
agent_compute-ego0_min0.01215436732312804
complete-iteration_max0.1929681803159532
complete-iteration_mean0.17598851229771725
complete-iteration_median0.1780987291701734
complete-iteration_min0.15478841053456888
deviation-center-line_max3.968727544554039
deviation-center-line_mean1.8316256522075425
deviation-center-line_min1.0026967051858546
deviation-heading_max13.958914977187966
deviation-heading_mean6.8482128326317
deviation-heading_median4.909261219693025
deviation-heading_min3.615413913952783
driven_any_max7.10060827473819
driven_any_mean5.9557388250748495
driven_any_median6.665064710508713
driven_any_min3.3922176045437813
driven_lanedir_consec_max6.792997252177034
driven_lanedir_consec_mean3.5390935880494983
driven_lanedir_consec_min1.553561591472841
driven_lanedir_max6.792997252177034
driven_lanedir_mean3.551452129767121
driven_lanedir_median2.929624837709305
driven_lanedir_min1.553561591472841
get_duckie_state_max1.3939843983773289e-06
get_duckie_state_mean1.3224667849851116e-06
get_duckie_state_median1.313018016618413e-06
get_duckie_state_min1.269846708326292e-06
get_robot_state_max0.003938289201032351
get_robot_state_mean0.003836990371917832
get_robot_state_median0.0038772038136928822
get_robot_state_min0.003655264659253214
get_state_dump_max0.004999456207301836
get_state_dump_mean0.00484652395315853
get_state_dump_median0.004854893915658263
get_state_dump_min0.00467685177401576
get_ui_image_max0.03536095397047909
get_ui_image_mean0.031475260889222506
get_ui_image_median0.03187879769183542
get_ui_image_min0.02678249420274009
in-drivable-lane_max41.1999999999989
in-drivable-lane_mean21.58749999999972
in-drivable-lane_min1.050000000000015
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.913263593227138, "get_ui_image": 0.029034756684369695, "step_physics": 0.09901752865967534, "survival_time": 53.79999999999908, "driven_lanedir": 3.988441419296376, "get_state_dump": 0.004891280454956168, "get_robot_state": 0.003842070906275162, "sim_render-ego0": 0.004059491604704932, "get_duckie_state": 1.3209319048273198e-06, "in-drivable-lane": 27.89999999999975, "deviation-heading": 3.615413913952783, "agent_compute-ego0": 0.012824806994382385, "complete-iteration": 0.16950133517592067, "set_robot_commands": 0.002300434015144766, "deviation-center-line": 1.0026967051858546, "driven_lanedir_consec": 3.988441419296376, "sim_compute_sim_state": 0.011333858955758749, "sim_compute_performance-ego0": 0.002111826545127366}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.3922176045437813, "get_ui_image": 0.03536095397047909, "step_physics": 0.11194149031615296, "survival_time": 30.00000000000029, "driven_lanedir": 1.553561591472841, "get_state_dump": 0.00467685177401576, "get_robot_state": 0.003655264659253214, "sim_render-ego0": 0.003890574672654544, "get_duckie_state": 1.269846708326292e-06, "in-drivable-lane": 16.200000000000212, "deviation-heading": 4.312309821063672, "agent_compute-ego0": 0.01215436732312804, "complete-iteration": 0.18669612316442608, "set_robot_commands": 0.0021691790436349574, "deviation-center-line": 1.032722689469178, "driven_lanedir_consec": 1.553561591472841, "sim_compute_sim_state": 0.01079453882480818, "sim_compute_performance-ego0": 0.001970042008131792}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.416865827790288, "get_ui_image": 0.03472283869930115, "step_physics": 0.11604777572473166, "survival_time": 57.64999999999886, "driven_lanedir": 1.8708082561222343, "get_state_dump": 0.004999456207301836, "get_robot_state": 0.003938289201032351, "sim_render-ego0": 0.004275737023642819, "get_duckie_state": 1.3051041284095065e-06, "in-drivable-lane": 41.1999999999989, "deviation-heading": 5.506212618322379, "agent_compute-ego0": 0.01365934190964988, "complete-iteration": 0.1929681803159532, "set_robot_commands": 0.002324509248783105, "deviation-center-line": 1.3223556696210974, "driven_lanedir_consec": 1.8213740892517432, "sim_compute_sim_state": 0.0106991029488152, "sim_compute_performance-ego0": 0.002212193437837439}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.10060827473819, "get_ui_image": 0.02678249420274009, "step_physics": 0.09179470044786388, "survival_time": 59.99999999999873, "driven_lanedir": 6.792997252177034, "get_state_dump": 0.0048185073763603575, "get_robot_state": 0.003912336721110602, "sim_render-ego0": 0.003997065443281925, "get_duckie_state": 1.3939843983773289e-06, "in-drivable-lane": 1.050000000000015, "deviation-heading": 13.958914977187966, "agent_compute-ego0": 0.012485604004300108, "complete-iteration": 0.15478841053456888, "set_robot_commands": 0.0023301036828364263, "deviation-center-line": 3.968727544554039, "driven_lanedir_consec": 6.792997252177034, "sim_compute_sim_state": 0.006462333402863946, "sim_compute_performance-ego0": 0.002120969496003595}}
set_robot_commands_max0.0023301036828364263
set_robot_commands_mean0.002281056497599814
set_robot_commands_median0.0023124716319639356
set_robot_commands_min0.0021691790436349574
sim_compute_performance-ego0_max0.002212193437837439
sim_compute_performance-ego0_mean0.002103757871775048
sim_compute_performance-ego0_median0.00211639802056548
sim_compute_performance-ego0_min0.001970042008131792
sim_compute_sim_state_max0.011333858955758749
sim_compute_sim_state_mean0.009822458533061518
sim_compute_sim_state_median0.01074682088681169
sim_compute_sim_state_min0.006462333402863946
sim_render-ego0_max0.004275737023642819
sim_render-ego0_mean0.004055717186071056
sim_render-ego0_median0.004028278523993428
sim_render-ego0_min0.003890574672654544
simulation-passed1
step_physics_max0.11604777572473166
step_physics_mean0.10470037378710596
step_physics_median0.10547950948791417
step_physics_min0.09179470044786388
survival_time_max59.99999999999873
survival_time_mean50.36249999999924
survival_time_min30.00000000000029
No reset possible
5773510856Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:25:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.399332451710581
survival_time_median55.62499999999898
deviation-center-line_median1.156283771266252
in-drivable-lane_median15.399999999999864


other stats
agent_compute-ego0_max0.013968584597924069
agent_compute-ego0_mean0.013316202848180253
agent_compute-ego0_median0.013573301503265136
agent_compute-ego0_min0.012149623788266657
complete-iteration_max0.23353859640303112
complete-iteration_mean0.18660204516782983
complete-iteration_median0.18369547328966415
complete-iteration_min0.14547863768895997
deviation-center-line_max3.809405496269786
deviation-center-line_mean1.5742589875271291
deviation-center-line_min0.17506291130622784
deviation-heading_max11.977052764654688
deviation-heading_mean5.4051558282693115
deviation-heading_median3.954649386872524
deviation-heading_min1.7342717746775131
driven_any_max8.224120064503042
driven_any_mean5.387655632462334
driven_any_median6.519801663078907
driven_any_min0.2868991391884791
driven_lanedir_consec_max6.696125083942303
driven_lanedir_consec_mean2.906636828838148
driven_lanedir_consec_min0.13175732798912598
driven_lanedir_max6.696125083942303
driven_lanedir_mean2.906636828838148
driven_lanedir_median2.399332451710581
driven_lanedir_min0.13175732798912598
get_duckie_state_max2.5772908974809256e-06
get_duckie_state_mean2.248586547803709e-06
get_duckie_state_median2.277384978027755e-06
get_duckie_state_min1.8622853376783995e-06
get_robot_state_max0.004020556139434755
get_robot_state_mean0.00382064356159712
get_robot_state_median0.003849572726478802
get_robot_state_min0.0035628726539961206
get_state_dump_max0.004941848054034435
get_state_dump_mean0.004738632234339048
get_state_dump_median0.004735646658698845
get_state_dump_min0.004541387565924067
get_ui_image_max0.0361968960080828
get_ui_image_mean0.030948463997660942
get_ui_image_median0.031188072297781255
get_ui_image_min0.025220815386998465
in-drivable-lane_max46.799999999998676
in-drivable-lane_mean19.787499999999604
in-drivable-lane_min1.5499999999999945
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.224120064503042, "get_ui_image": 0.029301625505077353, "step_physics": 0.10444509476845112, "survival_time": 59.99999999999873, "driven_lanedir": 2.0035469857288297, "get_state_dump": 0.004849333449466143, "get_robot_state": 0.004000963914602821, "sim_render-ego0": 0.004201052488633536, "get_duckie_state": 2.542403615781608e-06, "in-drivable-lane": 46.799999999998676, "deviation-heading": 1.7342717746775131, "agent_compute-ego0": 0.013631485383973132, "complete-iteration": 0.175325967191558, "set_robot_commands": 0.002395776189634147, "deviation-center-line": 0.5492931003245027, "driven_lanedir_consec": 2.0035469857288297, "sim_compute_sim_state": 0.010168584359873344, "sim_compute_performance-ego0": 0.002232659766318697}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2868991391884791, "get_ui_image": 0.0361968960080828, "step_physics": 0.15702711116699947, "survival_time": 4.149999999999993, "driven_lanedir": 0.13175732798912598, "get_state_dump": 0.004621959867931548, "get_robot_state": 0.0036981815383547822, "sim_render-ego0": 0.00392101492200579, "get_duckie_state": 2.0123663402739024e-06, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 1.8352117536456989, "agent_compute-ego0": 0.01351511762255714, "complete-iteration": 0.23353859640303112, "set_robot_commands": 0.002195636431376139, "deviation-center-line": 0.17506291130622784, "driven_lanedir_consec": 0.13175732798912598, "sim_compute_sim_state": 0.010338184379395984, "sim_compute_performance-ego0": 0.0019400488762628463}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.917773769917445, "get_ui_image": 0.03307451909048516, "step_physics": 0.11485468272344876, "survival_time": 51.249999999999226, "driven_lanedir": 2.795117917692333, "get_state_dump": 0.004941848054034435, "get_robot_state": 0.004020556139434755, "sim_render-ego0": 0.004243839321545458, "get_duckie_state": 2.5772908974809256e-06, "in-drivable-lane": 27.999999999999694, "deviation-heading": 6.074087020099348, "agent_compute-ego0": 0.013968584597924069, "complete-iteration": 0.1920649793877704, "set_robot_commands": 0.002362528274863319, "deviation-center-line": 1.7632744422080011, "driven_lanedir_consec": 2.795117917692333, "sim_compute_sim_state": 0.012249107016922204, "sim_compute_performance-ego0": 0.002246140039455124}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.121829556240368, "get_ui_image": 0.025220815386998465, "step_physics": 0.08622783268619635, "survival_time": 59.99999999999873, "driven_lanedir": 6.696125083942303, "get_state_dump": 0.004541387565924067, "get_robot_state": 0.0035628726539961206, "sim_render-ego0": 0.0036994777650856954, "get_duckie_state": 1.8622853376783995e-06, "in-drivable-lane": 2.8000000000000327, "deviation-heading": 11.977052764654688, "agent_compute-ego0": 0.012149623788266657, "complete-iteration": 0.14547863768895997, "set_robot_commands": 0.0021315593703601084, "deviation-center-line": 3.809405496269786, "driven_lanedir_consec": 6.696125083942303, "sim_compute_sim_state": 0.005994485875748278, "sim_compute_performance-ego0": 0.001871176504473404}}
set_robot_commands_max0.002395776189634147
set_robot_commands_mean0.0022713750665584284
set_robot_commands_median0.002279082353119729
set_robot_commands_min0.0021315593703601084
sim_compute_performance-ego0_max0.002246140039455124
sim_compute_performance-ego0_mean0.002072506296627518
sim_compute_performance-ego0_median0.0020863543212907717
sim_compute_performance-ego0_min0.001871176504473404
sim_compute_sim_state_max0.012249107016922204
sim_compute_sim_state_mean0.009687590407984953
sim_compute_sim_state_median0.010253384369634664
sim_compute_sim_state_min0.005994485875748278
sim_render-ego0_max0.004243839321545458
sim_render-ego0_mean0.004016346124317619
sim_render-ego0_median0.004061033705319662
sim_render-ego0_min0.0036994777650856954
simulation-passed1
step_physics_max0.15702711116699947
step_physics_mean0.11563868033627392
step_physics_median0.10964988874594994
step_physics_min0.08622783268619635
survival_time_max59.99999999999873
survival_time_mean43.84999999999917
survival_time_min4.149999999999993
No reset possible
5772010863Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:11:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6451624214972336
survival_time_median10.425000000000011
deviation-center-line_median0.23174133606194044
in-drivable-lane_median6.32500000000002


other stats
agent_compute-ego0_max0.013355372539117708
agent_compute-ego0_mean0.0130437282729303
agent_compute-ego0_median0.01305008245005029
agent_compute-ego0_min0.012719375652502914
complete-iteration_max0.20160142888021731
complete-iteration_mean0.18268344616038884
complete-iteration_median0.18420607414344475
complete-iteration_min0.16072020747444846
deviation-center-line_max1.423140985241001
deviation-center-line_mean0.5139438841867164
deviation-center-line_min0.16915187938198384
deviation-heading_max6.924885514492694
deviation-heading_mean2.5504190735023937
deviation-heading_median1.2675179045900271
deviation-heading_min0.7417549703368262
driven_any_max8.11776030648158
driven_any_mean3.1694600261425117
driven_any_median1.5944934370982622
driven_any_min1.371092923891941
driven_lanedir_consec_max5.484305128235918
driven_lanedir_consec_mean1.836339076185556
driven_lanedir_consec_min0.5707263335118387
driven_lanedir_max5.484305128235918
driven_lanedir_mean1.836339076185556
driven_lanedir_median0.6451624214972336
driven_lanedir_min0.5707263335118387
get_duckie_state_max1.4053517250559438e-06
get_duckie_state_mean1.3214745342393731e-06
get_duckie_state_median1.329737231290143e-06
get_duckie_state_min1.221071949321262e-06
get_robot_state_max0.003882036425850608
get_robot_state_mean0.0037569681286173376
get_robot_state_median0.003776815388782688
get_robot_state_min0.0035922053110533656
get_state_dump_max0.004841255782237604
get_state_dump_mean0.004716207243860503
get_state_dump_median0.004708300617868795
get_state_dump_min0.004606971957466819
get_ui_image_max0.03544768970974242
get_ui_image_mean0.030331342975162115
get_ui_image_median0.029922731520528205
get_ui_image_min0.02603221914984963
in-drivable-lane_max13.9999999999995
in-drivable-lane_mean7.899999999999884
in-drivable-lane_min4.949999999999999
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.11776030648158, "get_ui_image": 0.028436004142636705, "step_physics": 0.10630881539885444, "survival_time": 45.89999999999953, "driven_lanedir": 5.484305128235918, "get_state_dump": 0.004730465622280316, "get_robot_state": 0.0037420820748844913, "sim_render-ego0": 0.003936674441813903, "get_duckie_state": 1.3871862268292216e-06, "in-drivable-lane": 13.9999999999995, "deviation-heading": 6.924885514492694, "agent_compute-ego0": 0.012801745511242822, "complete-iteration": 0.17437248001679762, "set_robot_commands": 0.0022383605305336504, "deviation-center-line": 1.423140985241001, "driven_lanedir_consec": 5.484305128235918, "sim_compute_sim_state": 0.010046910409439634, "sim_compute_performance-ego0": 0.00203727741884848}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.371092923891941, "get_ui_image": 0.03544768970974242, "step_physics": 0.12755882674159266, "survival_time": 8.999999999999993, "driven_lanedir": 0.5707263335118387, "get_state_dump": 0.004686135613457274, "get_robot_state": 0.0035922053110533656, "sim_render-ego0": 0.003808971268037406, "get_duckie_state": 1.221071949321262e-06, "in-drivable-lane": 4.949999999999999, "deviation-heading": 1.7805912031650248, "agent_compute-ego0": 0.012719375652502914, "complete-iteration": 0.20160142888021731, "set_robot_commands": 0.0021829670964025, "deviation-center-line": 0.2864150674247602, "driven_lanedir_consec": 0.5707263335118387, "sim_compute_sim_state": 0.009603111783443894, "sim_compute_performance-ego0": 0.0019150465232891272}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4791099488456192, "get_ui_image": 0.03140945889841971, "step_physics": 0.12331035149157346, "survival_time": 9.900000000000006, "driven_lanedir": 0.6495051985484711, "get_state_dump": 0.004841255782237604, "get_robot_state": 0.003811548702680885, "sim_render-ego0": 0.004027841079175172, "get_duckie_state": 1.4053517250559438e-06, "in-drivable-lane": 5.750000000000012, "deviation-heading": 0.7544446060150293, "agent_compute-ego0": 0.013355372539117708, "complete-iteration": 0.19403966827009192, "set_robot_commands": 0.0022539385599107597, "deviation-center-line": 0.1770676046991207, "driven_lanedir_consec": 0.6495051985484711, "sim_compute_sim_state": 0.008863372419347716, "sim_compute_performance-ego0": 0.0020675731064686226}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7098769253509052, "get_ui_image": 0.02603221914984963, "step_physics": 0.098989567973397, "survival_time": 10.95000000000002, "driven_lanedir": 0.6408196444459962, "get_state_dump": 0.004606971957466819, "get_robot_state": 0.003882036425850608, "sim_render-ego0": 0.0038553357124328615, "get_duckie_state": 1.2722882357510652e-06, "in-drivable-lane": 6.900000000000027, "deviation-heading": 0.7417549703368262, "agent_compute-ego0": 0.013298419388857756, "complete-iteration": 0.16072020747444846, "set_robot_commands": 0.0022222031246532095, "deviation-center-line": 0.16915187938198384, "driven_lanedir_consec": 0.6408196444459962, "sim_compute_sim_state": 0.00507971698587591, "sim_compute_performance-ego0": 0.002663987333124334}}
set_robot_commands_max0.0022539385599107597
set_robot_commands_mean0.0022243673278750297
set_robot_commands_median0.00223028182759343
set_robot_commands_min0.0021829670964025
sim_compute_performance-ego0_max0.002663987333124334
sim_compute_performance-ego0_mean0.002170971095432641
sim_compute_performance-ego0_median0.0020524252626585512
sim_compute_performance-ego0_min0.0019150465232891272
sim_compute_sim_state_max0.010046910409439634
sim_compute_sim_state_mean0.008398277899526789
sim_compute_sim_state_median0.009233242101395804
sim_compute_sim_state_min0.00507971698587591
sim_render-ego0_max0.004027841079175172
sim_render-ego0_mean0.003907205625364836
sim_render-ego0_median0.0038960050771233825
sim_render-ego0_min0.003808971268037406
simulation-passed1
step_physics_max0.12755882674159266
step_physics_mean0.1140418904013544
step_physics_median0.11480958344521396
step_physics_min0.098989567973397
survival_time_max45.89999999999953
survival_time_mean18.937499999999886
survival_time_min8.999999999999993
No reset possible
5766810881Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:24:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.117472110889487
survival_time_median56.79999999999891
deviation-center-line_median1.4417941557499303
in-drivable-lane_median28.37499999999914


other stats
agent_compute-ego0_max0.014564788204500046
agent_compute-ego0_mean0.013559699818387987
agent_compute-ego0_median0.013578279613047552
agent_compute-ego0_min0.012517451842956795
complete-iteration_max0.2272700907170087
complete-iteration_mean0.1819904364912916
complete-iteration_median0.18010607625931296
complete-iteration_min0.14047950272953183
deviation-center-line_max1.998734616014289
deviation-center-line_mean1.2623666774422957
deviation-center-line_min0.1671437822550329
deviation-heading_max6.3737320523936924
deviation-heading_mean4.872601093714591
deviation-heading_median5.633575939830877
deviation-heading_min1.8495204428029184
driven_any_max7.501194740926674
driven_any_mean5.3789392098828746
driven_any_median6.857002448515324
driven_any_min0.30055720157417726
driven_lanedir_consec_max4.0087916025913035
driven_lanedir_consec_mean2.5952953171257462
driven_lanedir_consec_min0.13744544413270665
driven_lanedir_max4.0087916025913035
driven_lanedir_mean2.5952953171257462
driven_lanedir_median3.117472110889487
driven_lanedir_min0.13744544413270665
get_duckie_state_max1.593604892186772e-06
get_duckie_state_mean1.435420045617527e-06
get_duckie_state_median1.4465262974813523e-06
get_duckie_state_min1.2550226953206313e-06
get_robot_state_max0.004100479948629845
get_robot_state_mean0.003871730819792853
get_robot_state_median0.0038991539179815864
get_robot_state_min0.003588135494578391
get_state_dump_max0.005195140838623047
get_state_dump_mean0.004865763948030898
get_state_dump_median0.004912132951452344
get_state_dump_min0.004443649050595857
get_ui_image_max0.0347792937837798
get_ui_image_mean0.030468029022920208
get_ui_image_median0.03070742545435168
get_ui_image_min0.02567797139919767
in-drivable-lane_max36.14999999999925
in-drivable-lane_mean23.624999999999385
in-drivable-lane_min1.5999999999999943
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.896659122312882, "get_ui_image": 0.02834015590280211, "step_physics": 0.1015252895924052, "survival_time": 53.59999999999909, "driven_lanedir": 4.0087916025913035, "get_state_dump": 0.00489609928077776, "get_robot_state": 0.004011774107549975, "sim_render-ego0": 0.00410714087259625, "get_duckie_state": 1.593604892186772e-06, "in-drivable-lane": 26.049999999999834, "deviation-heading": 5.091280483746498, "agent_compute-ego0": 0.013164579590569004, "complete-iteration": 0.1723590583747942, "set_robot_commands": 0.002319269278065023, "deviation-center-line": 1.0553087567759611, "driven_lanedir_consec": 4.0087916025913035, "sim_compute_sim_state": 0.011685966001085778, "sim_compute_performance-ego0": 0.002209676056405927}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.30055720157417726, "get_ui_image": 0.0347792937837798, "step_physics": 0.15015004147058245, "survival_time": 4.299999999999993, "driven_lanedir": 0.13744544413270665, "get_state_dump": 0.005195140838623047, "get_robot_state": 0.003786533728413198, "sim_render-ego0": 0.003982963233158506, "get_duckie_state": 1.397626153353987e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 1.8495204428029184, "agent_compute-ego0": 0.014564788204500046, "complete-iteration": 0.2272700907170087, "set_robot_commands": 0.0022559056336852326, "deviation-center-line": 0.1671437822550329, "driven_lanedir_consec": 0.13744544413270665, "sim_compute_sim_state": 0.010297756085450622, "sim_compute_performance-ego0": 0.0021585650827692844}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.817345774717767, "get_ui_image": 0.03307469500590125, "step_physics": 0.10980194057652, "survival_time": 59.99999999999873, "driven_lanedir": 2.8083142335681694, "get_state_dump": 0.004928166622126927, "get_robot_state": 0.004100479948629845, "sim_render-ego0": 0.00444430574390116, "get_duckie_state": 1.495426441608718e-06, "in-drivable-lane": 36.14999999999925, "deviation-heading": 6.3737320523936924, "agent_compute-ego0": 0.0139919796355261, "complete-iteration": 0.18785309414383175, "set_robot_commands": 0.002565892510966, "deviation-center-line": 1.8282795547238997, "driven_lanedir_consec": 2.8083142335681694, "sim_compute_sim_state": 0.012547357989588347, "sim_compute_performance-ego0": 0.0022964725684960817}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.501194740926674, "get_ui_image": 0.02567797139919767, "step_physics": 0.0805846695895993, "survival_time": 59.99999999999873, "driven_lanedir": 3.426629988210805, "get_state_dump": 0.004443649050595857, "get_robot_state": 0.003588135494578391, "sim_render-ego0": 0.003798272786390573, "get_duckie_state": 1.2550226953206313e-06, "in-drivable-lane": 30.699999999998447, "deviation-heading": 6.175871395915255, "agent_compute-ego0": 0.012517451842956795, "complete-iteration": 0.14047950272953183, "set_robot_commands": 0.0021480062819837433, "deviation-center-line": 1.998734616014289, "driven_lanedir_consec": 3.426629988210805, "sim_compute_sim_state": 0.005717553068060958, "sim_compute_performance-ego0": 0.0019243212167071263}}
set_robot_commands_max0.002565892510966
set_robot_commands_mean0.002322268426175
set_robot_commands_median0.002287587455875128
set_robot_commands_min0.0021480062819837433
sim_compute_performance-ego0_max0.0022964725684960817
sim_compute_performance-ego0_mean0.0021472587310946045
sim_compute_performance-ego0_median0.0021841205695876057
sim_compute_performance-ego0_min0.0019243212167071263
sim_compute_sim_state_max0.012547357989588347
sim_compute_sim_state_mean0.010062158286046428
sim_compute_sim_state_median0.0109918610432682
sim_compute_sim_state_min0.005717553068060958
sim_render-ego0_max0.00444430574390116
sim_render-ego0_mean0.004083170659011622
sim_render-ego0_median0.004045052052877378
sim_render-ego0_min0.003798272786390573
simulation-passed1
step_physics_max0.15015004147058245
step_physics_mean0.11051548530727671
step_physics_median0.1056636150844626
step_physics_min0.0805846695895993
survival_time_max59.99999999999873
survival_time_mean44.474999999999135
survival_time_min4.299999999999993
No reset possible
5763710897Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:17:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3866570542404792
survival_time_median21.15000000000017
deviation-center-line_median0.8654691737087861
in-drivable-lane_median7.950000000000113


other stats
agent_compute-ego0_max0.013307085534407627
agent_compute-ego0_mean0.012534004839076228
agent_compute-ego0_median0.012386319627633709
agent_compute-ego0_min0.01205629456662986
complete-iteration_max0.210127939142583
complete-iteration_mean0.18444398600487377
complete-iteration_median0.18840207218569477
complete-iteration_min0.15084386050552254
deviation-center-line_max1.1328830544365516
deviation-center-line_mean0.8479557575069042
deviation-center-line_min0.5280016281734933
deviation-heading_max4.026659855187528
deviation-heading_mean3.1425345233114492
deviation-heading_median3.1634029519124782
deviation-heading_min2.2166723342333112
driven_any_max10.422594649670025
driven_any_mean5.02652138255407
driven_any_median3.5088178291402823
driven_any_min2.665855222265693
driven_lanedir_consec_max2.5241769030892263
driven_lanedir_consec_mean2.286817024841488
driven_lanedir_consec_min1.8497770877957669
driven_lanedir_max2.5241769030892263
driven_lanedir_mean2.286817024841488
driven_lanedir_median2.3866570542404792
driven_lanedir_min1.8497770877957669
get_duckie_state_max1.305087482759738e-06
get_duckie_state_mean1.213416681366712e-06
get_duckie_state_median1.2081366345879182e-06
get_duckie_state_min1.1323059735312738e-06
get_robot_state_max0.003888920020153172
get_robot_state_mean0.003660802171878385
get_robot_state_median0.003613317488061986
get_robot_state_min0.0035276536912363966
get_state_dump_max0.004867935632642412
get_state_dump_mean0.004585084240595512
get_state_dump_median0.004548391581065375
get_state_dump_min0.0043756181676088855
get_ui_image_max0.03316863159156356
get_ui_image_mean0.029432189159177603
get_ui_image_median0.029586074129086835
get_ui_image_min0.025387976786973177
in-drivable-lane_max44.79999999999863
in-drivable-lane_mean15.699999999999722
in-drivable-lane_min2.10000000000003
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.5306646902512804, "get_ui_image": 0.027102782133039734, "step_physics": 0.10771728905153946, "survival_time": 21.250000000000167, "driven_lanedir": 2.5241769030892263, "get_state_dump": 0.0045967706492249395, "get_robot_state": 0.0035721002050408735, "sim_render-ego0": 0.003694043472898958, "get_duckie_state": 1.239664677722913e-06, "in-drivable-lane": 6.200000000000088, "deviation-heading": 2.2166723342333112, "agent_compute-ego0": 0.01213329834557475, "complete-iteration": 0.17291427610066015, "set_robot_commands": 0.0021505775585980483, "deviation-center-line": 0.8131606410329293, "driven_lanedir_consec": 2.5241769030892263, "sim_compute_sim_state": 0.009925009499133473, "sim_compute_performance-ego0": 0.0019389542055801609}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.665855222265693, "get_ui_image": 0.03316863159156356, "step_physics": 0.1389917211795072, "survival_time": 16.300000000000097, "driven_lanedir": 2.31511581312421, "get_state_dump": 0.0043756181676088855, "get_robot_state": 0.0035276536912363966, "sim_render-ego0": 0.003717044077881979, "get_duckie_state": 1.1323059735312738e-06, "in-drivable-lane": 2.10000000000003, "deviation-heading": 3.840334123534753, "agent_compute-ego0": 0.01205629456662986, "complete-iteration": 0.210127939142583, "set_robot_commands": 0.0021763299947849474, "deviation-center-line": 1.1328830544365516, "driven_lanedir_consec": 2.31511581312421, "sim_compute_sim_state": 0.010106147976096618, "sim_compute_performance-ego0": 0.001928162501857186}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.4869709680292846, "get_ui_image": 0.03206936612513393, "step_physics": 0.13038766666611223, "survival_time": 21.050000000000164, "driven_lanedir": 1.8497770877957669, "get_state_dump": 0.004867935632642412, "get_robot_state": 0.003888920020153172, "sim_render-ego0": 0.004148026778234689, "get_duckie_state": 1.305087482759738e-06, "in-drivable-lane": 9.700000000000138, "deviation-heading": 2.486471780290204, "agent_compute-ego0": 0.013307085534407627, "complete-iteration": 0.2038898682707294, "set_robot_commands": 0.002319464186356531, "deviation-center-line": 0.5280016281734933, "driven_lanedir_consec": 1.8497770877957669, "sim_compute_sim_state": 0.010621681597560504, "sim_compute_performance-ego0": 0.0021874181467209947}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.422594649670025, "get_ui_image": 0.025387976786973177, "step_physics": 0.0904470792320944, "survival_time": 59.99999999999873, "driven_lanedir": 2.4581982953567487, "get_state_dump": 0.00450001251290581, "get_robot_state": 0.003654534771083098, "sim_render-ego0": 0.0038122461796997985, "get_duckie_state": 1.1766085914529234e-06, "in-drivable-lane": 44.79999999999863, "deviation-heading": 4.026659855187528, "agent_compute-ego0": 0.012639340909692667, "complete-iteration": 0.15084386050552254, "set_robot_commands": 0.0022150169899819, "deviation-center-line": 0.9177777063846428, "driven_lanedir_consec": 2.4581982953567487, "sim_compute_sim_state": 0.0061556461153181264, "sim_compute_performance-ego0": 0.0019498050063972568}}
set_robot_commands_max0.002319464186356531
set_robot_commands_mean0.0022153471824303567
set_robot_commands_median0.0021956734923834235
set_robot_commands_min0.0021505775585980483
sim_compute_performance-ego0_max0.0021874181467209947
sim_compute_performance-ego0_mean0.0020010849651388996
sim_compute_performance-ego0_median0.0019443796059887089
sim_compute_performance-ego0_min0.001928162501857186
sim_compute_sim_state_max0.010621681597560504
sim_compute_sim_state_mean0.00920212129702718
sim_compute_sim_state_median0.010015578737615046
sim_compute_sim_state_min0.0061556461153181264
sim_render-ego0_max0.004148026778234689
sim_render-ego0_mean0.003842840127178857
sim_render-ego0_median0.003764645128790889
sim_render-ego0_min0.003694043472898958
simulation-passed1
step_physics_max0.1389917211795072
step_physics_mean0.11688593903231333
step_physics_median0.11905247785882583
step_physics_min0.0904470792320944
survival_time_max59.99999999999873
survival_time_mean29.64999999999979
survival_time_min16.300000000000097
No reset possible
5763610900Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simtimeoutyesnogpu-prod-070:00:11
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5762911428Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-erroryesnogpu-prod-070:02:50
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5759210885Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:24:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9106716056245108
survival_time_median51.32499999999922
deviation-center-line_median0.7902756410796339
in-drivable-lane_median14.799999999999866


other stats
agent_compute-ego0_max0.01409909429259825
agent_compute-ego0_mean0.01335356608628472
agent_compute-ego0_median0.013325888031574576
agent_compute-ego0_min0.01266339398939147
complete-iteration_max0.21834294670506527
complete-iteration_mean0.1819052656101395
complete-iteration_median0.178456099679344
complete-iteration_min0.15236591637680472
deviation-center-line_max3.159627678092464
deviation-center-line_mean1.231729012627356
deviation-center-line_min0.18673709025769292
deviation-heading_max10.62276480620088
deviation-heading_mean4.871008495952686
deviation-heading_median3.6055261564662824
deviation-heading_min1.650216864677298
driven_any_max8.68500980525041
driven_any_mean5.425658292087147
driven_any_median6.359772939468974
driven_any_min0.29807748416022994
driven_lanedir_consec_max7.634837172554285
driven_lanedir_consec_mean2.8952816467939693
driven_lanedir_consec_min0.1249462033725708
driven_lanedir_max7.634837172554285
driven_lanedir_mean2.9014914950342523
driven_lanedir_median1.9230913021050768
driven_lanedir_min0.1249462033725708
get_duckie_state_max1.4394451918590825e-06
get_duckie_state_mean1.2692810136592198e-06
get_duckie_state_median1.2378509991571965e-06
get_duckie_state_min1.1619768644634043e-06
get_robot_state_max0.004028798824730187
get_robot_state_mean0.003726130299286395
get_robot_state_median0.0036712359826233266
get_robot_state_min0.0035332504071687396
get_state_dump_max0.004820314168371697
get_state_dump_mean0.004637318354430407
get_state_dump_median0.004667343247641532
get_state_dump_min0.004394272754066869
get_ui_image_max0.0356350396808825
get_ui_image_mean0.030721150321807913
get_ui_image_median0.030524978379400425
get_ui_image_min0.026199604847548307
in-drivable-lane_max47.14999999999869
in-drivable-lane_mean19.18749999999961
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.68500980525041, "get_ui_image": 0.028383835269251433, "step_physics": 0.09687833424710314, "survival_time": 59.99999999999873, "driven_lanedir": 2.018223595171256, "get_state_dump": 0.004703877271958731, "get_robot_state": 0.00368677269509194, "sim_render-ego0": 0.003944568292584447, "get_duckie_state": 1.2429131754828334e-06, "in-drivable-lane": 47.14999999999869, "deviation-heading": 1.650216864677298, "agent_compute-ego0": 0.013203073401534487, "complete-iteration": 0.1642112672378578, "set_robot_commands": 0.0022330824084127077, "deviation-center-line": 0.5457965102883393, "driven_lanedir_consec": 2.018223595171256, "sim_compute_sim_state": 0.00906031772953386, "sim_compute_performance-ego0": 0.002024581291395659}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.29807748416022994, "get_ui_image": 0.0356350396808825, "step_physics": 0.14318870494240207, "survival_time": 4.699999999999991, "driven_lanedir": 0.1249462033725708, "get_state_dump": 0.004394272754066869, "get_robot_state": 0.0035332504071687396, "sim_render-ego0": 0.0037537850831684313, "get_duckie_state": 1.1619768644634043e-06, "in-drivable-lane": 2.0499999999999927, "deviation-heading": 1.9338792064456505, "agent_compute-ego0": 0.01344870266161467, "complete-iteration": 0.21834294670506527, "set_robot_commands": 0.0021794795989990234, "deviation-center-line": 0.18673709025769292, "driven_lanedir_consec": 0.1249462033725708, "sim_compute_sim_state": 0.010182601527163855, "sim_compute_performance-ego0": 0.0019407021371941817}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.929595275133148, "get_ui_image": 0.03266612148954941, "step_physics": 0.11756238501859212, "survival_time": 42.649999999999714, "driven_lanedir": 1.8279590090388975, "get_state_dump": 0.004820314168371697, "get_robot_state": 0.004028798824730187, "sim_render-ego0": 0.004241528220701553, "get_duckie_state": 1.4394451918590825e-06, "in-drivable-lane": 27.549999999999734, "deviation-heading": 5.277173106486915, "agent_compute-ego0": 0.01409909429259825, "complete-iteration": 0.19270093212083017, "set_robot_commands": 0.0024197830249330756, "deviation-center-line": 1.0347547718709285, "driven_lanedir_consec": 1.8031196160777656, "sim_compute_sim_state": 0.010477568840813025, "sim_compute_performance-ego0": 0.002275448493153485}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.7899506038048, "get_ui_image": 0.026199604847548307, "step_physics": 0.0908308626710128, "survival_time": 59.99999999999873, "driven_lanedir": 7.634837172554285, "get_state_dump": 0.0046308092233243335, "get_robot_state": 0.003655699270154714, "sim_render-ego0": 0.003855836480781498, "get_duckie_state": 1.2327888228315595e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.62276480620088, "agent_compute-ego0": 0.01266339398939147, "complete-iteration": 0.15236591637680472, "set_robot_commands": 0.002225510583729867, "deviation-center-line": 3.159627678092464, "driven_lanedir_consec": 7.634837172554285, "sim_compute_sim_state": 0.006247698714790694, "sim_compute_performance-ego0": 0.001965773691245658}}
set_robot_commands_max0.0024197830249330756
set_robot_commands_mean0.0022644639040186685
set_robot_commands_median0.0022292964960712873
set_robot_commands_min0.0021794795989990234
sim_compute_performance-ego0_max0.002275448493153485
sim_compute_performance-ego0_mean0.002051626403247246
sim_compute_performance-ego0_median0.0019951774913206585
sim_compute_performance-ego0_min0.0019407021371941817
sim_compute_sim_state_max0.010477568840813025
sim_compute_sim_state_mean0.008992046703075358
sim_compute_sim_state_median0.009621459628348858
sim_compute_sim_state_min0.006247698714790694
sim_render-ego0_max0.004241528220701553
sim_render-ego0_mean0.003948929519308982
sim_render-ego0_median0.003900202386682972
sim_render-ego0_min0.0037537850831684313
simulation-passed1
step_physics_max0.14318870494240207
step_physics_mean0.11211507171977753
step_physics_median0.10722035963284764
step_physics_min0.0908308626710128
survival_time_max59.99999999999873
survival_time_mean41.83749999999929
survival_time_min4.699999999999991
No reset possible
5757210891Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:07:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.31396446050381466
survival_time_median10.92500000000002
deviation-center-line_median0.16983225862532342
in-drivable-lane_median8.650000000000022


other stats
agent_compute-ego0_max0.0132853140742142
agent_compute-ego0_mean0.012825287582895254
agent_compute-ego0_median0.012829594117560262
agent_compute-ego0_min0.012356648022246288
complete-iteration_max0.2615161878722055
complete-iteration_mean0.20731969010041185
complete-iteration_median0.19578172039853875
complete-iteration_min0.17619913173236434
deviation-center-line_max0.4544023611386169
deviation-center-line_mean0.22010896178363196
deviation-center-line_min0.08636896874526415
deviation-heading_max2.3204281113263505
deviation-heading_mean1.1403424111321792
deviation-heading_median0.7640005740519966
deviation-heading_min0.7129403850983725
driven_any_max3.1884385482857205
driven_any_mean1.9961757385528924
driven_any_median2.07216104202442
driven_any_min0.6519423218770097
driven_lanedir_consec_max0.5816798998111024
driven_lanedir_consec_mean0.3393456361570122
driven_lanedir_consec_min0.14777372380931708
driven_lanedir_max0.5821314152239325
driven_lanedir_mean0.34168930277602333
driven_lanedir_median0.31824663521533625
driven_lanedir_min0.1481325254494883
get_duckie_state_max1.572427295503162e-06
get_duckie_state_mean1.529613839325171e-06
get_duckie_state_median1.5570291847894816e-06
get_duckie_state_min1.4319696922185588e-06
get_robot_state_max0.003809629760173537
get_robot_state_mean0.003603446487412523
get_robot_state_median0.003591431650650871
get_robot_state_min0.0034212928881748117
get_state_dump_max0.004898023901518828
get_state_dump_mean0.004640285490066537
get_state_dump_median0.004641318605059669
get_state_dump_min0.004380480848627982
get_ui_image_max0.03701365561712356
get_ui_image_mean0.030369438159310175
get_ui_image_median0.02883921286897976
get_ui_image_min0.026785671282157624
in-drivable-lane_max13.15000000000007
in-drivable-lane_mean8.200000000000028
in-drivable-lane_min2.3499999999999925
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6854091429586058, "get_ui_image": 0.026785671282157624, "step_physics": 0.11290170734734845, "survival_time": 13.850000000000062, "driven_lanedir": 0.5821314152239325, "get_state_dump": 0.004380480848627982, "get_robot_state": 0.0034212928881748117, "sim_render-ego0": 0.003746091890678131, "get_duckie_state": 1.5591545928296426e-06, "in-drivable-lane": 10.600000000000064, "deviation-heading": 0.7671668680478522, "agent_compute-ego0": 0.012712801103111652, "complete-iteration": 0.17619913173236434, "set_robot_commands": 0.0020962276047082258, "deviation-center-line": 0.4544023611386169, "driven_lanedir_consec": 0.5816798998111024, "sim_compute_sim_state": 0.008195907091922897, "sim_compute_performance-ego0": 0.0018786895189353888}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6519423218770097, "get_ui_image": 0.03701365561712356, "step_physics": 0.18437351215453376, "survival_time": 4.149999999999993, "driven_lanedir": 0.2733195825226038, "get_state_dump": 0.004842170647212437, "get_robot_state": 0.0037060919262114026, "sim_render-ego0": 0.003991969994136265, "get_duckie_state": 1.572427295503162e-06, "in-drivable-lane": 2.3499999999999925, "deviation-heading": 0.7608342800561411, "agent_compute-ego0": 0.012946387132008873, "complete-iteration": 0.2615161878722055, "set_robot_commands": 0.002200850418635777, "deviation-center-line": 0.12536776212871387, "driven_lanedir_consec": 0.2733195825226038, "sim_compute_sim_state": 0.010339078449067616, "sim_compute_performance-ego0": 0.0020166635513305664}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.1884385482857205, "get_ui_image": 0.03064941047528468, "step_physics": 0.12488207467105412, "survival_time": 16.300000000000097, "driven_lanedir": 0.3631736879080687, "get_state_dump": 0.004440466562906901, "get_robot_state": 0.0034767713750903395, "sim_render-ego0": 0.0036889653687083392, "get_duckie_state": 1.4319696922185588e-06, "in-drivable-lane": 13.15000000000007, "deviation-heading": 2.3204281113263505, "agent_compute-ego0": 0.012356648022246288, "complete-iteration": 0.19157151563451924, "set_robot_commands": 0.00204851065936074, "deviation-center-line": 0.21429675512193297, "driven_lanedir_consec": 0.35460933848502557, "sim_compute_sim_state": 0.008095773352760058, "sim_compute_performance-ego0": 0.001850255767868929}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.458912941090234, "get_ui_image": 0.02702901526267484, "step_physics": 0.13638229103562255, "survival_time": 7.99999999999998, "driven_lanedir": 0.1481325254494883, "get_state_dump": 0.004898023901518828, "get_robot_state": 0.003809629760173537, "sim_render-ego0": 0.0040803873761100055, "get_duckie_state": 1.5549037767493206e-06, "in-drivable-lane": 6.699999999999979, "deviation-heading": 0.7129403850983725, "agent_compute-ego0": 0.0132853140742142, "complete-iteration": 0.19999192516255823, "set_robot_commands": 0.002391958829038632, "deviation-center-line": 0.08636896874526415, "driven_lanedir_consec": 0.14777372380931708, "sim_compute_sim_state": 0.005939156372354638, "sim_compute_performance-ego0": 0.002084274469695476}}
set_robot_commands_max0.002391958829038632
set_robot_commands_mean0.002184386877935844
set_robot_commands_median0.0021485390116720016
set_robot_commands_min0.00204851065936074
sim_compute_performance-ego0_max0.002084274469695476
sim_compute_performance-ego0_mean0.00195747082695759
sim_compute_performance-ego0_median0.0019476765351329776
sim_compute_performance-ego0_min0.001850255767868929
sim_compute_sim_state_max0.010339078449067616
sim_compute_sim_state_mean0.008142478816526301
sim_compute_sim_state_median0.008145840222341477
sim_compute_sim_state_min0.005939156372354638
sim_render-ego0_max0.0040803873761100055
sim_render-ego0_mean0.0038768536574081856
sim_render-ego0_median0.003869030942407198
sim_render-ego0_min0.0036889653687083392
simulation-passed1
step_physics_max0.18437351215453376
step_physics_mean0.1396348963021397
step_physics_median0.13063218285333833
step_physics_min0.11290170734734845
survival_time_max16.300000000000097
survival_time_mean10.575000000000031
survival_time_min4.149999999999993
No reset possible
5748710912Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:29:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.604020557551997
survival_time_median59.199999999998774
deviation-center-line_median0.9495494604861532
in-drivable-lane_median13.499999999999272


other stats
agent_compute-ego0_max0.0563252067565918
agent_compute-ego0_mean0.03544800227614208
agent_compute-ego0_median0.036228299637221975
agent_compute-ego0_min0.013010203073532588
complete-iteration_max0.2700657812754313
complete-iteration_mean0.2090442533686959
complete-iteration_median0.19044237692648577
complete-iteration_min0.18522647834638076
deviation-center-line_max2.5570868438807905
deviation-center-line_mean1.1508648702658923
deviation-center-line_min0.14727371621047206
deviation-heading_max7.762328228959136
deviation-heading_mean4.394284159714041
deviation-heading_median4.262850402194171
deviation-heading_min1.2891076055086863
driven_any_max9.646948778381166
driven_any_mean6.987834653294605
driven_any_median8.990983966586008
driven_any_min0.3224219016252405
driven_lanedir_consec_max6.129925579110904
driven_lanedir_consec_mean3.3769752544693534
driven_lanedir_consec_min0.16993432366251682
driven_lanedir_max9.445747731537018
driven_lanedir_mean4.205930792575882
driven_lanedir_median3.604020557551997
driven_lanedir_min0.16993432366251682
get_duckie_state_max1.319342112164017e-06
get_duckie_state_mean1.2505540913425257e-06
get_duckie_state_median1.2469801360431473e-06
get_duckie_state_min1.1889139811197916e-06
get_robot_state_max0.003781454648503058
get_robot_state_mean0.003691505439800018
get_robot_state_median0.003698878556124532
get_robot_state_min0.0035868099984479487
get_state_dump_max0.005181368239625486
get_state_dump_mean0.0049506387460963265
get_state_dump_median0.005002769518652923
get_state_dump_min0.0046156477074539735
get_ui_image_max0.03582388877868652
get_ui_image_mean0.030534882108073817
get_ui_image_median0.03047668003089913
get_ui_image_min0.025362279591810494
in-drivable-lane_max43.94999999999861
in-drivable-lane_mean17.849999999999284
in-drivable-lane_min0.4499999999999744
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.646948778381166, "get_ui_image": 0.02886502649464476, "step_physics": 0.11013130919323871, "survival_time": 59.99999999999873, "driven_lanedir": 9.445747731537018, "get_state_dump": 0.005119827367383971, "get_robot_state": 0.003781454648503058, "sim_render-ego0": 0.0039925491879325824, "get_duckie_state": 1.319342112164017e-06, "in-drivable-lane": 0.4499999999999744, "deviation-heading": 7.762328228959136, "agent_compute-ego0": 0.021707576081516543, "complete-iteration": 0.1887596614354854, "set_robot_commands": 0.0023050248672523465, "deviation-center-line": 2.5570868438807905, "driven_lanedir_consec": 6.129925579110904, "sim_compute_sim_state": 0.01069452998838655, "sim_compute_performance-ego0": 0.0020657060148316954}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3224219016252405, "get_ui_image": 0.03582388877868652, "step_physics": 0.15100943247477214, "survival_time": 3.699999999999995, "driven_lanedir": 0.16993432366251682, "get_state_dump": 0.004885711669921875, "get_robot_state": 0.003675845464070638, "sim_render-ego0": 0.003801107406616211, "get_duckie_state": 1.1889139811197916e-06, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 1.2891076055086863, "agent_compute-ego0": 0.0563252067565918, "complete-iteration": 0.2700657812754313, "set_robot_commands": 0.0022773234049479167, "deviation-center-line": 0.14727371621047206, "driven_lanedir_consec": 0.16993432366251682, "sim_compute_sim_state": 0.01020541508992513, "sim_compute_performance-ego0": 0.001970974604288737}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.872893033946323, "get_ui_image": 0.0320883335671535, "step_physics": 0.11604799461527908, "survival_time": 58.39999999999882, "driven_lanedir": 4.909567882766077, "get_state_dump": 0.005181368239625486, "get_robot_state": 0.003721911648178427, "sim_render-ego0": 0.003988947799003869, "get_duckie_state": 1.3036540270463538e-06, "in-drivable-lane": 25.449999999998553, "deviation-heading": 5.516657827545817, "agent_compute-ego0": 0.013010203073532588, "complete-iteration": 0.1921250924174861, "set_robot_commands": 0.002173749272694845, "deviation-center-line": 1.080934572173674, "driven_lanedir_consec": 4.909567882766077, "sim_compute_sim_state": 0.013740911149285204, "sim_compute_performance-ego0": 0.002075671333854682}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.109074899225693, "get_ui_image": 0.025362279591810494, "step_physics": 0.08700685239056564, "survival_time": 59.99999999999873, "driven_lanedir": 2.298473232337916, "get_state_dump": 0.0046156477074539735, "get_robot_state": 0.0035868099984479487, "sim_render-ego0": 0.0037747634439841593, "get_duckie_state": 1.1903062450399407e-06, "in-drivable-lane": 43.94999999999861, "deviation-heading": 3.009042976842524, "agent_compute-ego0": 0.0507490231929274, "complete-iteration": 0.18522647834638076, "set_robot_commands": 0.0021832173908878424, "deviation-center-line": 0.8181643487986322, "driven_lanedir_consec": 2.298473232337916, "sim_compute_sim_state": 0.005953195986402322, "sim_compute_performance-ego0": 0.0019044498916867376}}
set_robot_commands_max0.0023050248672523465
set_robot_commands_mean0.0022348287339457374
set_robot_commands_median0.0022302703979178795
set_robot_commands_min0.002173749272694845
sim_compute_performance-ego0_max0.002075671333854682
sim_compute_performance-ego0_mean0.002004200461165463
sim_compute_performance-ego0_median0.0020183403095602164
sim_compute_performance-ego0_min0.0019044498916867376
sim_compute_sim_state_max0.013740911149285204
sim_compute_sim_state_mean0.0101485130534998
sim_compute_sim_state_median0.01044997253915584
sim_compute_sim_state_min0.005953195986402322
sim_render-ego0_max0.0039925491879325824
sim_render-ego0_mean0.003889341959384205
sim_render-ego0_median0.00389502760281004
sim_render-ego0_min0.0037747634439841593
simulation-passed1
step_physics_max0.15100943247477214
step_physics_mean0.11604889716846392
step_physics_median0.1130896519042589
step_physics_min0.08700685239056564
survival_time_max59.99999999999873
survival_time_mean45.52499999999907
survival_time_min3.699999999999995
No reset possible
5748011426Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-testingLFP-simhost-erroryesnogpu-prod-070:00:53
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5735110947Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:20:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6635276503927638
survival_time_median36.9749999999994
deviation-center-line_median0.2459255170291532
in-drivable-lane_median7.299999999999995


other stats
agent_compute-ego0_max0.034447216136114935
agent_compute-ego0_mean0.03333358712226722
agent_compute-ego0_median0.033554815772233404
agent_compute-ego0_min0.03177750080848713
complete-iteration_max0.22932356869408843
complete-iteration_mean0.19331183160721505
complete-iteration_median0.1851784646865572
complete-iteration_min0.17356682836165735
deviation-center-line_max2.1690475373781437
deviation-center-line_mean0.7171612406016971
deviation-center-line_min0.2077463909703383
deviation-heading_max8.80897134271336
deviation-heading_mean3.089786005879437
deviation-heading_median1.2756791254603668
deviation-heading_min0.9988144298836548
driven_any_max8.324124365198058
driven_any_mean4.784212977194561
driven_any_median4.746707224897276
driven_any_min1.3193130937856332
driven_lanedir_consec_max7.277566073673901
driven_lanedir_consec_mean2.3111667166133394
driven_lanedir_consec_min0.6400454919939287
driven_lanedir_max7.277566073673901
driven_lanedir_mean2.3111667166133394
driven_lanedir_median0.6635276503927638
driven_lanedir_min0.6400454919939287
get_duckie_state_max2.1042080100523222e-06
get_duckie_state_mean1.980811408070498e-06
get_duckie_state_median1.992272312581305e-06
get_duckie_state_min1.83449299706706e-06
get_robot_state_max0.003734543559751741
get_robot_state_mean0.003564270061350891
get_robot_state_median0.00356001678956758
get_robot_state_min0.0034025031065166643
get_state_dump_max0.004701105383016188
get_state_dump_mean0.004563397869297627
get_state_dump_median0.004602611135217809
get_state_dump_min0.004347263823738702
get_ui_image_max0.0359488331943477
get_ui_image_mean0.029605535525210978
get_ui_image_median0.028705574888472356
get_ui_image_min0.02506215912955148
in-drivable-lane_max54.64999999999874
in-drivable-lane_mean18.64999999999969
in-drivable-lane_min5.350000000000031
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.324124365198058, "get_ui_image": 0.026089130492134953, "step_physics": 0.09054727002444812, "survival_time": 59.99999999999873, "driven_lanedir": 7.277566073673901, "get_state_dump": 0.004347263823738702, "get_robot_state": 0.0034025031065166643, "sim_render-ego0": 0.0035828279515884996, "get_duckie_state": 1.83449299706706e-06, "in-drivable-lane": 5.849999999999916, "deviation-heading": 8.80897134271336, "agent_compute-ego0": 0.03278845136707569, "complete-iteration": 0.17356682836165735, "set_robot_commands": 0.002015742135980941, "deviation-center-line": 2.1690475373781437, "driven_lanedir_consec": 7.277566073673901, "sim_compute_sim_state": 0.008915846591984402, "sim_compute_performance-ego0": 0.0018012503799451182}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3193130937856332, "get_ui_image": 0.0359488331943477, "step_physics": 0.1323409539843918, "survival_time": 10.85000000000002, "driven_lanedir": 0.6711294387889155, "get_state_dump": 0.004633169655406147, "get_robot_state": 0.0036332333853485383, "sim_render-ego0": 0.003914238116063109, "get_duckie_state": 2.1042080100523222e-06, "in-drivable-lane": 5.350000000000031, "deviation-heading": 1.5430868459961558, "agent_compute-ego0": 0.03432118017739112, "complete-iteration": 0.22932356869408843, "set_robot_commands": 0.002370147530092012, "deviation-center-line": 0.2678881248946068, "driven_lanedir_consec": 0.6711294387889155, "sim_compute_sim_state": 0.010087059178483597, "sim_compute_performance-ego0": 0.0019922748618169664}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.750630534147892, "get_ui_image": 0.03132201928480976, "step_physics": 0.10250017545701662, "survival_time": 59.99999999999873, "driven_lanedir": 0.6559258619966121, "get_state_dump": 0.004701105383016188, "get_robot_state": 0.003734543559751741, "sim_render-ego0": 0.003982611440996842, "get_duckie_state": 1.972462116530495e-06, "in-drivable-lane": 54.64999999999874, "deviation-heading": 0.9988144298836548, "agent_compute-ego0": 0.03177750080848713, "complete-iteration": 0.1956171479252951, "set_robot_commands": 0.0022278856377518246, "deviation-center-line": 0.2077463909703383, "driven_lanedir_consec": 0.6559258619966121, "sim_compute_sim_state": 0.013189434707412913, "sim_compute_performance-ego0": 0.0021019652920102796}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.742783915646659, "get_ui_image": 0.02506215912955148, "step_physics": 0.09418772544179645, "survival_time": 13.950000000000063, "driven_lanedir": 0.6400454919939287, "get_state_dump": 0.004572052615029471, "get_robot_state": 0.0034868001937866213, "sim_render-ego0": 0.0038288797651018416, "get_duckie_state": 2.012082508632115e-06, "in-drivable-lane": 8.750000000000075, "deviation-heading": 1.0082714049245776, "agent_compute-ego0": 0.034447216136114935, "complete-iteration": 0.1747397814478193, "set_robot_commands": 0.0021395300115857807, "deviation-center-line": 0.22396290916369965, "driven_lanedir_consec": 0.6400454919939287, "sim_compute_sim_state": 0.005037803309304373, "sim_compute_performance-ego0": 0.0018983006477355955}}
set_robot_commands_max0.002370147530092012
set_robot_commands_mean0.0021883263288526396
set_robot_commands_median0.002183707824668803
set_robot_commands_min0.002015742135980941
sim_compute_performance-ego0_max0.0021019652920102796
sim_compute_performance-ego0_mean0.00194844779537699
sim_compute_performance-ego0_median0.001945287754776281
sim_compute_performance-ego0_min0.0018012503799451182
sim_compute_sim_state_max0.013189434707412913
sim_compute_sim_state_mean0.00930753594679632
sim_compute_sim_state_median0.009501452885233998
sim_compute_sim_state_min0.005037803309304373
sim_render-ego0_max0.003982611440996842
sim_render-ego0_mean0.003827139318437573
sim_render-ego0_median0.0038715589405824754
sim_render-ego0_min0.0035828279515884996
simulation-passed1
step_physics_max0.1323409539843918
step_physics_mean0.10489403122691324
step_physics_median0.09834395044940653
step_physics_min0.09054727002444812
survival_time_max59.99999999999873
survival_time_mean36.199999999999385
survival_time_min10.85000000000002
No reset possible
5727210973Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:18:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4210264677470112
survival_time_median25.424999999999876
deviation-center-line_median0.7538164843051756
in-drivable-lane_median17.649999999999913


other stats
agent_compute-ego0_max0.012845634755508676
agent_compute-ego0_mean0.012421568287007889
agent_compute-ego0_median0.01241828286317733
agent_compute-ego0_min0.012004072666168214
complete-iteration_max0.23075875759124756
complete-iteration_mean0.19902416632934183
complete-iteration_median0.19911927310557703
complete-iteration_min0.16709936151496577
deviation-center-line_max1.7857220375701073
deviation-center-line_mean0.8588159515006792
deviation-center-line_min0.14190879982225874
deviation-heading_max11.96763258431313
deviation-heading_mean5.009593331886197
deviation-heading_median3.5763655224223556
deviation-heading_min0.9180096983869492
driven_any_max11.752950382102384
driven_any_mean5.519259206205342
driven_any_median4.826417731540104
driven_any_min0.6712509796387744
driven_lanedir_consec_max3.650215997531058
driven_lanedir_consec_mean1.6943355729773304
driven_lanedir_consec_min0.2850733588842411
driven_lanedir_max4.505535089011568
driven_lanedir_mean2.054785141416629
driven_lanedir_median1.714266058885353
driven_lanedir_min0.2850733588842411
get_duckie_state_max1.4729033222061925e-06
get_duckie_state_mean1.373763155191146e-06
get_duckie_state_median1.3784018669339176e-06
get_duckie_state_min1.2653455646905573e-06
get_robot_state_max0.003834957575929758
get_robot_state_mean0.003700945146955344
get_robot_state_median0.0036961450127257936
get_robot_state_min0.003576532986440031
get_state_dump_max0.004664481674110033
get_state_dump_mean0.004610116206834356
get_state_dump_median0.0046406148726160605
get_state_dump_min0.00449475340799527
get_ui_image_max0.03563255786895752
get_ui_image_mean0.02987828138050313
get_ui_image_median0.029023202443877676
get_ui_image_min0.025834162765299647
in-drivable-lane_max36.04999999999909
in-drivable-lane_mean18.499999999999726
in-drivable-lane_min2.6499999999999906
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.686718515548966, "get_ui_image": 0.02749820512348257, "step_physics": 0.12369320017056704, "survival_time": 41.84999999999976, "driven_lanedir": 1.8761643609853844, "get_state_dump": 0.0046208140958180575, "get_robot_state": 0.0037637428338317142, "sim_render-ego0": 0.0038884835482212695, "get_duckie_state": 1.4729033222061925e-06, "in-drivable-lane": 32.64999999999982, "deviation-heading": 5.592217147777675, "agent_compute-ego0": 0.012728976463645625, "complete-iteration": 0.19118838606131103, "set_robot_commands": 0.002212159104449652, "deviation-center-line": 0.896768571848211, "driven_lanedir_consec": 1.2896851787087005, "sim_compute_sim_state": 0.010532061638297216, "sim_compute_performance-ego0": 0.002151022662979891}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6712509796387744, "get_ui_image": 0.03563255786895752, "step_physics": 0.1566799259185791, "survival_time": 4.94999999999999, "driven_lanedir": 0.2850733588842411, "get_state_dump": 0.004660415649414063, "get_robot_state": 0.003628547191619873, "sim_render-ego0": 0.0037510514259338377, "get_duckie_state": 1.3065338134765626e-06, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 0.9180096983869492, "agent_compute-ego0": 0.012004072666168214, "complete-iteration": 0.23075875759124756, "set_robot_commands": 0.002179560661315918, "deviation-center-line": 0.14190879982225874, "driven_lanedir_consec": 0.2850733588842411, "sim_compute_sim_state": 0.010201995372772216, "sim_compute_performance-ego0": 0.0019377565383911133}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.9661169475312417, "get_ui_image": 0.030548199764272786, "step_physics": 0.13701926805696435, "survival_time": 8.999999999999993, "driven_lanedir": 1.5523677567853218, "get_state_dump": 0.004664481674110033, "get_robot_state": 0.003834957575929758, "sim_render-ego0": 0.003973938483559624, "get_duckie_state": 1.4502699203912723e-06, "in-drivable-lane": 2.6500000000000075, "deviation-heading": 1.5605138970670358, "agent_compute-ego0": 0.012845634755508676, "complete-iteration": 0.20705016014984295, "set_robot_commands": 0.0021832766453864167, "deviation-center-line": 0.6108643967621402, "driven_lanedir_consec": 1.5523677567853218, "sim_compute_sim_state": 0.009741029686690694, "sim_compute_performance-ego0": 0.002139158670414877}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.752950382102384, "get_ui_image": 0.025834162765299647, "step_physics": 0.1070363672448634, "survival_time": 59.99999999999873, "driven_lanedir": 4.505535089011568, "get_state_dump": 0.00449475340799527, "get_robot_state": 0.003576532986440031, "sim_render-ego0": 0.0037140365841982262, "get_duckie_state": 1.2653455646905573e-06, "in-drivable-lane": 36.04999999999909, "deviation-heading": 11.96763258431313, "agent_compute-ego0": 0.012107589262709034, "complete-iteration": 0.16709936151496577, "set_robot_commands": 0.002110616650609152, "deviation-center-line": 1.7857220375701073, "driven_lanedir_consec": 3.650215997531058, "sim_compute_sim_state": 0.006250974836198615, "sim_compute_performance-ego0": 0.001890345080309764}}
set_robot_commands_max0.002212159104449652
set_robot_commands_mean0.002171403265440285
set_robot_commands_median0.0021814186533511675
set_robot_commands_min0.002110616650609152
sim_compute_performance-ego0_max0.002151022662979891
sim_compute_performance-ego0_mean0.0020295707380239116
sim_compute_performance-ego0_median0.002038457604402995
sim_compute_performance-ego0_min0.001890345080309764
sim_compute_sim_state_max0.010532061638297216
sim_compute_sim_state_mean0.009181515383489686
sim_compute_sim_state_median0.009971512529731457
sim_compute_sim_state_min0.006250974836198615
sim_render-ego0_max0.003973938483559624
sim_render-ego0_mean0.00383187751047824
sim_render-ego0_median0.0038197674870775536
sim_render-ego0_min0.0037140365841982262
simulation-passed1
step_physics_max0.1566799259185791
step_physics_mean0.13110719034774346
step_physics_median0.13035623411376568
step_physics_min0.1070363672448634
survival_time_max59.99999999999873
survival_time_mean28.94999999999962
survival_time_min4.94999999999999
No reset possible
5724111312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-070:02:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5710711018Olga (Ge Ya) Xu 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:35:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.135973644363152
survival_time_median59.99999999999873
deviation-center-line_median4.53133004822749
in-drivable-lane_median6.449999999999758


other stats
agent_compute-ego0_max0.022889284964505083
agent_compute-ego0_mean0.015156710028747637
agent_compute-ego0_median0.012625960882855496
agent_compute-ego0_min0.012485633384774469
complete-iteration_max0.19704543442452185
complete-iteration_mean0.17738175109264556
complete-iteration_median0.175621946288783
complete-iteration_min0.1612376773684944
deviation-center-line_max4.63729035842144
deviation-center-line_mean4.477154932403478
deviation-center-line_min4.208669274737491
deviation-heading_max15.82274140537251
deviation-heading_mean14.78505634544521
deviation-heading_median14.707085445664015
deviation-heading_min13.903313085080294
driven_any_max9.33020056436231
driven_any_mean7.5887469522546995
driven_any_median7.053750792947845
driven_any_min6.9172856587608
driven_lanedir_consec_max8.88334044660533
driven_lanedir_consec_mean6.6302233816441145
driven_lanedir_consec_min5.365605791244825
driven_lanedir_max8.88334044660533
driven_lanedir_mean6.630576415849154
driven_lanedir_median6.135973644363152
driven_lanedir_min5.3670179280649855
get_duckie_state_max1.4499661130373127e-06
get_duckie_state_mean1.3472337111346825e-06
get_duckie_state_median1.3650009574540747e-06
get_duckie_state_min1.2089668165932683e-06
get_robot_state_max0.003777162518529074
get_robot_state_mean0.003729064944979551
get_robot_state_median0.0037277439651044577
get_robot_state_min0.0036836093311802135
get_state_dump_max0.004711363535935833
get_state_dump_mean0.004641081024268386
get_state_dump_median0.004650970680529033
get_state_dump_min0.0045510192000796455
get_ui_image_max0.03547432758131194
get_ui_image_mean0.030256057262023624
get_ui_image_median0.030038020592942825
get_ui_image_min0.0254738602808969
in-drivable-lane_max11.44999999999935
in-drivable-lane_mean6.462499999999695
in-drivable-lane_min1.4999999999999147
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.33020056436231, "get_ui_image": 0.0284575915753494, "step_physics": 0.10050651731340216, "survival_time": 59.99999999999873, "driven_lanedir": 8.88334044660533, "get_state_dump": 0.004648517708695004, "get_robot_state": 0.0036836093311802135, "sim_render-ego0": 0.0038830568947264, "get_duckie_state": 1.4499661130373127e-06, "in-drivable-lane": 1.4999999999999147, "deviation-heading": 14.757610691134229, "agent_compute-ego0": 0.012485633384774469, "complete-iteration": 0.1672074195248797, "set_robot_commands": 0.002219951718574162, "deviation-center-line": 4.208669274737491, "driven_lanedir_consec": 8.88334044660533, "sim_compute_sim_state": 0.009238397350517735, "sim_compute_performance-ego0": 0.001995942078462548}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.045684985613738, "get_ui_image": 0.03547432758131194, "step_physics": 0.12004612844055836, "survival_time": 59.99999999999873, "driven_lanedir": 6.023670432342982, "get_state_dump": 0.004711363535935833, "get_robot_state": 0.003777162518529074, "sim_render-ego0": 0.00401506197641136, "get_duckie_state": 1.3858452129125794e-06, "in-drivable-lane": 7.799999999999557, "deviation-heading": 15.82274140537251, "agent_compute-ego0": 0.012657274910055728, "complete-iteration": 0.19704543442452185, "set_robot_commands": 0.0022985297972514768, "deviation-center-line": 4.515731107096844, "driven_lanedir_consec": 6.023670432342982, "sim_compute_sim_state": 0.01188471096937702, "sim_compute_performance-ego0": 0.00209059405584915}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.061816600281953, "get_ui_image": 0.031618449610536246, "step_physics": 0.1103319794212551, "survival_time": 59.99999999999873, "driven_lanedir": 5.3670179280649855, "get_state_dump": 0.0045510192000796455, "get_robot_state": 0.003695722821352384, "sim_render-ego0": 0.0038979021734639463, "get_duckie_state": 1.2089668165932683e-06, "in-drivable-lane": 11.44999999999935, "deviation-heading": 14.656560200193804, "agent_compute-ego0": 0.01259464685565526, "complete-iteration": 0.1840364730526863, "set_robot_commands": 0.0022852811884820513, "deviation-center-line": 4.546928989358136, "driven_lanedir_consec": 5.365605791244825, "sim_compute_sim_state": 0.012977831965183637, "sim_compute_performance-ego0": 0.0019975377558470765}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.9172856587608, "get_ui_image": 0.0254738602808969, "step_physics": 0.08990166506898294, "survival_time": 59.99999999999873, "driven_lanedir": 6.248276856383322, "get_state_dump": 0.004653423652363061, "get_robot_state": 0.0037597651088565314, "sim_render-ego0": 0.003957725186629855, "get_duckie_state": 1.34415670199557e-06, "in-drivable-lane": 5.099999999999959, "deviation-heading": 13.903313085080294, "agent_compute-ego0": 0.022889284964505083, "complete-iteration": 0.1612376773684944, "set_robot_commands": 0.002261598540980254, "deviation-center-line": 4.63729035842144, "driven_lanedir_consec": 6.248276856383322, "sim_compute_sim_state": 0.006186630406248679, "sim_compute_performance-ego0": 0.002062426320122839}}
set_robot_commands_max0.0022985297972514768
set_robot_commands_mean0.002266340311321986
set_robot_commands_median0.0022734398647311525
set_robot_commands_min0.002219951718574162
sim_compute_performance-ego0_max0.00209059405584915
sim_compute_performance-ego0_mean0.002036625052570403
sim_compute_performance-ego0_median0.0020299820379849577
sim_compute_performance-ego0_min0.001995942078462548
sim_compute_sim_state_max0.012977831965183637
sim_compute_sim_state_mean0.010071892672831768
sim_compute_sim_state_median0.01056155415994738
sim_compute_sim_state_min0.006186630406248679
sim_render-ego0_max0.00401506197641136
sim_render-ego0_mean0.00393843655780789
sim_render-ego0_median0.003927813680046901
sim_render-ego0_min0.0038830568947264
simulation-passed1
step_physics_max0.12004612844055836
step_physics_mean0.10519657256104964
step_physics_median0.10541924836732865
step_physics_min0.08990166506898294
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5708611425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-070:00:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5707611313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-070:00:57
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5701011040Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:10:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4419155316708503
survival_time_median16.075000000000095
deviation-center-line_median0.36890160398364336
in-drivable-lane_median7.475000000000069


other stats
agent_compute-ego0_max0.013407789014872148
agent_compute-ego0_mean0.013027607911459169
agent_compute-ego0_median0.013052771014354297
agent_compute-ego0_min0.012597100602255927
complete-iteration_max0.218436762877588
complete-iteration_mean0.17947388773677644
complete-iteration_median0.17107492901064084
complete-iteration_min0.15730893004823615
deviation-center-line_max0.6961955457973529
deviation-center-line_mean0.40559481463553254
deviation-center-line_min0.18838050477749063
deviation-heading_max2.1193080533279143
deviation-heading_mean1.5133305133338064
deviation-heading_median1.6323696532411305
deviation-heading_min0.6692746935250502
driven_any_max4.4007330339506066
driven_any_mean3.0433021746985873
driven_any_median3.1403418538317664
driven_any_min1.4917919571802096
driven_lanedir_consec_max2.2423891747657456
driven_lanedir_consec_mean1.464783418797714
driven_lanedir_consec_min0.7329134370834103
driven_lanedir_max2.2423891747657456
driven_lanedir_mean1.464783418797714
driven_lanedir_median1.4419155316708503
driven_lanedir_min0.7329134370834103
get_duckie_state_max1.3712004487737646e-06
get_duckie_state_mean1.3448023836710511e-06
get_duckie_state_median1.3540894622662326e-06
get_duckie_state_min1.2998301613779743e-06
get_robot_state_max0.0037959280373162305
get_robot_state_mean0.003719417551934152
get_robot_state_median0.003733716204580543
get_robot_state_min0.003614309761259291
get_state_dump_max0.004889381930158644
get_state_dump_mean0.004738920219776349
get_state_dump_median0.004704865389676472
get_state_dump_min0.004656568169593811
get_ui_image_max0.036484267422344896
get_ui_image_mean0.030655537301024095
get_ui_image_median0.02964680713119352
get_ui_image_min0.026844267519364445
in-drivable-lane_max14.500000000000137
in-drivable-lane_mean7.912500000000076
in-drivable-lane_min2.2000000000000313
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.4007330339506066, "get_ui_image": 0.028166678768617136, "step_physics": 0.08970388052640138, "survival_time": 21.55000000000017, "driven_lanedir": 2.2423891747657456, "get_state_dump": 0.004656568169593811, "get_robot_state": 0.003614309761259291, "sim_render-ego0": 0.0038667944846329863, "get_duckie_state": 1.362076512089482e-06, "in-drivable-lane": 10.800000000000152, "deviation-heading": 1.3466996835616158, "agent_compute-ego0": 0.012597100602255927, "complete-iteration": 0.15730893004823615, "set_robot_commands": 0.0021798202285060178, "deviation-center-line": 0.4466692392582318, "driven_lanedir_consec": 2.2423891747657456, "sim_compute_sim_state": 0.0105190255023815, "sim_compute_performance-ego0": 0.0019216703044043649}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.236585254177939, "get_ui_image": 0.036484267422344896, "step_physics": 0.1401926543423321, "survival_time": 11.900000000000034, "driven_lanedir": 1.8735978367163049, "get_state_dump": 0.004701428832369369, "get_robot_state": 0.0037959280373162305, "sim_render-ego0": 0.004106168467629405, "get_duckie_state": 1.2998301613779743e-06, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 2.1193080533279143, "agent_compute-ego0": 0.013407789014872148, "complete-iteration": 0.218436762877588, "set_robot_commands": 0.0023298453087587235, "deviation-center-line": 0.6961955457973529, "driven_lanedir_consec": 1.8735978367163049, "sim_compute_sim_state": 0.011202520905179458, "sim_compute_performance-ego0": 0.0021286070596224092}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.044098453485594, "get_ui_image": 0.031126935493769905, "step_physics": 0.1107843303915315, "survival_time": 20.250000000000153, "driven_lanedir": 1.0102332266253955, "get_state_dump": 0.004889381930158644, "get_robot_state": 0.0036773781471064527, "sim_render-ego0": 0.004073403738989618, "get_duckie_state": 1.3712004487737646e-06, "in-drivable-lane": 14.500000000000137, "deviation-heading": 1.9180396229206444, "agent_compute-ego0": 0.01327506544554762, "complete-iteration": 0.18345842807750984, "set_robot_commands": 0.0021247617129621834, "deviation-center-line": 0.29113396870905484, "driven_lanedir_consec": 1.0102332266253955, "sim_compute_sim_state": 0.01131796132167572, "sim_compute_performance-ego0": 0.0020993108232620315}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4917919571802096, "get_ui_image": 0.026844267519364445, "step_physics": 0.09698846029198688, "survival_time": 7.99999999999998, "driven_lanedir": 0.7329134370834103, "get_state_dump": 0.004708301946983575, "get_robot_state": 0.003790054262054633, "sim_render-ego0": 0.0039034926373025646, "get_duckie_state": 1.3461024124429834e-06, "in-drivable-lane": 4.149999999999985, "deviation-heading": 0.6692746935250502, "agent_compute-ego0": 0.01283047658316097, "complete-iteration": 0.15869142994377183, "set_robot_commands": 0.002215683090020411, "deviation-center-line": 0.18838050477749063, "driven_lanedir_consec": 0.7329134370834103, "sim_compute_sim_state": 0.005344313864382158, "sim_compute_performance-ego0": 0.001982625226796784}}
set_robot_commands_max0.0023298453087587235
set_robot_commands_mean0.0022125275850618338
set_robot_commands_median0.0021977516592632143
set_robot_commands_min0.0021247617129621834
sim_compute_performance-ego0_max0.0021286070596224092
sim_compute_performance-ego0_mean0.0020330533535213974
sim_compute_performance-ego0_median0.002040968025029408
sim_compute_performance-ego0_min0.0019216703044043649
sim_compute_sim_state_max0.01131796132167572
sim_compute_sim_state_mean0.00959595539840471
sim_compute_sim_state_median0.01086077320378048
sim_compute_sim_state_min0.005344313864382158
sim_render-ego0_max0.004106168467629405
sim_render-ego0_mean0.003987464832138644
sim_render-ego0_median0.003988448188146091
sim_render-ego0_min0.0038667944846329863
simulation-passed1
step_physics_max0.1401926543423321
step_physics_mean0.10941733138806298
step_physics_median0.1038863953417592
step_physics_min0.08970388052640138
survival_time_max21.55000000000017
survival_time_mean15.425000000000084
survival_time_min7.99999999999998
No reset possible
5692011056Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:21:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 1770 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5688011068Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:06:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6686410004768379
survival_time_median5.774999999999988
deviation-center-line_median0.13170054806002218
in-drivable-lane_median2.7749999999999915


other stats
agent_compute-ego0_max0.013889285496303014
agent_compute-ego0_mean0.012690456899388242
agent_compute-ego0_median0.012442727857880722
agent_compute-ego0_min0.01198708638548851
complete-iteration_max0.20154266130356563
complete-iteration_mean0.17898527319754637
complete-iteration_median0.18287329752332632
complete-iteration_min0.14865183643996716
deviation-center-line_max0.5208601028005717
deviation-center-line_mean0.21931563450431088
deviation-center-line_min0.0930013390966274
deviation-heading_max1.3772308129971225
deviation-heading_mean0.7875702992885585
deviation-heading_median0.6973321406794115
deviation-heading_min0.37838610279828855
driven_any_max2.4842546828207253
driven_any_mean1.7592469706031826
driven_any_median1.6456924558182862
driven_any_min1.2613482879554334
driven_lanedir_consec_max2.029530283703435
driven_lanedir_consec_mean0.9337523468445322
driven_lanedir_consec_min0.368197102721018
driven_lanedir_max2.029530283703435
driven_lanedir_mean0.9337523468445322
driven_lanedir_median0.6686410004768379
driven_lanedir_min0.368197102721018
get_duckie_state_max1.784733363560268e-06
get_duckie_state_mean1.6996480742163844e-06
get_duckie_state_median1.7067054059447311e-06
get_duckie_state_min1.6004481214158078e-06
get_robot_state_max0.004316604705083938
get_robot_state_mean0.003846268744391136
get_robot_state_median0.0037174064010675545
get_robot_state_min0.003633657470345497
get_state_dump_max0.005403109959193638
get_state_dump_mean0.004988440970736741
get_state_dump_median0.004910215588511738
get_state_dump_min0.004730222746729851
get_ui_image_max0.03342911284020607
get_ui_image_mean0.02985358367581466
get_ui_image_median0.030332145728300675
get_ui_image_min0.025320930406451225
in-drivable-lane_max3.999999999999986
in-drivable-lane_mean2.862499999999991
in-drivable-lane_min1.899999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4842546828207253, "get_ui_image": 0.027458864014323164, "step_physics": 0.10595222071903508, "survival_time": 8.14999999999998, "driven_lanedir": 2.029530283703435, "get_state_dump": 0.005042068841980725, "get_robot_state": 0.0037951731100315, "sim_render-ego0": 0.003929535063301645, "get_duckie_state": 1.731442242133908e-06, "in-drivable-lane": 1.899999999999995, "deviation-heading": 0.9941553388382084, "agent_compute-ego0": 0.012432876156597602, "complete-iteration": 0.17252010543171953, "set_robot_commands": 0.002244378008493563, "deviation-center-line": 0.5208601028005717, "driven_lanedir_consec": 2.029530283703435, "sim_compute_sim_state": 0.009430049396142727, "sim_compute_performance-ego0": 0.002140324290205793}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2613482879554334, "get_ui_image": 0.03342911284020607, "step_physics": 0.12141540202688664, "survival_time": 4.6499999999999915, "driven_lanedir": 0.368197102721018, "get_state_dump": 0.004778362335042751, "get_robot_state": 0.0036396396921036097, "sim_render-ego0": 0.003809878166685713, "get_duckie_state": 1.6004481214158078e-06, "in-drivable-lane": 2.699999999999993, "deviation-heading": 1.3772308129971225, "agent_compute-ego0": 0.012452579559163844, "complete-iteration": 0.1932264896149331, "set_robot_commands": 0.002211892858464667, "deviation-center-line": 0.15461501015929013, "driven_lanedir_consec": 0.368197102721018, "sim_compute_sim_state": 0.009341298265660065, "sim_compute_performance-ego0": 0.002052096610373639}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4360525949292078, "get_ui_image": 0.03320542744227818, "step_physics": 0.1265028749193464, "survival_time": 5.1999999999999895, "driven_lanedir": 0.659635841451105, "get_state_dump": 0.005403109959193638, "get_robot_state": 0.004316604705083938, "sim_render-ego0": 0.004331270853678386, "get_duckie_state": 1.784733363560268e-06, "in-drivable-lane": 2.84999999999999, "deviation-heading": 0.4005089425206144, "agent_compute-ego0": 0.013889285496303014, "complete-iteration": 0.20154266130356563, "set_robot_commands": 0.0023638543628510976, "deviation-center-line": 0.0930013390966274, "driven_lanedir_consec": 0.659635841451105, "sim_compute_sim_state": 0.009121792657034736, "sim_compute_performance-ego0": 0.002299983160836356}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8553323167073643, "get_ui_image": 0.025320930406451225, "step_physics": 0.0899541899561882, "survival_time": 6.349999999999985, "driven_lanedir": 0.6776461595025709, "get_state_dump": 0.004730222746729851, "get_robot_state": 0.003633657470345497, "sim_render-ego0": 0.003708623349666595, "get_duckie_state": 1.6819685697555542e-06, "in-drivable-lane": 3.999999999999986, "deviation-heading": 0.37838610279828855, "agent_compute-ego0": 0.01198708638548851, "complete-iteration": 0.14865183643996716, "set_robot_commands": 0.0022688787430524826, "deviation-center-line": 0.10878608596075424, "driven_lanedir_consec": 0.6776461595025709, "sim_compute_sim_state": 0.004979047924280167, "sim_compute_performance-ego0": 0.001965725794434547}}
set_robot_commands_max0.0023638543628510976
set_robot_commands_mean0.002272250993215453
set_robot_commands_median0.002256628375773023
set_robot_commands_min0.002211892858464667
sim_compute_performance-ego0_max0.002299983160836356
sim_compute_performance-ego0_mean0.002114532463962584
sim_compute_performance-ego0_median0.002096210450289716
sim_compute_performance-ego0_min0.001965725794434547
sim_compute_sim_state_max0.009430049396142727
sim_compute_sim_state_mean0.008218047060779424
sim_compute_sim_state_median0.0092315454613474
sim_compute_sim_state_min0.004979047924280167
sim_render-ego0_max0.004331270853678386
sim_render-ego0_mean0.0039448268583330845
sim_render-ego0_median0.003869706614993679
sim_render-ego0_min0.003708623349666595
simulation-passed1
step_physics_max0.1265028749193464
step_physics_mean0.11095617190536408
step_physics_median0.11368381137296084
step_physics_min0.0899541899561882
survival_time_max8.14999999999998
survival_time_mean6.087499999999986
survival_time_min4.6499999999999915
No reset possible
5671011092Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:29:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.068216087273205
survival_time_median59.99999999999873
deviation-center-line_median3.090005496450313
in-drivable-lane_median10.074999999999855


other stats
agent_compute-ego0_max0.012854845696543774
agent_compute-ego0_mean0.012561220216853797
agent_compute-ego0_median0.012580572324715218
agent_compute-ego0_min0.012228890521440976
complete-iteration_max0.22109589390115475
complete-iteration_mean0.19341898054006168
complete-iteration_median0.1938629671536232
complete-iteration_min0.16485409395184544
deviation-center-line_max3.448469020511213
deviation-center-line_mean2.5711045172098346
deviation-center-line_min0.6559380554275002
deviation-heading_max19.117196603119453
deviation-heading_mean13.916685222865922
deviation-heading_median15.974706426053247
deviation-heading_min4.600131436237738
driven_any_max10.78531059349442
driven_any_mean8.374415744569289
driven_any_median10.010992747802952
driven_any_min2.6903668891768353
driven_lanedir_consec_max9.873808038154769
driven_lanedir_consec_mean4.7520439350953545
driven_lanedir_consec_min0.9979355276802409
driven_lanedir_max9.873808038154769
driven_lanedir_mean6.083525679599213
driven_lanedir_median6.311641659184013
driven_lanedir_min1.837011361874063
get_duckie_state_max1.3247020635676323e-06
get_duckie_state_mean1.2529154916406498e-06
get_duckie_state_median1.2476320204622295e-06
get_duckie_state_min1.1916958620705076e-06
get_robot_state_max0.00367311503749488
get_robot_state_mean0.003617177620724384
get_robot_state_median0.003624376905252296
get_robot_state_min0.0035468416348980627
get_state_dump_max0.004606995539099975
get_state_dump_mean0.004550954281190583
get_state_dump_median0.004553341944946238
get_state_dump_min0.004490137695769883
get_ui_image_max0.03555084088759855
get_ui_image_mean0.03031288845084152
get_ui_image_median0.02962573442133539
get_ui_image_min0.02644924407309674
in-drivable-lane_max16.849999999999635
in-drivable-lane_mean10.012499999999813
in-drivable-lane_min3.049999999999905
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.78531059349442, "get_ui_image": 0.027282152644402775, "step_physics": 0.10091100961937692, "survival_time": 59.99999999999873, "driven_lanedir": 9.873808038154769, "get_state_dump": 0.004490137695769883, "get_robot_state": 0.0035468416348980627, "sim_render-ego0": 0.003674544065222951, "get_duckie_state": 1.2379502575165227e-06, "in-drivable-lane": 3.049999999999905, "deviation-heading": 12.847519461565406, "agent_compute-ego0": 0.012228890521440976, "complete-iteration": 0.16485409395184544, "set_robot_commands": 0.002093737568089011, "deviation-center-line": 2.8391697111874445, "driven_lanedir_consec": 9.873808038154769, "sim_compute_sim_state": 0.008652900478226458, "sim_compute_performance-ego0": 0.0018932587101894256}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.004486852043897, "get_ui_image": 0.03555084088759855, "step_physics": 0.14518315428798145, "survival_time": 59.99999999999873, "driven_lanedir": 6.437197448176239, "get_state_dump": 0.004563788390973525, "get_robot_state": 0.0035758228921374115, "sim_render-ego0": 0.0037957212510057337, "get_duckie_state": 1.3247020635676323e-06, "in-drivable-lane": 15.849999999999696, "deviation-heading": 19.117196603119453, "agent_compute-ego0": 0.01263436727182355, "complete-iteration": 0.22109589390115475, "set_robot_commands": 0.0021343808884823155, "deviation-center-line": 3.3408412817131814, "driven_lanedir_consec": 4.245345090840749, "sim_compute_sim_state": 0.011634567992871846, "sim_compute_performance-ego0": 0.0019388623678316976}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.017498643562009, "get_ui_image": 0.031969316198268004, "step_physics": 0.14099663163501952, "survival_time": 59.99999999999873, "driven_lanedir": 6.186085870191787, "get_state_dump": 0.004542895498918951, "get_robot_state": 0.003672930918367181, "sim_render-ego0": 0.0038253329973435223, "get_duckie_state": 1.1916958620705076e-06, "in-drivable-lane": 16.849999999999635, "deviation-heading": 19.101893390541093, "agent_compute-ego0": 0.012854845696543774, "complete-iteration": 0.21400773693977249, "set_robot_commands": 0.0022333269810100877, "deviation-center-line": 3.448469020511213, "driven_lanedir_consec": 3.8910870837056626, "sim_compute_sim_state": 0.01182876995064436, "sim_compute_performance-ego0": 0.0019980209455402764}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6903668891768353, "get_ui_image": 0.02644924407309674, "step_physics": 0.11274794532172948, "survival_time": 16.400000000000098, "driven_lanedir": 1.837011361874063, "get_state_dump": 0.004606995539099975, "get_robot_state": 0.00367311503749488, "sim_render-ego0": 0.0038081940184248255, "get_duckie_state": 1.257313783407936e-06, "in-drivable-lane": 4.300000000000015, "deviation-heading": 4.600131436237738, "agent_compute-ego0": 0.012526777377606888, "complete-iteration": 0.17371819736747393, "set_robot_commands": 0.0021724961811285977, "deviation-center-line": 0.6559380554275002, "driven_lanedir_consec": 0.9979355276802409, "sim_compute_sim_state": 0.005715196980531455, "sim_compute_performance-ego0": 0.0019345399456545936}}
set_robot_commands_max0.0022333269810100877
set_robot_commands_mean0.0021584854046775032
set_robot_commands_median0.002153438534805457
set_robot_commands_min0.002093737568089011
sim_compute_performance-ego0_max0.0019980209455402764
sim_compute_performance-ego0_mean0.0019411704923039984
sim_compute_performance-ego0_median0.0019367011567431457
sim_compute_performance-ego0_min0.0018932587101894256
sim_compute_sim_state_max0.01182876995064436
sim_compute_sim_state_mean0.00945785885056853
sim_compute_sim_state_median0.010143734235549153
sim_compute_sim_state_min0.005715196980531455
sim_render-ego0_max0.0038253329973435223
sim_render-ego0_mean0.003775948082999258
sim_render-ego0_median0.0038019576347152794
sim_render-ego0_min0.003674544065222951
simulation-passed1
step_physics_max0.14518315428798145
step_physics_mean0.12495968521602684
step_physics_median0.1268722884783745
step_physics_min0.10091100961937692
survival_time_max59.99999999999873
survival_time_mean49.09999999999907
survival_time_min16.400000000000098
No reset possible
5665011093Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:08:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6531735829195671
survival_time_median5.07499999999999
deviation-center-line_median0.09372641978625572
in-drivable-lane_median2.7749999999999924


other stats
agent_compute-ego0_max0.08492757269173615
agent_compute-ego0_mean0.03096522132501636
agent_compute-ego0_median0.013239361088851404
agent_compute-ego0_min0.012454590430626505
complete-iteration_max0.24184673819048652
complete-iteration_mean0.2106375578391707
complete-iteration_median0.21127531927010057
complete-iteration_min0.17815285462599534
deviation-center-line_max0.25211078410553667
deviation-center-line_mean0.12403235879106642
deviation-center-line_min0.05656581148621745
deviation-heading_max0.974426685470986
deviation-heading_mean0.5567417066190413
deviation-heading_median0.45140663497877864
deviation-heading_min0.34972687104762223
driven_any_max1.8902633483115143
driven_any_mean1.33122692309733
driven_any_median1.4011120506996404
driven_any_min0.6324202426785251
driven_lanedir_consec_max0.7131499048913401
driven_lanedir_consec_mean0.5538612805503353
driven_lanedir_consec_min0.1959480514708671
driven_lanedir_max0.7131499048913401
driven_lanedir_mean0.5538612805503353
driven_lanedir_median0.6531735829195671
driven_lanedir_min0.1959480514708671
get_duckie_state_max1.5112069936899038e-06
get_duckie_state_mean1.419374696129676e-06
get_duckie_state_median1.4005307969152842e-06
get_duckie_state_min1.365230196998233e-06
get_robot_state_max0.003942237412633975
get_robot_state_mean0.0038381435408391023
get_robot_state_median0.003882576630424787
get_robot_state_min0.003645183489872859
get_state_dump_max0.005195954750324118
get_state_dump_mean0.004990991484821116
get_state_dump_median0.004975994451456021
get_state_dump_min0.004816022286048302
get_ui_image_max0.036649777971465014
get_ui_image_mean0.03108517846691597
get_ui_image_median0.02990509520520221
get_ui_image_min0.027880745485794445
in-drivable-lane_max3.89999999999999
in-drivable-lane_mean2.824999999999992
in-drivable-lane_min1.8499999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.8902633483115143, "get_ui_image": 0.028543756558344915, "step_physics": 0.11177215576171876, "survival_time": 6.449999999999985, "driven_lanedir": 0.7131499048913401, "get_state_dump": 0.004816022286048302, "get_robot_state": 0.003645183489872859, "sim_render-ego0": 0.0038947270466731143, "get_duckie_state": 1.5112069936899038e-06, "in-drivable-lane": 3.89999999999999, "deviation-heading": 0.974426685470986, "agent_compute-ego0": 0.012454590430626505, "complete-iteration": 0.17815285462599534, "set_robot_commands": 0.002278261918288011, "deviation-center-line": 0.25211078410553667, "driven_lanedir_consec": 0.7131499048913401, "sim_compute_sim_state": 0.008592796325683594, "sim_compute_performance-ego0": 0.002057191041799692}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6324202426785251, "get_ui_image": 0.036649777971465014, "step_physics": 0.16429441139615816, "survival_time": 2.849999999999998, "driven_lanedir": 0.1959480514708671, "get_state_dump": 0.005195954750324118, "get_robot_state": 0.003935637145206846, "sim_render-ego0": 0.0041461073119064855, "get_duckie_state": 1.4099581488247575e-06, "in-drivable-lane": 1.8499999999999976, "deviation-heading": 0.5223828256471623, "agent_compute-ego0": 0.01338417776699724, "complete-iteration": 0.24184673819048652, "set_robot_commands": 0.002184058057850805, "deviation-center-line": 0.05656581148621745, "driven_lanedir_consec": 0.1959480514708671, "sim_compute_sim_state": 0.009863475273395409, "sim_compute_performance-ego0": 0.0020896319685311153}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0691768887865982, "get_ui_image": 0.0312664338520595, "step_physics": 0.1199101550238473, "survival_time": 4.149999999999993, "driven_lanedir": 0.6451307621460519, "get_state_dump": 0.004849019504728771, "get_robot_state": 0.003829516115642729, "sim_render-ego0": 0.004052275703066871, "get_duckie_state": 1.365230196998233e-06, "in-drivable-lane": 1.8499999999999936, "deviation-heading": 0.3804304443103949, "agent_compute-ego0": 0.013094544410705566, "complete-iteration": 0.1891031577473595, "set_robot_commands": 0.002226877780187698, "deviation-center-line": 0.08870435297046002, "driven_lanedir_consec": 0.6451307621460519, "sim_compute_sim_state": 0.007650750023978097, "sim_compute_performance-ego0": 0.0021258677755083355}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7330472126126824, "get_ui_image": 0.027880745485794445, "step_physics": 0.09781178561123936, "survival_time": 5.999999999999987, "driven_lanedir": 0.6612164036930823, "get_state_dump": 0.005102969398183271, "get_robot_state": 0.003942237412633975, "sim_render-ego0": 0.00402024954803719, "get_duckie_state": 1.3911034450058109e-06, "in-drivable-lane": 3.699999999999987, "deviation-heading": 0.34972687104762223, "agent_compute-ego0": 0.08492757269173615, "complete-iteration": 0.23344748079284164, "set_robot_commands": 0.0023756046925694487, "deviation-center-line": 0.09874848660205146, "driven_lanedir_consec": 0.6612164036930823, "sim_compute_sim_state": 0.0052814523050607725, "sim_compute_performance-ego0": 0.002000241240194021}}
set_robot_commands_max0.0023756046925694487
set_robot_commands_mean0.0022662006122239906
set_robot_commands_median0.0022525698492378544
set_robot_commands_min0.002184058057850805
sim_compute_performance-ego0_max0.0021258677755083355
sim_compute_performance-ego0_mean0.002068233006508291
sim_compute_performance-ego0_median0.0020734115051654037
sim_compute_performance-ego0_min0.002000241240194021
sim_compute_sim_state_max0.009863475273395409
sim_compute_sim_state_mean0.007847118482029469
sim_compute_sim_state_median0.008121773174830847
sim_compute_sim_state_min0.0052814523050607725
sim_render-ego0_max0.0041461073119064855
sim_render-ego0_mean0.004028339902420915
sim_render-ego0_median0.004036262625552031
sim_render-ego0_min0.0038947270466731143
simulation-passed1
step_physics_max0.16429441139615816
step_physics_mean0.12344712694824088
step_physics_median0.11584115539278304
step_physics_min0.09781178561123936
survival_time_max6.449999999999985
survival_time_mean4.862499999999991
survival_time_min2.849999999999998
No reset possible
5661411427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-070:05:30
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5659311427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-070:01:04
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5656511112Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:03:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 37 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5650411280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5641711134Himanshu Arora 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:05:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5633711450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-070:03:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5629211128Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5626311286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5623311310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:07
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5619611310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5617411283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5580511420Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-070:33:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.696147591383086
survival_time_median33.64999999999935
deviation-center-line_median1.602678575587224
in-drivable-lane_median0.6999999999999975


other stats
agent_compute-ego0_max0.04952047957855017
agent_compute-ego0_mean0.0464054590894872
agent_compute-ego0_median0.0464054590894872
agent_compute-ego0_min0.043290438600424225
agent_compute-npc0_max0.03956531684265645
agent_compute-npc0_mean0.03769210739531479
agent_compute-npc0_median0.03769210739531479
agent_compute-npc0_min0.03581889794797313
agent_compute-npc1_max0.04100508475482315
agent_compute-npc1_mean0.0384716105932294
agent_compute-npc1_median0.0384716105932294
agent_compute-npc1_min0.03593813643163564
agent_compute-npc2_max0.04134843490403657
agent_compute-npc2_mean0.038503437763189624
agent_compute-npc2_median0.038503437763189624
agent_compute-npc2_min0.035658440622342684
complete-iteration_max1.223660167382688
complete-iteration_mean1.1231458614278838
complete-iteration_median1.1231458614278838
complete-iteration_min1.0226315554730798
deviation-center-line_max2.8305007562607853
deviation-center-line_mean1.602678575587224
deviation-center-line_min0.37485639491366257
deviation-heading_max10.829028225443134
deviation-heading_mean6.4136445912508755
deviation-heading_median6.4136445912508755
deviation-heading_min1.9982609570586176
driven_any_max14.590269734375006
driven_any_mean8.060581772023879
driven_any_median8.060581772023879
driven_any_min1.5308938096727505
driven_lanedir_consec_max14.2852209595819
driven_lanedir_consec_mean7.696147591383086
driven_lanedir_consec_min1.107074223184273
driven_lanedir_max14.285221064869503
driven_lanedir_mean7.696296759693248
driven_lanedir_median7.696296759693248
driven_lanedir_min1.107372454516992
get_duckie_state_max1.456461796144239e-06
get_duckie_state_mean1.4353474499120577e-06
get_duckie_state_median1.4353474499120577e-06
get_duckie_state_min1.414233103679876e-06
get_robot_state_max0.013995428474581972
get_robot_state_mean0.01387660033307964
get_robot_state_median0.01387660033307964
get_robot_state_min0.013757772191577313
get_state_dump_max0.009488303645127484
get_state_dump_mean0.009375722853795903
get_state_dump_median0.009375722853795903
get_state_dump_min0.009263142062464324
get_ui_image_max0.04969687346713331
get_ui_image_mean0.04900487498368665
get_ui_image_median0.04900487498368665
get_ui_image_min0.048312876500239986
in-drivable-lane_max1.399999999999995
in-drivable-lane_mean0.6999999999999975
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 14.590269734375006, "get_ui_image": 0.04969687346713331, "step_physics": 0.7135716058332457, "survival_time": 59.99999999999873, "driven_lanedir": 14.285221064869503, "get_state_dump": 0.009263142062464324, "get_robot_state": 0.013757772191577313, "sim_render-ego0": 0.003830335420136845, "sim_render-npc0": 0.00372577269408824, "sim_render-npc1": 0.003716107113573772, "sim_render-npc2": 0.00377581955292739, "get_duckie_state": 1.414233103679876e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.829028225443134, "agent_compute-ego0": 0.043290438600424225, "agent_compute-npc0": 0.03956531684265645, "agent_compute-npc1": 0.04100508475482315, "agent_compute-npc2": 0.04134843490403657, "complete-iteration": 1.0226315554730798, "set_robot_commands": 0.0022169015091920673, "deviation-center-line": 2.8305007562607853, "driven_lanedir_consec": 14.2852209595819, "sim_compute_sim_state": 0.03959727724029261, "sim_compute_performance-ego0": 0.002021663294148187, "sim_compute_performance-npc0": 0.001879891785455683, "sim_compute_performance-npc1": 0.0018859896235025296, "sim_compute_performance-npc2": 0.001890914426258859}, "LFVI-norm-udem1-000-ego0": {"driven_any": 1.5308938096727505, "get_ui_image": 0.048312876500239986, "step_physics": 0.9225303332010903, "survival_time": 7.299999999999982, "driven_lanedir": 1.107372454516992, "get_state_dump": 0.009488303645127484, "get_robot_state": 0.013995428474581972, "sim_render-ego0": 0.003922443000637755, "sim_render-npc0": 0.0038880977500863625, "sim_render-npc1": 0.003908687708329181, "sim_render-npc2": 0.0038594112915246665, "get_duckie_state": 1.456461796144239e-06, "in-drivable-lane": 1.399999999999995, "deviation-heading": 1.9982609570586176, "agent_compute-ego0": 0.04952047957855017, "agent_compute-npc0": 0.03581889794797313, "agent_compute-npc1": 0.03593813643163564, "agent_compute-npc2": 0.035658440622342684, "complete-iteration": 1.223660167382688, "set_robot_commands": 0.00222116587113361, "deviation-center-line": 0.37485639491366257, "driven_lanedir_consec": 1.107074223184273, "sim_compute_sim_state": 0.03953687998713279, "sim_compute_performance-ego0": 0.0021296569279261996, "sim_compute_performance-npc0": 0.001989896605614902, "sim_compute_performance-npc1": 0.0019152342867689068, "sim_compute_performance-npc2": 0.0019886055771185427}}
set_robot_commands_max0.00222116587113361
set_robot_commands_mean0.002219033690162839
set_robot_commands_median0.002219033690162839
set_robot_commands_min0.0022169015091920673
sim_compute_performance-ego0_max0.0021296569279261996
sim_compute_performance-ego0_mean0.0020756601110371933
sim_compute_performance-ego0_median0.0020756601110371933
sim_compute_performance-ego0_min0.002021663294148187
sim_compute_performance-npc0_max0.001989896605614902
sim_compute_performance-npc0_mean0.0019348941955352923
sim_compute_performance-npc0_median0.0019348941955352923
sim_compute_performance-npc0_min0.001879891785455683
sim_compute_performance-npc1_max0.0019152342867689068
sim_compute_performance-npc1_mean0.0019006119551357183
sim_compute_performance-npc1_median0.0019006119551357183
sim_compute_performance-npc1_min0.0018859896235025296
sim_compute_performance-npc2_max0.0019886055771185427
sim_compute_performance-npc2_mean0.0019397600016887008
sim_compute_performance-npc2_median0.0019397600016887008
sim_compute_performance-npc2_min0.001890914426258859
sim_compute_sim_state_max0.03959727724029261
sim_compute_sim_state_mean0.0395670786137127
sim_compute_sim_state_median0.0395670786137127
sim_compute_sim_state_min0.03953687998713279
sim_render-ego0_max0.003922443000637755
sim_render-ego0_mean0.003876389210387299
sim_render-ego0_median0.003876389210387299
sim_render-ego0_min0.003830335420136845
sim_render-npc0_max0.0038880977500863625
sim_render-npc0_mean0.003806935222087301
sim_render-npc0_median0.003806935222087301
sim_render-npc0_min0.00372577269408824
sim_render-npc1_max0.003908687708329181
sim_render-npc1_mean0.003812397410951476
sim_render-npc1_median0.003812397410951476
sim_render-npc1_min0.003716107113573772
sim_render-npc2_max0.0038594112915246665
sim_render-npc2_mean0.003817615422226028
sim_render-npc2_median0.003817615422226028
sim_render-npc2_min0.00377581955292739
simulation-passed1
step_physics_max0.9225303332010903
step_physics_mean0.818050969517168
step_physics_median0.818050969517168
step_physics_min0.7135716058332457
survival_time_max59.99999999999873
survival_time_mean33.64999999999935
survival_time_min7.299999999999982
No reset possible
5578711287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5576711287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5572711284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:21
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5570011285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5567511311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5566011285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:33
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5564011301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5557711296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:33
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5553111282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:42
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5546011308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:09
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5540511276Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5537511281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5535211289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5532811305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5512911413Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFP-sim-validationLFP-simsuccessnonogpu-prod-070:11:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.025
in-drivable-lane_median0.5250000000000075
driven_lanedir_consec_median1.5425060846496597
deviation-center-line_median0.3402907324174555


other stats
agent_compute-ego0_max0.044146332603234514
agent_compute-ego0_mean0.04184440131577592
agent_compute-ego0_median0.04169043079509409
agent_compute-ego0_min0.039850411069681006
complete-iteration_max0.27053127505562524
complete-iteration_mean0.22380871301124772
complete-iteration_median0.2236613213716941
complete-iteration_min0.17738093424597748
deviation-center-line_max3.9835052701742866
deviation-center-line_mean1.236651740974358
deviation-center-line_min0.28252022888823475
deviation-heading_max15.44160972654172
deviation-heading_mean4.841131521609718
deviation-heading_median1.5359479095706048
deviation-heading_min0.851020540755943
driven_any_max14.5898100863319
driven_any_mean4.636677111867429
driven_any_median1.7082199312507167
driven_any_min0.5404584986363816
driven_lanedir_consec_max11.088425839240465
driven_lanedir_consec_mean3.668570257254791
driven_lanedir_consec_min0.5008430204793802
driven_lanedir_max11.088425839240465
driven_lanedir_mean3.668570257254791
driven_lanedir_median1.5425060846496597
driven_lanedir_min0.5008430204793802
get_duckie_state_max0.02231629078204815
get_duckie_state_mean0.015961928367295153
get_duckie_state_median0.018803755426595337
get_duckie_state_min0.003923911833941788
get_robot_state_max0.003308375676472982
get_robot_state_mean0.003220391756775813
get_robot_state_median0.0032210553201303307
get_robot_state_min0.003131080710369608
get_state_dump_max0.007324524796926058
get_state_dump_mean0.006396232914494733
get_state_dump_median0.006845304287469434
get_state_dump_min0.004569798286114009
get_ui_image_max0.03246137590119333
get_ui_image_mean0.028103228397050213
get_ui_image_median0.02844525567165585
get_ui_image_min0.023061026343695827
in-drivable-lane_max11.099999999999756
in-drivable-lane_mean3.037499999999943
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.276806063496427, "get_ui_image": 0.027179586199613717, "step_physics": 0.1000656531407283, "survival_time": 10.350000000000012, "driven_lanedir": 1.9665277864594513, "get_state_dump": 0.007324524796926058, "get_robot_state": 0.0031911937090066764, "sim_render-ego0": 0.0032991090646156897, "get_duckie_state": 0.02231629078204815, "in-drivable-lane": 1.050000000000015, "deviation-heading": 1.747008755262681, "agent_compute-ego0": 0.044146332603234514, "complete-iteration": 0.2181027416999523, "set_robot_commands": 0.0018903544315925012, "deviation-center-line": 0.3724996356547582, "driven_lanedir_consec": 1.9665277864594513, "sim_compute_sim_state": 0.006920189811633184, "sim_compute_performance-ego0": 0.0016828695168861975}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5404584986363816, "get_ui_image": 0.03246137590119333, "step_physics": 0.15107287421370996, "survival_time": 3.2499999999999964, "driven_lanedir": 0.5008430204793802, "get_state_dump": 0.007059671662070535, "get_robot_state": 0.003308375676472982, "sim_render-ego0": 0.0033443371454874673, "get_duckie_state": 0.01918121901425448, "in-drivable-lane": 0.0, "deviation-heading": 1.3248870638785288, "agent_compute-ego0": 0.04197592807538582, "complete-iteration": 0.27053127505562524, "set_robot_commands": 0.001990412220810399, "deviation-center-line": 0.28252022888823475, "driven_lanedir_consec": 0.5008430204793802, "sim_compute_sim_state": 0.008328401681148645, "sim_compute_performance-ego0": 0.00171746268416896}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.1396337990050067, "get_ui_image": 0.029710925143697987, "step_physics": 0.11218478783317234, "survival_time": 5.699999999999988, "driven_lanedir": 1.118484382839868, "get_state_dump": 0.0066309369128683335, "get_robot_state": 0.003131080710369608, "sim_render-ego0": 0.0032376061315121858, "get_duckie_state": 0.018426291838936185, "in-drivable-lane": 0.0, "deviation-heading": 0.851020540755943, "agent_compute-ego0": 0.04140493351480235, "complete-iteration": 0.2292199010434358, "set_robot_commands": 0.001804403636766517, "deviation-center-line": 0.3080818291801528, "driven_lanedir_consec": 1.118484382839868, "sim_compute_sim_state": 0.010972912415214206, "sim_compute_performance-ego0": 0.0016321949336839758}, "LFP-norm-small_loop-000-ego0": {"driven_any": 14.5898100863319, "get_ui_image": 0.023061026343695827, "step_physics": 0.0903105561084096, "survival_time": 59.99999999999873, "driven_lanedir": 11.088425839240465, "get_state_dump": 0.004569798286114009, "get_robot_state": 0.0032509169312539845, "sim_render-ego0": 0.0032852335238238357, "get_duckie_state": 0.003923911833941788, "in-drivable-lane": 11.099999999999756, "deviation-heading": 15.44160972654172, "agent_compute-ego0": 0.039850411069681006, "complete-iteration": 0.17738093424597748, "set_robot_commands": 0.001895728059652743, "deviation-center-line": 3.9835052701742866, "driven_lanedir_consec": 11.088425839240465, "sim_compute_sim_state": 0.005458611036518233, "sim_compute_performance-ego0": 0.0016901814669593985}}
set_robot_commands_max0.001990412220810399
set_robot_commands_mean0.00189522458720554
set_robot_commands_median0.001893041245622622
set_robot_commands_min0.001804403636766517
sim_compute_performance-ego0_max0.00171746268416896
sim_compute_performance-ego0_mean0.0016806771504246328
sim_compute_performance-ego0_median0.001686525491922798
sim_compute_performance-ego0_min0.0016321949336839758
sim_compute_sim_state_max0.010972912415214206
sim_compute_sim_state_mean0.007920028736128567
sim_compute_sim_state_median0.007624295746390914
sim_compute_sim_state_min0.005458611036518233
sim_render-ego0_max0.0033443371454874673
sim_render-ego0_mean0.0032915714663597946
sim_render-ego0_median0.0032921712942197627
sim_render-ego0_min0.0032376061315121858
simulation-passed1
step_physics_max0.15107287421370996
step_physics_mean0.11340846782400506
step_physics_median0.10612522048695032
step_physics_min0.0903105561084096
survival_time_max59.99999999999873
survival_time_mean19.824999999999683
survival_time_min3.2499999999999964
No reset possible
5510711290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:10
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5508711290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5503311293Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:04:11
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5502211307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5499111303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5494511309Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:56
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5491211333Riccardo Tresa 🇮🇹template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.012708826197518244
agent_compute-ego0_mean0.011338326972943158
agent_compute-ego0_median0.01110169104514177
agent_compute-ego0_min0.010441099603970846
complete-iteration_max0.22096293387205704
complete-iteration_mean0.19092860566173653
complete-iteration_median0.18984511752420336
complete-iteration_min0.1630612537264824
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max2.2338784259298574e-06
get_duckie_state_mean1.9896700764142695e-06
get_duckie_state_median1.9302505229595844e-06
get_duckie_state_min1.8643008338080513e-06
get_robot_state_max0.004086579965508502
get_robot_state_mean0.0038677128439050766
get_robot_state_median0.003850337280335138
get_robot_state_min0.003683596849441528
get_state_dump_max0.005265565022178318
get_state_dump_mean0.005061367161593393
get_state_dump_median0.005072228474288383
get_state_dump_min0.004835446675618489
get_ui_image_max0.03662912223650062
get_ui_image_mean0.0312322620168034
get_ui_image_median0.03083620628056479
get_ui_image_min0.026627513269583385
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02937109259110463, "step_physics": 0.10809971260119088, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.005173754088486297, "get_robot_state": 0.003959098948708064, "sim_render-ego0": 0.004195495496822309, "get_duckie_state": 1.95563593997231e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.011073031002962136, "complete-iteration": 0.1762445123889778, "set_robot_commands": 0.002307840540439268, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.00977316989174372, "sim_compute_performance-ego0": 0.0021992559674419935}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03662912223650062, "step_physics": 0.14531751300977624, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.005265565022178318, "get_robot_state": 0.004086579965508502, "sim_render-ego0": 0.004182110662045686, "get_duckie_state": 2.2338784259298574e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.011130351087321404, "complete-iteration": 0.22096293387205704, "set_robot_commands": 0.0022840784943622093, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.00983875212462052, "sim_compute_performance-ego0": 0.002139519090237825}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.03230131997002496, "step_physics": 0.13331009282006157, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004970702860090468, "get_robot_state": 0.003741575611962212, "sim_render-ego0": 0.003967851400375366, "get_duckie_state": 1.8643008338080513e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.012708826197518244, "complete-iteration": 0.20344572265942892, "set_robot_commands": 0.0021795564227634007, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.008103513055377536, "sim_compute_performance-ego0": 0.0020702514383527967}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.026627513269583385, "step_physics": 0.10407773156960803, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004835446675618489, "get_robot_state": 0.003683596849441528, "sim_render-ego0": 0.003967416783173879, "get_duckie_state": 1.9048651059468589e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.010441099603970846, "complete-iteration": 0.1630612537264824, "set_robot_commands": 0.0021601667006810508, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.00517292320728302, "sim_compute_performance-ego0": 0.002011917531490326}}
set_robot_commands_max0.002307840540439268
set_robot_commands_mean0.002232910539561482
set_robot_commands_median0.002231817458562805
set_robot_commands_min0.0021601667006810508
sim_compute_performance-ego0_max0.0021992559674419935
sim_compute_performance-ego0_mean0.0021052360068807355
sim_compute_performance-ego0_median0.002104885264295311
sim_compute_performance-ego0_min0.002011917531490326
sim_compute_sim_state_max0.00983875212462052
sim_compute_sim_state_mean0.008222089569756199
sim_compute_sim_state_median0.008938341473560627
sim_compute_sim_state_min0.00517292320728302
sim_render-ego0_max0.004195495496822309
sim_render-ego0_mean0.00407821858560431
sim_render-ego0_median0.004074981031210526
sim_render-ego0_min0.003967416783173879
simulation-passed1
step_physics_max0.14531751300977624
step_physics_mean0.12270126250015918
step_physics_median0.12070490271062624
step_physics_min0.10407773156960803
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5480511364Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:17:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7234586253962337
survival_time_median25.350000000000225
deviation-center-line_median0.2260090178346552
in-drivable-lane_median19.5499999999995


other stats
agent_compute-ego0_max0.012977376580238342
agent_compute-ego0_mean0.01255121933615919
agent_compute-ego0_median0.012509216934386185
agent_compute-ego0_min0.012209066895626052
complete-iteration_max0.20321911012110688
complete-iteration_mean0.18205993385117444
complete-iteration_median0.1860423831593354
complete-iteration_min0.15293585896492004
deviation-center-line_max1.6132012167194405
deviation-center-line_mean0.5516141138939058
deviation-center-line_min0.14123720318687244
deviation-heading_max4.799733576905841
deviation-heading_mean1.9344730575334128
deviation-heading_median1.0872128360488809
deviation-heading_min0.7637329811300474
driven_any_max9.342475485799794
driven_any_mean4.880890135139277
driven_any_median4.304459524311238
driven_any_min1.5721660061348357
driven_lanedir_consec_max5.835227250652712
driven_lanedir_consec_mean1.991339730833523
driven_lanedir_consec_min0.6832144218889129
driven_lanedir_max5.835227250652712
driven_lanedir_mean1.991339730833523
driven_lanedir_median0.7234586253962337
driven_lanedir_min0.6832144218889129
get_duckie_state_max1.6098985305199255e-06
get_duckie_state_mean1.4962267922892977e-06
get_duckie_state_median1.5160833880371018e-06
get_duckie_state_min1.3428418625630606e-06
get_robot_state_max0.0038887766691354606
get_robot_state_mean0.003676116678164942
get_robot_state_median0.00365480239014244
get_robot_state_min0.0035060852632394284
get_state_dump_max0.00498415816288728
get_state_dump_mean0.0047206242751838
get_state_dump_median0.004651704859777842
get_state_dump_min0.004594929218292236
get_ui_image_max0.03537729716621707
get_ui_image_mean0.030852323136926645
get_ui_image_median0.03109480047502871
get_ui_image_min0.02584239443143209
in-drivable-lane_max26.400000000000297
in-drivable-lane_mean17.96249999999983
in-drivable-lane_min6.350000000000032
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.342475485799794, "get_ui_image": 0.02832781998106122, "step_physics": 0.10294201784187997, "survival_time": 52.849999999999135, "driven_lanedir": 5.835227250652712, "get_state_dump": 0.004641927708299489, "get_robot_state": 0.003731390929627734, "sim_render-ego0": 0.003924645187724065, "get_duckie_state": 1.5654951503010917e-06, "in-drivable-lane": 22.349999999998836, "deviation-heading": 4.799733576905841, "agent_compute-ego0": 0.012618158399946072, "complete-iteration": 0.1704021207776998, "set_robot_commands": 0.002256292251197512, "deviation-center-line": 1.6132012167194405, "driven_lanedir_consec": 5.835227250652712, "sim_compute_sim_state": 0.00982000899900786, "sim_compute_performance-ego0": 0.0020495763573168805}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5721660061348357, "get_ui_image": 0.03537729716621707, "step_physics": 0.12954642312943668, "survival_time": 11.100000000000025, "driven_lanedir": 0.7336036065724838, "get_state_dump": 0.004661482011256196, "get_robot_state": 0.0035060852632394284, "sim_render-ego0": 0.0037315127026339816, "get_duckie_state": 1.3428418625630606e-06, "in-drivable-lane": 6.350000000000032, "deviation-heading": 1.3690339086944383, "agent_compute-ego0": 0.012209066895626052, "complete-iteration": 0.20321911012110688, "set_robot_commands": 0.0021534361646848945, "deviation-center-line": 0.2333555604344542, "driven_lanedir_consec": 0.7336036065724838, "sim_compute_sim_state": 0.010050289299455992, "sim_compute_performance-ego0": 0.0018993535918505203}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.269714785303539, "get_ui_image": 0.0338617809689962, "step_physics": 0.12610547588421747, "survival_time": 20.75000000000016, "driven_lanedir": 0.7133136442199837, "get_state_dump": 0.00498415816288728, "get_robot_state": 0.0038887766691354606, "sim_render-ego0": 0.004178712574335245, "get_duckie_state": 1.6098985305199255e-06, "in-drivable-lane": 16.750000000000167, "deviation-heading": 0.8053917634033231, "agent_compute-ego0": 0.012977376580238342, "complete-iteration": 0.201682645540971, "set_robot_commands": 0.002356543563879453, "deviation-center-line": 0.21866247523485616, "driven_lanedir_consec": 0.7133136442199837, "sim_compute_sim_state": 0.011076847521158366, "sim_compute_performance-ego0": 0.0021554512473253105}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.339204263318936, "get_ui_image": 0.02584239443143209, "step_physics": 0.0925105063120524, "survival_time": 29.95000000000029, "driven_lanedir": 0.6832144218889129, "get_state_dump": 0.004594929218292236, "get_robot_state": 0.003578213850657145, "sim_render-ego0": 0.0037941277027130128, "get_duckie_state": 1.466671625773112e-06, "in-drivable-lane": 26.400000000000297, "deviation-heading": 0.7637329811300474, "agent_compute-ego0": 0.012400275468826294, "complete-iteration": 0.15293585896492004, "set_robot_commands": 0.002134720087051392, "deviation-center-line": 0.14123720318687244, "driven_lanedir_consec": 0.6832144218889129, "sim_compute_sim_state": 0.006078072786331177, "sim_compute_performance-ego0": 0.0019173709551493327}}
set_robot_commands_max0.002356543563879453
set_robot_commands_mean0.0022252480167033128
set_robot_commands_median0.0022048642079412033
set_robot_commands_min0.002134720087051392
sim_compute_performance-ego0_max0.0021554512473253105
sim_compute_performance-ego0_mean0.0020054380379105107
sim_compute_performance-ego0_median0.0019834736562331064
sim_compute_performance-ego0_min0.0018993535918505203
sim_compute_sim_state_max0.011076847521158366
sim_compute_sim_state_mean0.00925630465148835
sim_compute_sim_state_median0.009935149149231926
sim_compute_sim_state_min0.006078072786331177
sim_render-ego0_max0.004178712574335245
sim_render-ego0_mean0.003907249541851576
sim_render-ego0_median0.0038593864452185385
sim_render-ego0_min0.0037315127026339816
simulation-passed1
step_physics_max0.12954642312943668
step_physics_mean0.11277610579189662
step_physics_median0.11452374686304873
step_physics_min0.0925105063120524
survival_time_max52.849999999999135
survival_time_mean28.662499999999905
survival_time_min11.100000000000025
No reset possible
5478911439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:22
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5470811386Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:13:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4406283742656965
survival_time_median9.850000000000003
deviation-center-line_median0.38203068668703266
in-drivable-lane_median4.424999999999992


other stats
agent_compute-ego0_max0.012483690856793603
agent_compute-ego0_mean0.011883858457045943
agent_compute-ego0_median0.011873053368446207
agent_compute-ego0_min0.011305636234497755
complete-iteration_max0.20897057304134617
complete-iteration_mean0.17767401039999908
complete-iteration_median0.17552784444413888
complete-iteration_min0.15066977967037243
deviation-center-line_max0.9815163190130324
deviation-center-line_mean0.47067687692872023
deviation-center-line_min0.13712981532778312
deviation-heading_max7.211336272983961
deviation-heading_mean2.753233687841933
deviation-heading_median1.5322091345533595
deviation-heading_min0.7371802092770506
driven_any_max10.091363793244549
driven_any_mean3.9038183960739943
driven_any_median2.1054969137278414
driven_any_min1.3129159635957477
driven_lanedir_consec_max2.48840419382995
driven_lanedir_consec_mean1.5117984194400758
driven_lanedir_consec_min0.6775327353989606
driven_lanedir_max2.66980023506808
driven_lanedir_mean1.5571474297496084
driven_lanedir_median1.4406283742656965
driven_lanedir_min0.6775327353989606
get_duckie_state_max1.4320596472009436e-06
get_duckie_state_mean1.3152939799922527e-06
get_duckie_state_median1.3148658067439587e-06
get_duckie_state_min1.1993846592801494e-06
get_robot_state_max0.0038733668141550832
get_robot_state_mean0.003622355166933403
get_robot_state_median0.0035594202122630784
get_robot_state_min0.0034972134290523725
get_state_dump_max0.004662792403976638
get_state_dump_mean0.004558527020402584
get_state_dump_median0.004556562781100445
get_state_dump_min0.00445819011543281
get_ui_image_max0.03449891759203626
get_ui_image_mean0.029129691898145987
get_ui_image_median0.02859198104044835
get_ui_image_min0.024835887919650988
in-drivable-lane_max38.59999999999934
in-drivable-lane_mean12.312499999999837
in-drivable-lane_min1.8000000000000256
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4317866514643556, "get_ui_image": 0.027202505584156843, "step_physics": 0.10266230521945778, "survival_time": 10.85000000000002, "driven_lanedir": 2.117949681122064, "get_state_dump": 0.00450969945400133, "get_robot_state": 0.003614345821765585, "sim_render-ego0": 0.0036147384468568577, "get_duckie_state": 1.2795859520588443e-06, "in-drivable-lane": 1.8000000000000256, "deviation-heading": 1.6071386207138345, "agent_compute-ego0": 0.012483690856793603, "complete-iteration": 0.16769037990395083, "set_robot_commands": 0.0021673003467944786, "deviation-center-line": 0.506547405809248, "driven_lanedir_consec": 2.117949681122064, "sim_compute_sim_state": 0.009398369614137422, "sim_compute_performance-ego0": 0.0019493540492626503}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3129159635957477, "get_ui_image": 0.03449891759203626, "step_physics": 0.13603576437219397, "survival_time": 7.649999999999981, "driven_lanedir": 0.763307067409329, "get_state_dump": 0.004662792403976638, "get_robot_state": 0.0038733668141550832, "sim_render-ego0": 0.003691270753934786, "get_duckie_state": 1.4320596472009436e-06, "in-drivable-lane": 3.099999999999989, "deviation-heading": 1.4572796483928845, "agent_compute-ego0": 0.012042359872297808, "complete-iteration": 0.20897057304134617, "set_robot_commands": 0.002186719473306234, "deviation-center-line": 0.25751396756481737, "driven_lanedir_consec": 0.763307067409329, "sim_compute_sim_state": 0.00975325664916596, "sim_compute_performance-ego0": 0.002136707305908203}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.091363793244549, "get_ui_image": 0.02998145649673985, "step_physics": 0.1133207234107752, "survival_time": 53.899999999999075, "driven_lanedir": 2.66980023506808, "get_state_dump": 0.00445819011543281, "get_robot_state": 0.0034972134290523725, "sim_render-ego0": 0.003599378994154201, "get_duckie_state": 1.1993846592801494e-06, "in-drivable-lane": 38.59999999999934, "deviation-heading": 7.211336272983961, "agent_compute-ego0": 0.011703746864594609, "complete-iteration": 0.18336530898432693, "set_robot_commands": 0.002067427595419614, "deviation-center-line": 0.9815163190130324, "driven_lanedir_consec": 2.48840419382995, "sim_compute_sim_state": 0.012751592100495203, "sim_compute_performance-ego0": 0.001898101571536484}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7792071759913275, "get_ui_image": 0.024835887919650988, "step_physics": 0.09335183829403997, "survival_time": 8.84999999999999, "driven_lanedir": 0.6775327353989606, "get_state_dump": 0.0046034261081995586, "get_robot_state": 0.0035044946027605723, "sim_render-ego0": 0.003688967629764857, "get_duckie_state": 1.350145661429073e-06, "in-drivable-lane": 5.749999999999994, "deviation-heading": 0.7371802092770506, "agent_compute-ego0": 0.011305636234497755, "complete-iteration": 0.15066977967037243, "set_robot_commands": 0.0021861336204443086, "deviation-center-line": 0.13712981532778312, "driven_lanedir_consec": 0.6775327353989606, "sim_compute_sim_state": 0.005184529872422808, "sim_compute_performance-ego0": 0.0019251885039083072}}
set_robot_commands_max0.002186719473306234
set_robot_commands_mean0.002151895258991159
set_robot_commands_median0.002176716983619394
set_robot_commands_min0.002067427595419614
sim_compute_performance-ego0_max0.002136707305908203
sim_compute_performance-ego0_mean0.0019773378576539115
sim_compute_performance-ego0_median0.0019372712765854789
sim_compute_performance-ego0_min0.001898101571536484
sim_compute_sim_state_max0.012751592100495203
sim_compute_sim_state_mean0.009271937059055348
sim_compute_sim_state_median0.00957581313165169
sim_compute_sim_state_min0.005184529872422808
sim_render-ego0_max0.003691270753934786
sim_render-ego0_mean0.003648588956177675
sim_render-ego0_median0.003651853038310857
sim_render-ego0_min0.003599378994154201
simulation-passed1
step_physics_max0.13603576437219397
step_physics_mean0.11134265782411672
step_physics_median0.1079915143151165
step_physics_min0.09335183829403997
survival_time_max53.899999999999075
survival_time_mean20.31249999999977
survival_time_min7.649999999999981
No reset possible
5463911404Marton Moro 🇭🇺template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.0121113293700748
agent_compute-ego0_mean0.010815971460297502
agent_compute-ego0_median0.010834425753397672
agent_compute-ego0_min0.009483704964319864
complete-iteration_max0.20712578296661377
complete-iteration_mean0.18111696264444632
complete-iteration_median0.18656806988117783
complete-iteration_min0.14420592784881592
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.5587746342526207e-06
get_duckie_state_mean1.4286267324040103e-06
get_duckie_state_median1.4085556573913867e-06
get_duckie_state_min1.3386209805806475e-06
get_robot_state_max0.0037960377004411486
get_robot_state_mean0.003700837604794919
get_robot_state_median0.0037526829956518663
get_robot_state_min0.003501946727434794
get_state_dump_max0.004830856866474393
get_state_dump_mean0.004607978479483729
get_state_dump_median0.004607772985518266
get_state_dump_min0.004385511080423991
get_ui_image_max0.037780002407405686
get_ui_image_mean0.03151290461312578
get_ui_image_median0.03174534347825245
get_ui_image_min0.02478092908859253
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.029175504853453816, "step_physics": 0.10275941408133205, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004830856866474393, "get_robot_state": 0.003715347640122039, "sim_render-ego0": 0.003947624677344214, "get_duckie_state": 1.5587746342526207e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.010949896860726272, "complete-iteration": 0.16951793205888965, "set_robot_commands": 0.002269231820408302, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.009744823733462565, "sim_compute_performance-ego0": 0.0020369321485108967}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.037780002407405686, "step_physics": 0.12954361542411472, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.004441872886989428, "get_robot_state": 0.0037900183511816936, "sim_render-ego0": 0.0039265129877173385, "get_duckie_state": 1.3501747794773269e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.01071895464606907, "complete-iteration": 0.203618207703466, "set_robot_commands": 0.00237978282182113, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.008994138759115467, "sim_compute_performance-ego0": 0.001959860324859619}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.03431518210305108, "step_physics": 0.13585272431373596, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004773673084047105, "get_robot_state": 0.0037960377004411486, "sim_render-ego0": 0.003970748848385281, "get_duckie_state": 1.466936535305447e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.0121113293700748, "complete-iteration": 0.20712578296661377, "set_robot_commands": 0.002238247129652235, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007962759998109605, "sim_compute_performance-ego0": 0.002018117242389255}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.02478092908859253, "step_physics": 0.08994180212418239, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004385511080423991, "get_robot_state": 0.003501946727434794, "sim_render-ego0": 0.003535124162832896, "get_duckie_state": 1.3386209805806475e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.009483704964319864, "complete-iteration": 0.14420592784881592, "set_robot_commands": 0.0020382379492123923, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.004647456109523773, "sim_compute_performance-ego0": 0.0018094306190808611}}
set_robot_commands_max0.00237978282182113
set_robot_commands_mean0.002231374930273515
set_robot_commands_median0.002253739475030269
set_robot_commands_min0.0020382379492123923
sim_compute_performance-ego0_max0.0020369321485108967
sim_compute_performance-ego0_mean0.0019560850837101584
sim_compute_performance-ego0_median0.001988988783624437
sim_compute_performance-ego0_min0.0018094306190808611
sim_compute_sim_state_max0.009744823733462565
sim_compute_sim_state_mean0.007837294650052853
sim_compute_sim_state_median0.008478449378612536
sim_compute_sim_state_min0.004647456109523773
sim_render-ego0_max0.003970748848385281
sim_render-ego0_mean0.003845002669069932
sim_render-ego0_median0.003937068832530776
sim_render-ego0_min0.003535124162832896
simulation-passed1
step_physics_max0.13585272431373596
step_physics_mean0.11452438898584127
step_physics_median0.11615151475272338
step_physics_min0.08994180212418239
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5462211424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:01
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5450211485Raphael Jeanreal-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:37:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.140142126770781
survival_time_median59.99999999999873
deviation-center-line_median3.894042142494184
in-drivable-lane_median3.899999999999902


other stats
agent_compute-ego0_max0.012652621678170514
agent_compute-ego0_mean0.0124908994933573
agent_compute-ego0_median0.012471914303297752
agent_compute-ego0_min0.012367147688663175
complete-iteration_max0.3072422996605977
complete-iteration_mean0.25064042760615185
complete-iteration_median0.2491388627631182
complete-iteration_min0.19704168523777335
deviation-center-line_max4.823563709255509
deviation-center-line_mean3.8740629724087974
deviation-center-line_min2.8846038953913107
deviation-heading_max23.623667018513903
deviation-heading_mean20.881984091519048
deviation-heading_median20.838847091667965
deviation-heading_min18.22657516422635
driven_any_max11.966252880527197
driven_any_mean10.652787158302552
driven_any_median11.684935865845109
driven_any_min7.275024020992793
driven_lanedir_consec_max9.620531095048392
driven_lanedir_consec_mean7.514153291664028
driven_lanedir_consec_min6.155797818066159
driven_lanedir_max10.03209579894228
driven_lanedir_mean8.818426956863881
driven_lanedir_median9.54290710522354
driven_lanedir_min6.155797818066159
get_duckie_state_max1.3706117573350962e-06
get_duckie_state_mean1.3179655780731383e-06
get_duckie_state_median1.3228161547404345e-06
get_duckie_state_min1.2556182454765885e-06
get_robot_state_max0.0038808303894382894
get_robot_state_mean0.0037757543547423866
get_robot_state_median0.0037729399686649776
get_robot_state_min0.0036763070922013023
get_state_dump_max0.005253639546758825
get_state_dump_mean0.004813895322689991
get_state_dump_median0.004722366892608753
get_state_dump_min0.004557207958783635
get_ui_image_max0.038060553003065656
get_ui_image_mean0.03158086201696309
get_ui_image_median0.030888824736843696
get_ui_image_min0.026485245591099316
in-drivable-lane_max5.699999999999909
in-drivable-lane_mean3.5624999999999307
in-drivable-lane_min0.7500000000000107
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.442121395708066, "get_ui_image": 0.02877612733324799, "step_physics": 0.16849450167767907, "survival_time": 59.99999999999873, "driven_lanedir": 9.620531095048392, "get_state_dump": 0.004623080371917039, "get_robot_state": 0.003728058018553366, "sim_render-ego0": 0.0037694568935778615, "get_duckie_state": 1.3284738812220286e-06, "in-drivable-lane": 2.8999999999999417, "deviation-heading": 23.623667018513903, "agent_compute-ego0": 0.012367147688663175, "complete-iteration": 0.2354526289495997, "set_robot_commands": 0.0022491312940154445, "deviation-center-line": 3.86633263040639, "driven_lanedir_consec": 9.620531095048392, "sim_compute_sim_state": 0.009306246394618762, "sim_compute_performance-ego0": 0.002051770736732451}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.275024020992793, "get_ui_image": 0.038060553003065656, "step_physics": 0.227101465853134, "survival_time": 40.349999999999845, "driven_lanedir": 6.155797818066159, "get_state_dump": 0.004821653413300467, "get_robot_state": 0.0038808303894382894, "sim_render-ego0": 0.003927294865693196, "get_duckie_state": 1.3706117573350962e-06, "in-drivable-lane": 0.7500000000000107, "deviation-heading": 18.22657516422635, "agent_compute-ego0": 0.012517655544941967, "complete-iteration": 0.3072422996605977, "set_robot_commands": 0.002317489078729459, "deviation-center-line": 2.8846038953913107, "driven_lanedir_consec": 6.155797818066159, "sim_compute_sim_state": 0.01237671416584808, "sim_compute_performance-ego0": 0.00214942463553778}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.966252880527197, "get_ui_image": 0.0330015221404394, "step_physics": 0.19020976432654185, "survival_time": 59.99999999999873, "driven_lanedir": 9.465283115398693, "get_state_dump": 0.004557207958783635, "get_robot_state": 0.0036763070922013023, "sim_render-ego0": 0.003745247978254917, "get_duckie_state": 1.2556182454765885e-06, "in-drivable-lane": 5.699999999999909, "deviation-heading": 22.647044738509948, "agent_compute-ego0": 0.012426173061653535, "complete-iteration": 0.26282509657663666, "set_robot_commands": 0.0022104618253557013, "deviation-center-line": 3.921751654581978, "driven_lanedir_consec": 7.078545240549768, "sim_compute_sim_state": 0.01092416023235337, "sim_compute_performance-ego0": 0.0019898152569747785}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.927750335982152, "get_ui_image": 0.026485245591099316, "step_physics": 0.13399662165518705, "survival_time": 59.99999999999873, "driven_lanedir": 10.03209579894228, "get_state_dump": 0.005253639546758825, "get_robot_state": 0.003817821918776589, "sim_render-ego0": 0.003866217118516552, "get_duckie_state": 1.3171584282588404e-06, "in-drivable-lane": 4.899999999999863, "deviation-heading": 19.030649444825983, "agent_compute-ego0": 0.012652621678170514, "complete-iteration": 0.19704168523777335, "set_robot_commands": 0.0022886700673861666, "deviation-center-line": 4.823563709255509, "driven_lanedir_consec": 7.201739012991794, "sim_compute_sim_state": 0.00647852561753755, "sim_compute_performance-ego0": 0.002117149438786566}}
set_robot_commands_max0.002317489078729459
set_robot_commands_mean0.002266438066371693
set_robot_commands_median0.0022689006807008055
set_robot_commands_min0.0022104618253557013
sim_compute_performance-ego0_max0.00214942463553778
sim_compute_performance-ego0_mean0.002077040017007894
sim_compute_performance-ego0_median0.0020844600877595086
sim_compute_performance-ego0_min0.0019898152569747785
sim_compute_sim_state_max0.01237671416584808
sim_compute_sim_state_mean0.00977141160258944
sim_compute_sim_state_median0.010115203313486068
sim_compute_sim_state_min0.00647852561753755
sim_render-ego0_max0.003927294865693196
sim_render-ego0_mean0.003827054214010632
sim_render-ego0_median0.0038178370060472063
sim_render-ego0_min0.003745247978254917
simulation-passed1
step_physics_max0.227101465853134
step_physics_mean0.1799505883781355
step_physics_median0.17935213300211045
step_physics_min0.13399662165518705
survival_time_max59.99999999999873
survival_time_mean55.08749999999901
survival_time_min40.349999999999845
No reset possible
5444711539Jean-Sébastien Grondin 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:24:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.194043747591065
survival_time_median40.174999999999514
deviation-center-line_median2.346054219480844
in-drivable-lane_median6.650000000000023


other stats
agent_compute-ego0_max0.0123625039525677
agent_compute-ego0_mean0.012200930926708028
agent_compute-ego0_median0.012282592467637908
agent_compute-ego0_min0.011876034818988596
complete-iteration_max0.27940473376779495
complete-iteration_mean0.23600200603962992
complete-iteration_median0.2316656974424576
complete-iteration_min0.2012718955058096
deviation-center-line_max3.803809024709457
deviation-center-line_mean2.1393327968519364
deviation-center-line_min0.06141372373660074
deviation-heading_max15.72559399494886
deviation-heading_mean9.796250766058256
deviation-heading_median11.424419408069316
deviation-heading_min0.6105702531455391
driven_any_max14.57830334051024
driven_any_mean8.8554319892881
driven_any_median9.5706675557595
driven_any_min1.7020895051231646
driven_lanedir_consec_max12.442889039293812
driven_lanedir_consec_mean6.2359252966465775
driven_lanedir_consec_min0.11272465211036976
driven_lanedir_max12.442889039293812
driven_lanedir_mean6.343288344111992
driven_lanedir_median6.408769842521892
driven_lanedir_min0.11272465211036976
get_duckie_state_max1.3357363872646543e-06
get_duckie_state_mean1.305651338023352e-06
get_duckie_state_median1.3041113899942418e-06
get_duckie_state_min1.2786461848402698e-06
get_robot_state_max0.003809405802489319
get_robot_state_mean0.003760937731610763
get_robot_state_median0.0037581633990213274
get_robot_state_min0.003718018325911079
get_state_dump_max0.004723006894129403
get_state_dump_mean0.0047046831125984925
get_state_dump_median0.004706693113647227
get_state_dump_min0.0046823393289701105
get_ui_image_max0.03628137317835095
get_ui_image_mean0.031416666741800846
get_ui_image_median0.03126397500733646
get_ui_image_min0.02685734377417951
in-drivable-lane_max14.649999999999324
in-drivable-lane_mean8.324999999999827
in-drivable-lane_min5.349999999999941
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.7020895051231646, "get_ui_image": 0.02903262428615404, "step_physics": 0.15051574292390243, "survival_time": 7.99999999999998, "driven_lanedir": 0.11272465211036976, "get_state_dump": 0.004723006894129403, "get_robot_state": 0.0037221419885291817, "sim_render-ego0": 0.003793307713099888, "get_duckie_state": 1.3357363872646543e-06, "in-drivable-lane": 6.94999999999998, "deviation-heading": 0.6105702531455391, "agent_compute-ego0": 0.012258787332854655, "complete-iteration": 0.21595576387014448, "set_robot_commands": 0.0025116997475949873, "deviation-center-line": 0.06141372373660074, "driven_lanedir_consec": 0.11272465211036976, "sim_compute_sim_state": 0.007352941524908409, "sim_compute_performance-ego0": 0.0019618635592253313}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.248102017032417, "get_ui_image": 0.03628137317835095, "step_physics": 0.19954312719949863, "survival_time": 22.500000000000185, "driven_lanedir": 3.3544633035874383, "get_state_dump": 0.004697349806318262, "get_robot_state": 0.0037941848095134727, "sim_render-ego0": 0.003864168856466425, "get_duckie_state": 1.3105092186092538e-06, "in-drivable-lane": 6.350000000000065, "deviation-heading": 7.133696124374305, "agent_compute-ego0": 0.0123625039525677, "complete-iteration": 0.27940473376779495, "set_robot_commands": 0.0022481180347518753, "deviation-center-line": 1.2575655192030837, "driven_lanedir_consec": 2.9250111137257853, "sim_compute_sim_state": 0.014469492990531838, "sim_compute_performance-ego0": 0.0020584822229694102}, "LF-norm-techtrack-000-ego0": {"driven_any": 14.57830334051024, "get_ui_image": 0.03349532572851888, "step_physics": 0.17208948123464973, "survival_time": 59.99999999999873, "driven_lanedir": 12.442889039293812, "get_state_dump": 0.004716036420976192, "get_robot_state": 0.003809405802489319, "sim_render-ego0": 0.003842570998090987, "get_duckie_state": 1.2786461848402698e-06, "in-drivable-lane": 5.349999999999941, "deviation-heading": 15.715142691764324, "agent_compute-ego0": 0.01230639760242116, "complete-iteration": 0.24737563101477072, "set_robot_commands": 0.002317608643531005, "deviation-center-line": 3.803809024709457, "driven_lanedir_consec": 12.442889039293812, "sim_compute_sim_state": 0.012642281537846066, "sim_compute_performance-ego0": 0.002071250586783658}, "LF-norm-small_loop-000-ego0": {"driven_any": 13.89323309448658, "get_ui_image": 0.02685734377417951, "step_physics": 0.14005563069707577, "survival_time": 57.84999999999885, "driven_lanedir": 9.463076381456345, "get_state_dump": 0.0046823393289701105, "get_robot_state": 0.003718018325911079, "sim_render-ego0": 0.003753751053093629, "get_duckie_state": 1.29771356137923e-06, "in-drivable-lane": 14.649999999999324, "deviation-heading": 15.72559399494886, "agent_compute-ego0": 0.011876034818988596, "complete-iteration": 0.2012718955058096, "set_robot_commands": 0.002237570718162418, "deviation-center-line": 3.4345429197586044, "driven_lanedir_consec": 9.463076381456345, "sim_compute_sim_state": 0.0060334864469801614, "sim_compute_performance-ego0": 0.0019750747450069236}}
set_robot_commands_max0.0025116997475949873
set_robot_commands_mean0.0023287492860100713
set_robot_commands_median0.00228286333914144
set_robot_commands_min0.002237570718162418
sim_compute_performance-ego0_max0.002071250586783658
sim_compute_performance-ego0_mean0.0020166677784963305
sim_compute_performance-ego0_median0.0020167784839881667
sim_compute_performance-ego0_min0.0019618635592253313
sim_compute_sim_state_max0.014469492990531838
sim_compute_sim_state_mean0.010124550625066618
sim_compute_sim_state_median0.009997611531377236
sim_compute_sim_state_min0.0060334864469801614
sim_render-ego0_max0.003864168856466425
sim_render-ego0_mean0.003813449655187732
sim_render-ego0_median0.003817939355595438
sim_render-ego0_min0.003753751053093629
simulation-passed1
step_physics_max0.19954312719949863
step_physics_mean0.16555099551378166
step_physics_median0.1613026120792761
step_physics_min0.14005563069707577
survival_time_max59.99999999999873
survival_time_mean37.08749999999944
survival_time_min7.99999999999998
No reset possible
5441011553Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:16:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1883828079989485
survival_time_median16.750000000000103
deviation-center-line_median0.8161167304680685
in-drivable-lane_median6.050000000000059


other stats
agent_compute-ego0_max0.013497617768078316
agent_compute-ego0_mean0.013000099827568085
agent_compute-ego0_median0.012843088003240308
agent_compute-ego0_min0.012816605535713402
complete-iteration_max0.24411310940175443
complete-iteration_mean0.21326412574617745
complete-iteration_median0.2128291631802785
complete-iteration_min0.1832850672223983
deviation-center-line_max3.92270485238161
deviation-center-line_mean1.428437639033015
deviation-center-line_min0.15881224281431214
deviation-heading_max8.51473834362652
deviation-heading_mean3.9619830062716472
deviation-heading_median3.2228241525649155
deviation-heading_min0.8875453763302363
driven_any_max14.204211762482498
driven_any_mean6.5578652506053725
driven_any_median4.416862714590639
driven_any_min3.193523810757714
driven_lanedir_consec_max11.068906357274823
driven_lanedir_consec_mean4.799453107342659
driven_lanedir_consec_min1.752140456097916
driven_lanedir_max11.068906357274823
driven_lanedir_mean4.799453107342659
driven_lanedir_median3.1883828079989485
driven_lanedir_min1.752140456097916
get_duckie_state_max1.6666040187928737e-06
get_duckie_state_mean1.6114758203072831e-06
get_duckie_state_median1.625260335382377e-06
get_duckie_state_min1.5287785916715055e-06
get_robot_state_max0.004073012747415682
get_robot_state_mean0.003942418483196322
get_robot_state_median0.003904593349051517
get_robot_state_min0.003887474487266572
get_state_dump_max0.00535743294692621
get_state_dump_mean0.005102912424747053
get_state_dump_median0.005069338492170842
get_state_dump_min0.0049155397677203205
get_ui_image_max0.036798492476746845
get_ui_image_mean0.03211025496297287
get_ui_image_median0.03225820453505969
get_ui_image_min0.027126118305025253
in-drivable-lane_max12.099999999999824
in-drivable-lane_mean7.049999999999997
in-drivable-lane_min4.000000000000048
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.877554980730296, "get_ui_image": 0.029853921621403795, "step_physics": 0.1344177044452505, "survival_time": 18.75000000000013, "driven_lanedir": 3.540373615855516, "get_state_dump": 0.005157577230575237, "get_robot_state": 0.003902937503571206, "sim_render-ego0": 0.004078965871892077, "get_duckie_state": 1.642932283117416e-06, "in-drivable-lane": 7.700000000000096, "deviation-heading": 3.297854543568217, "agent_compute-ego0": 0.012858395880841197, "complete-iteration": 0.20587370370296723, "set_robot_commands": 0.0023672796310262477, "deviation-center-line": 1.0107164328678442, "driven_lanedir_consec": 3.540373615855516, "sim_compute_sim_state": 0.011011367782633357, "sim_compute_performance-ego0": 0.002123171344716498}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.956170448450983, "get_ui_image": 0.036798492476746845, "step_physics": 0.1653590822542036, "survival_time": 14.750000000000076, "driven_lanedir": 2.8363920001423812, "get_state_dump": 0.004981099753766446, "get_robot_state": 0.0039062491945318274, "sim_render-ego0": 0.0040453978486963225, "get_duckie_state": 1.5287785916715055e-06, "in-drivable-lane": 4.000000000000048, "deviation-heading": 3.1477937615616143, "agent_compute-ego0": 0.012816605535713402, "complete-iteration": 0.24411310940175443, "set_robot_commands": 0.0023132055192380337, "deviation-center-line": 0.6215170280682928, "driven_lanedir_consec": 2.8363920001423812, "sim_compute_sim_state": 0.011615082218840316, "sim_compute_performance-ego0": 0.0021778345108032227}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.193523810757714, "get_ui_image": 0.034662487448715584, "step_physics": 0.1421829409715606, "survival_time": 10.20000000000001, "driven_lanedir": 1.752140456097916, "get_state_dump": 0.00535743294692621, "get_robot_state": 0.004073012747415682, "sim_render-ego0": 0.004156752330500905, "get_duckie_state": 1.6666040187928737e-06, "in-drivable-lane": 4.400000000000023, "deviation-heading": 0.8875453763302363, "agent_compute-ego0": 0.013497617768078316, "complete-iteration": 0.2197846226575898, "set_robot_commands": 0.002347719378587676, "deviation-center-line": 0.15881224281431214, "driven_lanedir_consec": 1.752140456097916, "sim_compute_sim_state": 0.011211301059257694, "sim_compute_performance-ego0": 0.0021914447226175447}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.204211762482498, "get_ui_image": 0.027126118305025253, "step_physics": 0.11965261986610992, "survival_time": 59.99999999999873, "driven_lanedir": 11.068906357274823, "get_state_dump": 0.0049155397677203205, "get_robot_state": 0.003887474487266572, "sim_render-ego0": 0.003893963006215727, "get_duckie_state": 1.607588387647338e-06, "in-drivable-lane": 12.099999999999824, "deviation-heading": 8.51473834362652, "agent_compute-ego0": 0.01282778012563942, "complete-iteration": 0.1832850672223983, "set_robot_commands": 0.002325168954244164, "deviation-center-line": 3.92270485238161, "driven_lanedir_consec": 11.068906357274823, "sim_compute_sim_state": 0.0064722256894711155, "sim_compute_performance-ego0": 0.0020874967980047347}}
set_robot_commands_max0.0023672796310262477
set_robot_commands_mean0.00233834337077403
set_robot_commands_median0.00233644416641592
set_robot_commands_min0.0023132055192380337
sim_compute_performance-ego0_max0.0021914447226175447
sim_compute_performance-ego0_mean0.0021449868440355
sim_compute_performance-ego0_median0.002150502927759861
sim_compute_performance-ego0_min0.0020874967980047347
sim_compute_sim_state_max0.011615082218840316
sim_compute_sim_state_mean0.01007749418755062
sim_compute_sim_state_median0.011111334420945524
sim_compute_sim_state_min0.0064722256894711155
sim_render-ego0_max0.004156752330500905
sim_render-ego0_mean0.004043769764326258
sim_render-ego0_median0.0040621818602942
sim_render-ego0_min0.003893963006215727
simulation-passed1
step_physics_max0.1653590822542036
step_physics_mean0.14040308688428113
step_physics_median0.13830032270840553
step_physics_min0.11965261986610992
survival_time_max59.99999999999873
survival_time_mean25.924999999999734
survival_time_min10.20000000000001
No reset possible
5429611594Francois Hebertreal-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-070:26:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5419611635Philippe Reddy 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:34:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.693079816507028
survival_time_median59.99999999999873
deviation-center-line_median3.301758708220798
in-drivable-lane_median15.624999999999416


other stats
agent_compute-ego0_max0.012987027458108334
agent_compute-ego0_mean0.01228096464018794
agent_compute-ego0_median0.01215933970712317
agent_compute-ego0_min0.01181815168839708
complete-iteration_max0.24714362273903115
complete-iteration_mean0.22186038709548145
complete-iteration_median0.22089897504357076
complete-iteration_min0.198499975555753
deviation-center-line_max4.73903292268114
deviation-center-line_mean3.3541633711112455
deviation-center-line_min2.074103145322245
deviation-heading_max18.475215564025813
deviation-heading_mean13.95176763669891
deviation-heading_median13.988043798510056
deviation-heading_min9.35576738574972
driven_any_max7.920635026485052
driven_any_mean7.119014955745232
driven_any_median7.917175606197507
driven_any_min4.721073584100863
driven_lanedir_consec_max5.920111037506828
driven_lanedir_consec_mean3.433946286773562
driven_lanedir_consec_min2.4295144765733627
driven_lanedir_max5.920111037506828
driven_lanedir_mean4.411696612754104
driven_lanedir_median4.420935716357928
driven_lanedir_min2.884803980793735
get_duckie_state_max1.970278432625319e-06
get_duckie_state_mean1.8155977532944793e-06
get_duckie_state_median1.776625373579878e-06
get_duckie_state_min1.738861833392842e-06
get_robot_state_max0.004025520829733563
get_robot_state_mean0.0037957816557433
get_robot_state_median0.003758145113173969
get_robot_state_min0.0036413155668917
get_state_dump_max0.004830844396357731
get_state_dump_mean0.004740685884438674
get_state_dump_median0.0047600158148264505
get_state_dump_min0.004611867511744063
get_ui_image_max0.03564487150765577
get_ui_image_mean0.03084653257287618
get_ui_image_median0.030702767595585885
get_ui_image_min0.026335723592677183
in-drivable-lane_max32.649999999999146
in-drivable-lane_mean16.387499999999477
in-drivable-lane_min1.6499999999999275
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.721073584100863, "get_ui_image": 0.02727104697025814, "step_physics": 0.13378903322623176, "survival_time": 36.60000000000006, "driven_lanedir": 4.319872504717358, "get_state_dump": 0.004611867511744063, "get_robot_state": 0.0036413155668917, "sim_render-ego0": 0.0036974584259407903, "get_duckie_state": 1.738861833392842e-06, "in-drivable-lane": 1.6499999999999275, "deviation-heading": 9.35576738574972, "agent_compute-ego0": 0.01232714640004573, "complete-iteration": 0.198499975555753, "set_robot_commands": 0.0022166773859833306, "deviation-center-line": 2.074103145322245, "driven_lanedir_consec": 2.4295144765733627, "sim_compute_sim_state": 0.008851873272925737, "sim_compute_performance-ego0": 0.0020091800377443738}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.920635026485052, "get_ui_image": 0.03564487150765577, "step_physics": 0.1713406783555767, "survival_time": 59.99999999999873, "driven_lanedir": 4.5219989279984985, "get_state_dump": 0.004811953743927485, "get_robot_state": 0.003718825998552435, "sim_render-ego0": 0.00378270212756307, "get_duckie_state": 1.7594536774164434e-06, "in-drivable-lane": 21.799999999999173, "deviation-heading": 13.487128832174395, "agent_compute-ego0": 0.01199153301420061, "complete-iteration": 0.24714362273903115, "set_robot_commands": 0.0022332932331679167, "deviation-center-line": 3.8449576609159335, "driven_lanedir_consec": 2.501355652220322, "sim_compute_sim_state": 0.011498366466271292, "sim_compute_performance-ego0": 0.002033769240685049}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914118167016699, "get_ui_image": 0.034134488220913625, "step_physics": 0.15966216213597942, "survival_time": 59.99999999999873, "driven_lanedir": 5.920111037506828, "get_state_dump": 0.004830844396357731, "get_robot_state": 0.004025520829733563, "sim_render-ego0": 0.003982972344391352, "get_duckie_state": 1.970278432625319e-06, "in-drivable-lane": 9.449999999999662, "deviation-heading": 18.475215564025813, "agent_compute-ego0": 0.012987027458108334, "complete-iteration": 0.2382585732367116, "set_robot_commands": 0.00243001139034935, "deviation-center-line": 4.73903292268114, "driven_lanedir_consec": 5.920111037506828, "sim_compute_sim_state": 0.013895726422286848, "sim_compute_performance-ego0": 0.002218079507400551}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920233045378314, "get_ui_image": 0.026335723592677183, "step_physics": 0.14236276116001914, "survival_time": 59.99999999999873, "driven_lanedir": 2.884803980793735, "get_state_dump": 0.004708077885725417, "get_robot_state": 0.0037974642277955016, "sim_render-ego0": 0.003787842122442418, "get_duckie_state": 1.7937970697433129e-06, "in-drivable-lane": 32.649999999999146, "deviation-heading": 14.488958764845716, "agent_compute-ego0": 0.01181815168839708, "complete-iteration": 0.20353937685042992, "set_robot_commands": 0.002317333499358953, "deviation-center-line": 2.7585597555256625, "driven_lanedir_consec": 2.884803980793735, "sim_compute_sim_state": 0.006274181043575646, "sim_compute_performance-ego0": 0.002051478520122595}}
set_robot_commands_max0.00243001139034935
set_robot_commands_mean0.002299328877214888
set_robot_commands_median0.0022753133662634347
set_robot_commands_min0.0022166773859833306
sim_compute_performance-ego0_max0.002218079507400551
sim_compute_performance-ego0_mean0.0020781268264881423
sim_compute_performance-ego0_median0.0020426238804038222
sim_compute_performance-ego0_min0.0020091800377443738
sim_compute_sim_state_max0.013895726422286848
sim_compute_sim_state_mean0.01013003680126488
sim_compute_sim_state_median0.010175119869598516
sim_compute_sim_state_min0.006274181043575646
sim_render-ego0_max0.003982972344391352
sim_render-ego0_mean0.003812743755084408
sim_render-ego0_median0.003785272125002744
sim_render-ego0_min0.0036974584259407903
simulation-passed1
step_physics_max0.1713406783555767
step_physics_mean0.15178865871945177
step_physics_median0.15101246164799928
step_physics_min0.13378903322623176
survival_time_max59.99999999999873
survival_time_mean54.14999999999906
survival_time_min36.60000000000006
No reset possible
5415511650Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:15:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3430905511262203
survival_time_median24.625000000000213
deviation-center-line_median0.31498177638974434
in-drivable-lane_median17.82500000000014


other stats
agent_compute-ego0_max0.01294750958245582
agent_compute-ego0_mean0.012285550924796315
agent_compute-ego0_median0.012238060292012106
agent_compute-ego0_min0.011718573532705232
complete-iteration_max0.23453817287914935
complete-iteration_mean0.2053965488341188
complete-iteration_median0.2090241550795452
complete-iteration_min0.16899971229823554
deviation-center-line_max1.2596075213391
deviation-center-line_mean0.5123815964545914
deviation-center-line_min0.15995531169977692
deviation-heading_max4.831234711383679
deviation-heading_mean2.148818304576741
deviation-heading_median1.4677208118847171
deviation-heading_min0.8285968831538498
driven_any_max6.5532312633878735
driven_any_mean4.563854203330273
driven_any_median4.321048094646116
driven_any_min3.060089360640982
driven_lanedir_consec_max3.76261354445397
driven_lanedir_consec_mean1.789587368492664
driven_lanedir_consec_min0.7095548272642449
driven_lanedir_max3.76261354445397
driven_lanedir_mean1.789587368492664
driven_lanedir_median1.3430905511262203
driven_lanedir_min0.7095548272642449
get_duckie_state_max1.5594267397185706e-06
get_duckie_state_mean1.4749090682670169e-06
get_duckie_state_median1.4848860157135644e-06
get_duckie_state_min1.370437501922367e-06
get_robot_state_max0.004149266722804569
get_robot_state_mean0.0038652834796573687
get_robot_state_median0.0038067917056475815
get_robot_state_min0.003698283784529742
get_state_dump_max0.005189738841046869
get_state_dump_mean0.004930432501071772
get_state_dump_median0.004903662080533595
get_state_dump_min0.004724667002173031
get_ui_image_max0.03654909800080692
get_ui_image_mean0.031808352297498114
get_ui_image_median0.032110577993572975
get_ui_image_min0.026463155202039585
in-drivable-lane_max21.75000000000023
in-drivable-lane_mean16.362500000000157
in-drivable-lane_min8.050000000000114
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.060089360640982, "get_ui_image": 0.02921324266047636, "step_physics": 0.12439059995092294, "survival_time": 16.5000000000001, "driven_lanedir": 1.9472129106758165, "get_state_dump": 0.005075593009095897, "get_robot_state": 0.003888578933531424, "sim_render-ego0": 0.004073828728897694, "get_duckie_state": 1.4989397677049897e-06, "in-drivable-lane": 8.050000000000114, "deviation-heading": 1.860398123374163, "agent_compute-ego0": 0.012252523099547786, "complete-iteration": 0.1942735467432489, "set_robot_commands": 0.0023844717492509824, "deviation-center-line": 0.46917249941422545, "driven_lanedir_consec": 1.9472129106758165, "sim_compute_sim_state": 0.010629076251810771, "sim_compute_performance-ego0": 0.0022616674532703043}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.5532312633878735, "get_ui_image": 0.03654909800080692, "step_physics": 0.14728555539075067, "survival_time": 33.95000000000021, "driven_lanedir": 3.76261354445397, "get_state_dump": 0.004724667002173031, "get_robot_state": 0.003698283784529742, "sim_render-ego0": 0.0037393506835488714, "get_duckie_state": 1.4708322637221392e-06, "in-drivable-lane": 15.000000000000076, "deviation-heading": 4.831234711383679, "agent_compute-ego0": 0.012223597484476423, "complete-iteration": 0.2237747634158415, "set_robot_commands": 0.0022147234748391546, "deviation-center-line": 1.2596075213391, "driven_lanedir_consec": 3.76261354445397, "sim_compute_sim_state": 0.011247007285847384, "sim_compute_performance-ego0": 0.0019998992190641517}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.786241291244553, "get_ui_image": 0.03500791332666959, "step_physics": 0.1566680338785892, "survival_time": 23.900000000000205, "driven_lanedir": 0.7095548272642449, "get_state_dump": 0.005189738841046869, "get_robot_state": 0.004149266722804569, "sim_render-ego0": 0.004163234368246632, "get_duckie_state": 1.5594267397185706e-06, "in-drivable-lane": 20.650000000000208, "deviation-heading": 0.8285968831538498, "agent_compute-ego0": 0.01294750958245582, "complete-iteration": 0.23453817287914935, "set_robot_commands": 0.002451898160707478, "deviation-center-line": 0.1607910533652632, "driven_lanedir_consec": 0.7095548272642449, "sim_compute_sim_state": 0.0115306820401568, "sim_compute_performance-ego0": 0.0023240580190447527}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.85585489804768, "get_ui_image": 0.026463155202039585, "step_physics": 0.1083764485486849, "survival_time": 25.350000000000225, "driven_lanedir": 0.7389681915766244, "get_state_dump": 0.004731731151971292, "get_robot_state": 0.0037250044777637392, "sim_render-ego0": 0.00370337878625224, "get_duckie_state": 1.370437501922367e-06, "in-drivable-lane": 21.75000000000023, "deviation-heading": 1.075043500395271, "agent_compute-ego0": 0.011718573532705232, "complete-iteration": 0.16899971229823554, "set_robot_commands": 0.002175159341707004, "deviation-center-line": 0.15995531169977692, "driven_lanedir_consec": 0.7389681915766244, "sim_compute_sim_state": 0.006067514419555664, "sim_compute_performance-ego0": 0.00194088727470458}}
set_robot_commands_max0.002451898160707478
set_robot_commands_mean0.002306563181626155
set_robot_commands_median0.0022995976120450687
set_robot_commands_min0.002175159341707004
sim_compute_performance-ego0_max0.0023240580190447527
sim_compute_performance-ego0_mean0.0021316279915209475
sim_compute_performance-ego0_median0.002130783336167228
sim_compute_performance-ego0_min0.00194088727470458
sim_compute_sim_state_max0.0115306820401568
sim_compute_sim_state_mean0.009868569999342654
sim_compute_sim_state_median0.010938041768829078
sim_compute_sim_state_min0.006067514419555664
sim_render-ego0_max0.004163234368246632
sim_render-ego0_mean0.003919948141736359
sim_render-ego0_median0.003906589706223282
sim_render-ego0_min0.00370337878625224
simulation-passed1
step_physics_max0.1566680338785892
step_physics_mean0.1341801594422369
step_physics_median0.1358380776708368
step_physics_min0.1083764485486849
survival_time_max33.95000000000021
survival_time_mean24.925000000000185
survival_time_min16.5000000000001
No reset possible
5413211674Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-070:09:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5408511672Bhavya Patwa 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:15:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5378940618408926
survival_time_median19.95000000000015
deviation-center-line_median0.3501020581269216
in-drivable-lane_median15.42500000000013


other stats
agent_compute-ego0_max0.013432963824729676
agent_compute-ego0_mean0.012523738978479249
agent_compute-ego0_median0.012274139513008282
agent_compute-ego0_min0.012113713063170752
complete-iteration_max0.2857274992125375
complete-iteration_mean0.22498825429270877
complete-iteration_median0.21371820148165568
complete-iteration_min0.18678911499498624
deviation-center-line_max0.3804328049026473
deviation-center-line_mean0.3186149300688017
deviation-center-line_min0.19382279911871636
deviation-heading_max3.499408400187864
deviation-heading_mean2.587466250302758
deviation-heading_median2.5107618286155424
deviation-heading_min1.8289329437920845
driven_any_max7.418284463853401
driven_any_mean3.6517732608770066
driven_any_median3.2436622016840366
driven_any_min0.7014841762865518
driven_lanedir_consec_max0.8444182196738188
driven_lanedir_consec_mean0.5638671387703749
driven_lanedir_consec_min0.3352622117258952
driven_lanedir_max0.8973557147264781
driven_lanedir_mean0.6080251316129446
driven_lanedir_median0.5997412999997025
driven_lanedir_min0.3352622117258952
get_duckie_state_max1.5542959607740454e-06
get_duckie_state_mean1.3897839986423438e-06
get_duckie_state_median1.3840991690200834e-06
get_duckie_state_min1.2366416957551632e-06
get_robot_state_max0.004160170895712716
get_robot_state_mean0.003948601371602084
get_robot_state_median0.004038308863293453
get_robot_state_min0.0035576168641087095
get_state_dump_max0.005144815709290982
get_state_dump_mean0.004891514446034374
get_state_dump_median0.004811537351221716
get_state_dump_min0.00479816737240308
get_ui_image_max0.03575039570773843
get_ui_image_mean0.031712901794583165
get_ui_image_median0.03193028772180561
get_ui_image_min0.02724063602698303
in-drivable-lane_max41.69999999999945
in-drivable-lane_mean18.962499999999928
in-drivable-lane_min3.2999999999999883
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.3582029996890785, "get_ui_image": 0.02724063602698303, "step_physics": 0.12255572365229518, "survival_time": 14.40000000000007, "driven_lanedir": 0.3550643803255862, "get_state_dump": 0.004820924316723042, "get_robot_state": 0.0035576168641087095, "sim_render-ego0": 0.003610673660225522, "get_duckie_state": 1.2366416957551632e-06, "in-drivable-lane": 11.100000000000048, "deviation-heading": 2.383413620322613, "agent_compute-ego0": 0.012113713063170752, "complete-iteration": 0.18678911499498624, "set_robot_commands": 0.002153837144581092, "deviation-center-line": 0.3404575093432483, "driven_lanedir_consec": 0.3550643803255862, "sim_compute_sim_state": 0.00878084902119884, "sim_compute_performance-ego0": 0.0018722029293284695}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7014841762865518, "get_ui_image": 0.035639097009386334, "step_physics": 0.21065691028322492, "survival_time": 6.949999999999983, "driven_lanedir": 0.3352622117258952, "get_state_dump": 0.0048021503857203895, "get_robot_state": 0.004160170895712716, "sim_render-ego0": 0.0036987185478210447, "get_duckie_state": 1.3913427080426897e-06, "in-drivable-lane": 3.2999999999999883, "deviation-heading": 1.8289329437920845, "agent_compute-ego0": 0.012171999045780727, "complete-iteration": 0.2857274992125375, "set_robot_commands": 0.0021952084132603237, "deviation-center-line": 0.19382279911871636, "driven_lanedir_consec": 0.3352622117258952, "sim_compute_sim_state": 0.010262267930167062, "sim_compute_performance-ego0": 0.0020507591111319405}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.418284463853401, "get_ui_image": 0.03575039570773843, "step_physics": 0.1611752972674014, "survival_time": 46.84999999999947, "driven_lanedir": 0.8444182196738188, "get_state_dump": 0.005144815709290982, "get_robot_state": 0.004097638862219447, "sim_render-ego0": 0.004097545579044041, "get_duckie_state": 1.5542959607740454e-06, "in-drivable-lane": 41.69999999999945, "deviation-heading": 2.638110036908472, "agent_compute-ego0": 0.013432963824729676, "complete-iteration": 0.2387241364033746, "set_robot_commands": 0.0024268360280278903, "deviation-center-line": 0.35974660691059485, "driven_lanedir_consec": 0.8444182196738188, "sim_compute_sim_state": 0.010300421511440644, "sim_compute_performance-ego0": 0.002193629360402317}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.129121403678995, "get_ui_image": 0.028221478434224883, "step_physics": 0.12420353917459684, "survival_time": 25.500000000000227, "driven_lanedir": 0.8973557147264781, "get_state_dump": 0.00479816737240308, "get_robot_state": 0.003978978864367461, "sim_render-ego0": 0.003872342305640651, "get_duckie_state": 1.3768556299974774e-06, "in-drivable-lane": 19.750000000000213, "deviation-heading": 3.499408400187864, "agent_compute-ego0": 0.012376279980235836, "complete-iteration": 0.18871226655993675, "set_robot_commands": 0.0023805446587430055, "deviation-center-line": 0.3804328049026473, "driven_lanedir_consec": 0.720723743356199, "sim_compute_sim_state": 0.006694121836682822, "sim_compute_performance-ego0": 0.002096565268977514}}
set_robot_commands_max0.0024268360280278903
set_robot_commands_mean0.002289106561153078
set_robot_commands_median0.0022878765360016644
set_robot_commands_min0.002153837144581092
sim_compute_performance-ego0_max0.002193629360402317
sim_compute_performance-ego0_mean0.0020532891674600604
sim_compute_performance-ego0_median0.0020736621900547276
sim_compute_performance-ego0_min0.0018722029293284695
sim_compute_sim_state_max0.010300421511440644
sim_compute_sim_state_mean0.009009415074872342
sim_compute_sim_state_median0.00952155847568295
sim_compute_sim_state_min0.006694121836682822
sim_render-ego0_max0.004097545579044041
sim_render-ego0_mean0.003819820023182815
sim_render-ego0_median0.003785530426730848
sim_render-ego0_min0.003610673660225522
simulation-passed1
step_physics_max0.21065691028322492
step_physics_mean0.1546478675943796
step_physics_median0.14268941822099912
step_physics_min0.12255572365229518
survival_time_max46.84999999999947
survival_time_mean23.42499999999994
survival_time_min6.949999999999983
No reset possible
5402111691Mo Kleit 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:18:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9884892670520378
survival_time_median25.625000000000227
deviation-center-line_median0.9534127032140328
in-drivable-lane_median14.000000000000163


other stats
agent_compute-ego0_max0.012503940226410572
agent_compute-ego0_mean0.012362725296415043
agent_compute-ego0_median0.012409591647193966
agent_compute-ego0_min0.012127777664861663
complete-iteration_max0.2816194903319049
complete-iteration_mean0.2451920996481141
complete-iteration_median0.24491020368482835
complete-iteration_min0.20932850089089455
deviation-center-line_max1.7434538454669866
deviation-center-line_mean1.0785480136769696
deviation-center-line_min0.663912802812826
deviation-heading_max7.414430725036753
deviation-heading_mean5.250874255933955
deviation-heading_median4.707054555007755
deviation-heading_min4.1749571886835595
driven_any_max17.00479068846169
driven_any_mean10.548997190769304
driven_any_median9.715801412454905
driven_any_min5.7595952497057095
driven_lanedir_consec_max4.024371329598386
driven_lanedir_consec_mean3.101711492360388
driven_lanedir_consec_min2.4054961057390893
driven_lanedir_max7.330875032032255
driven_lanedir_mean4.419251622984497
driven_lanedir_median3.918421126616438
driven_lanedir_min2.5092892066728543
get_duckie_state_max1.3749686360548114e-06
get_duckie_state_mean1.3273379488811917e-06
get_duckie_state_median1.3262911316197929e-06
get_duckie_state_min1.28180089623037e-06
get_robot_state_max0.003847341624271883
get_robot_state_mean0.003712828181636048
get_robot_state_median0.003688898405144898
get_robot_state_min0.003626174291982515
get_state_dump_max0.0049443112479315866
get_state_dump_mean0.004745910946065989
get_state_dump_median0.004734623499364359
get_state_dump_min0.004570085537603653
get_ui_image_max0.03620782931139515
get_ui_image_mean0.03091986861159452
get_ui_image_median0.03013287793193315
get_ui_image_min0.027205889271116637
in-drivable-lane_max23.099999999999955
in-drivable-lane_mean14.687500000000083
in-drivable-lane_min7.650000000000058
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.053820100331482, "get_ui_image": 0.027746989118693936, "step_physics": 0.15950331521676572, "survival_time": 31.500000000000313, "driven_lanedir": 4.471330001373348, "get_state_dump": 0.004570085537603653, "get_robot_state": 0.003626174291982515, "sim_render-ego0": 0.003726899151567801, "get_duckie_state": 1.3749686360548114e-06, "in-drivable-lane": 18.80000000000025, "deviation-heading": 4.41324517632677, "agent_compute-ego0": 0.012127777664861663, "complete-iteration": 0.22653831543899755, "set_robot_commands": 0.0021422071804524222, "deviation-center-line": 1.0088513177138974, "driven_lanedir_consec": 3.225047297200729, "sim_compute_sim_state": 0.011029025454150894, "sim_compute_performance-ego0": 0.0019784257075677017}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.7595952497057095, "get_ui_image": 0.03620782931139515, "step_physics": 0.20511385058141815, "survival_time": 15.650000000000087, "driven_lanedir": 2.5092892066728543, "get_state_dump": 0.004668479512451561, "get_robot_state": 0.0036839368237052, "sim_render-ego0": 0.0038056639349384673, "get_duckie_state": 1.2847268657319865e-06, "in-drivable-lane": 7.650000000000058, "deviation-heading": 4.1749571886835595, "agent_compute-ego0": 0.012402235322697148, "complete-iteration": 0.2816194903319049, "set_robot_commands": 0.0022009322597722337, "deviation-center-line": 0.663912802812826, "driven_lanedir_consec": 2.4054961057390893, "sim_compute_sim_state": 0.01138559496326811, "sim_compute_performance-ego0": 0.0020622136486563715}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.377782724578327, "get_ui_image": 0.032518766745172366, "step_physics": 0.18864512202715633, "survival_time": 19.750000000000146, "driven_lanedir": 3.3655122518595286, "get_state_dump": 0.0049443112479315866, "get_robot_state": 0.003693859986584596, "sim_render-ego0": 0.003868753861899328, "get_duckie_state": 1.28180089623037e-06, "in-drivable-lane": 9.200000000000085, "deviation-heading": 5.0008639336887395, "agent_compute-ego0": 0.012416947971690784, "complete-iteration": 0.26328209193065916, "set_robot_commands": 0.00222977183081887, "deviation-center-line": 0.8979740887141684, "driven_lanedir_consec": 2.751931236903346, "sim_compute_sim_state": 0.012864633642061791, "sim_compute_performance-ego0": 0.0020104989860997057}, "LF-norm-small_loop-000-ego0": {"driven_any": 17.00479068846169, "get_ui_image": 0.027205889271116637, "step_physics": 0.14645451164896578, "survival_time": 43.89999999999964, "driven_lanedir": 7.330875032032255, "get_state_dump": 0.004800767486277158, "get_robot_state": 0.003847341624271883, "sim_render-ego0": 0.003886827972290594, "get_duckie_state": 1.3678553975075993e-06, "in-drivable-lane": 23.099999999999955, "deviation-heading": 7.414430725036753, "agent_compute-ego0": 0.012503940226410572, "complete-iteration": 0.20932850089089455, "set_robot_commands": 0.0023375338661792743, "deviation-center-line": 1.7434538454669866, "driven_lanedir_consec": 4.024371329598386, "sim_compute_sim_state": 0.006129661653364613, "sim_compute_performance-ego0": 0.002072049760438748}}
set_robot_commands_max0.0023375338661792743
set_robot_commands_mean0.0022276112843057005
set_robot_commands_median0.002215352045295552
set_robot_commands_min0.0021422071804524222
sim_compute_performance-ego0_max0.002072049760438748
sim_compute_performance-ego0_mean0.002030797025690632
sim_compute_performance-ego0_median0.0020363563173780384
sim_compute_performance-ego0_min0.0019784257075677017
sim_compute_sim_state_max0.012864633642061791
sim_compute_sim_state_mean0.010352228928211351
sim_compute_sim_state_median0.011207310208709504
sim_compute_sim_state_min0.006129661653364613
sim_render-ego0_max0.003886827972290594
sim_render-ego0_mean0.0038220362301740474
sim_render-ego0_median0.003837208898418898
sim_render-ego0_min0.003726899151567801
simulation-passed1
step_physics_max0.20511385058141815
step_physics_mean0.17492919986857652
step_physics_median0.17407421862196104
step_physics_min0.14645451164896578
survival_time_max43.89999999999964
survival_time_mean27.700000000000045
survival_time_min15.650000000000087
No reset possible
5389111574Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:52:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.328384575418778
survival_time_median59.99999999999873
deviation-center-line_median1.408425815676224
in-drivable-lane_median46.19999999999859


other stats
agent_compute-ego0_max0.1415039784306789
agent_compute-ego0_mean0.11959134480240542
agent_compute-ego0_median0.12250844882390184
agent_compute-ego0_min0.0918445031311391
complete-iteration_max0.4870479597239371
complete-iteration_mean0.4101488955014949
complete-iteration_median0.418326329430573
complete-iteration_min0.3168949634208965
deviation-center-line_max5.324036018525398
deviation-center-line_mean2.059352747365291
deviation-center-line_min0.09652333958331896
deviation-heading_max10.118380600676508
deviation-heading_mean4.247507774792357
deviation-heading_median3.292527599415803
deviation-heading_min0.28659529966131625
driven_any_max18.972144348016453
driven_any_mean8.139598175741918
driven_any_median6.396273677107725
driven_any_min0.7937010007357683
driven_lanedir_consec_max16.139940167063106
driven_lanedir_consec_mean6.260524827219919
driven_lanedir_consec_min0.24538999097901384
driven_lanedir_max16.139940167063106
driven_lanedir_mean6.260524827219919
driven_lanedir_median4.328384575418778
driven_lanedir_min0.24538999097901384
get_duckie_state_max1.474979219587518e-06
get_duckie_state_mean1.4561201313155378e-06
get_duckie_state_median1.4568149398308214e-06
get_duckie_state_min1.4358714260129903e-06
get_robot_state_max0.004109357417771262
get_robot_state_mean0.004005940480593539
get_robot_state_median0.003994771781114615
get_robot_state_min0.003924860942373665
get_state_dump_max0.004968170321652732
get_state_dump_mean0.004878087553950174
get_state_dump_median0.0048821321832051776
get_state_dump_min0.004779915527737607
get_ui_image_max0.03996487223635506
get_ui_image_mean0.034201689753107584
get_ui_image_median0.033818126419601
get_ui_image_min0.029205633936873285
in-drivable-lane_max59.09999999999873
in-drivable-lane_mean40.149999999998954
in-drivable-lane_min9.099999999999882
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.7937010007357683, "get_ui_image": 0.033176201368549485, "step_physics": 0.2556066548794533, "survival_time": 59.99999999999873, "driven_lanedir": 0.24538999097901384, "get_state_dump": 0.004968170321652732, "get_robot_state": 0.004109357417771262, "sim_render-ego0": 0.004189131162645021, "get_duckie_state": 1.474979219587518e-06, "in-drivable-lane": 59.09999999999873, "deviation-heading": 0.28659529966131625, "agent_compute-ego0": 0.1415039784306789, "complete-iteration": 0.45864897822460265, "set_robot_commands": 0.0025589797617890852, "deviation-center-line": 0.09652333958331896, "driven_lanedir_consec": 0.24538999097901384, "sim_compute_sim_state": 0.0101694864198429, "sim_compute_performance-ego0": 0.00226867605903365}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.6817982524491657, "get_ui_image": 0.03996487223635506, "step_physics": 0.28888087209118696, "survival_time": 59.99999999999873, "driven_lanedir": 2.6235050647404923, "get_state_dump": 0.004931231124712764, "get_robot_state": 0.004018037344990523, "sim_render-ego0": 0.004112963672482302, "get_duckie_state": 1.4733910858382989e-06, "in-drivable-lane": 50.799999999998676, "deviation-heading": 2.7082869378770997, "agent_compute-ego0": 0.12755449189433052, "complete-iteration": 0.4870479597239371, "set_robot_commands": 0.0025243092139098765, "deviation-center-line": 0.8023152620857057, "driven_lanedir_consec": 2.6235050647404923, "sim_compute_sim_state": 0.012702404906807296, "sim_compute_performance-ego0": 0.002259319172016687}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.110749101766284, "get_ui_image": 0.03446005147065251, "step_physics": 0.22105197287121975, "survival_time": 59.99999999999873, "driven_lanedir": 6.0332640860970645, "get_state_dump": 0.004779915527737607, "get_robot_state": 0.003924860942373665, "sim_render-ego0": 0.003983409279689106, "get_duckie_state": 1.4402387938233438e-06, "in-drivable-lane": 41.59999999999852, "deviation-heading": 3.8767682609545058, "agent_compute-ego0": 0.0918445031311391, "complete-iteration": 0.3780036806365433, "set_robot_commands": 0.0024342483326755494, "deviation-center-line": 2.014536369266742, "driven_lanedir_consec": 6.0332640860970645, "sim_compute_sim_state": 0.013257534676646312, "sim_compute_performance-ego0": 0.0021709587849943366}, "LF-norm-small_loop-000-ego0": {"driven_any": 18.972144348016453, "get_ui_image": 0.029205633936873285, "step_physics": 0.1461646505239901, "survival_time": 59.99999999999873, "driven_lanedir": 16.139940167063106, "get_state_dump": 0.004833033241697592, "get_robot_state": 0.003971506217238707, "sim_render-ego0": 0.003930660211275658, "get_duckie_state": 1.4358714260129903e-06, "in-drivable-lane": 9.099999999999882, "deviation-heading": 10.118380600676508, "agent_compute-ego0": 0.11746240575347316, "complete-iteration": 0.3168949634208965, "set_robot_commands": 0.0024780520392298005, "deviation-center-line": 5.324036018525398, "driven_lanedir_consec": 16.139940167063106, "sim_compute_sim_state": 0.006568500938066138, "sim_compute_performance-ego0": 0.002185384399388652}}
set_robot_commands_max0.0025589797617890852
set_robot_commands_mean0.002498897336901078
set_robot_commands_median0.0025011806265698385
set_robot_commands_min0.0024342483326755494
sim_compute_performance-ego0_max0.00226867605903365
sim_compute_performance-ego0_mean0.0022210846038583317
sim_compute_performance-ego0_median0.0022223517857026696
sim_compute_performance-ego0_min0.0021709587849943366
sim_compute_sim_state_max0.013257534676646312
sim_compute_sim_state_mean0.01067448173534066
sim_compute_sim_state_median0.011435945663325096
sim_compute_sim_state_min0.006568500938066138
sim_render-ego0_max0.004189131162645021
sim_render-ego0_mean0.004054041081523022
sim_render-ego0_median0.004048186476085704
sim_render-ego0_min0.003930660211275658
simulation-passed1
step_physics_max0.28888087209118696
step_physics_mean0.22792603759146252
step_physics_median0.2383293138753365
step_physics_min0.1461646505239901
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5386511742Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:27:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.154087170560157
survival_time_median53.84999999999908
deviation-center-line_median2.679339136755724
in-drivable-lane_median13.024999999999665


other stats
agent_compute-ego0_max0.012758514014157382
agent_compute-ego0_mean0.012481455451137775
agent_compute-ego0_median0.012497745809816095
agent_compute-ego0_min0.012171816170761528
complete-iteration_max0.2330410170929594
complete-iteration_mean0.19497447156062897
complete-iteration_median0.19267622451752991
complete-iteration_min0.16150442011449656
deviation-center-line_max4.68431430225937
deviation-center-line_mean2.549076144527537
deviation-center-line_min0.15331200233932868
deviation-heading_max17.138757477523495
deviation-heading_mean11.16741009190024
deviation-heading_median13.41329582321714
deviation-heading_min0.704291243643182
driven_any_max11.026380575296976
driven_any_mean7.274800702869317
driven_any_median8.356772450143467
driven_any_min1.3592773358933563
driven_lanedir_consec_max7.1314740101757
driven_lanedir_consec_mean3.5203799179868995
driven_lanedir_consec_min0.6418713206515837
driven_lanedir_max9.791373176066305
driven_lanedir_mean5.129811858540556
driven_lanedir_median5.043001468722168
driven_lanedir_min0.6418713206515837
get_duckie_state_max1.8652630884581856e-06
get_duckie_state_mean1.5433456338316237e-06
get_duckie_state_median1.4707651778325078e-06
get_duckie_state_min1.366589091203294e-06
get_robot_state_max0.00404171244636256
get_robot_state_mean0.003925795370998521
get_robot_state_median0.003940815455384226
get_robot_state_min0.003779838126863071
get_state_dump_max0.005114970258828702
get_state_dump_mean0.005048241052045796
get_state_dump_median0.005039405232166668
get_state_dump_min0.004999183485021142
get_ui_image_max0.037704571629069865
get_ui_image_mean0.03152598060527884
get_ui_image_median0.03111857811080526
get_ui_image_min0.026162194570434977
in-drivable-lane_max29.049999999999613
in-drivable-lane_mean14.974999999999744
in-drivable-lane_min4.80000000000003
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.652488492779511, "get_ui_image": 0.029539597818595383, "step_physics": 0.11836946417548871, "survival_time": 59.99999999999873, "driven_lanedir": 7.539219373103978, "get_state_dump": 0.005114970258828702, "get_robot_state": 0.003943769858342027, "sim_render-ego0": 0.004000455314769634, "get_duckie_state": 1.8652630884581856e-06, "in-drivable-lane": 18.4999999999993, "deviation-heading": 15.291112993970136, "agent_compute-ego0": 0.0125403235496629, "complete-iteration": 0.1880951394248664, "set_robot_commands": 0.0023262552377286303, "deviation-center-line": 3.8187303956765946, "driven_lanedir_consec": 7.1314740101757, "sim_compute_sim_state": 0.009996901741631325, "sim_compute_performance-ego0": 0.002164831169439692}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.061056407507424, "get_ui_image": 0.037704571629069865, "step_physics": 0.1521877306294067, "survival_time": 47.69999999999943, "driven_lanedir": 2.546783564340358, "get_state_dump": 0.004999183485021142, "get_robot_state": 0.00404171244636256, "sim_render-ego0": 0.00409610433728283, "get_duckie_state": 1.3950607539471531e-06, "in-drivable-lane": 29.049999999999613, "deviation-heading": 11.535478652464146, "agent_compute-ego0": 0.012455168069969297, "complete-iteration": 0.2330410170929594, "set_robot_commands": 0.0024289430748105673, "deviation-center-line": 1.5399478778348532, "driven_lanedir_consec": 1.6649962740133148, "sim_compute_sim_state": 0.012751135152047842, "sim_compute_performance-ego0": 0.0022840687117651496}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3592773358933563, "get_ui_image": 0.03269755840301514, "step_physics": 0.1251595594666221, "survival_time": 10.95000000000002, "driven_lanedir": 0.6418713206515837, "get_state_dump": 0.005035555362701416, "get_robot_state": 0.003937861052426425, "sim_render-ego0": 0.004005327007987282, "get_duckie_state": 1.5464696017178622e-06, "in-drivable-lane": 7.550000000000025, "deviation-heading": 0.704291243643182, "agent_compute-ego0": 0.012758514014157382, "complete-iteration": 0.19725730961019344, "set_robot_commands": 0.0023311376571655273, "deviation-center-line": 0.15331200233932868, "driven_lanedir_consec": 0.6418713206515837, "sim_compute_sim_state": 0.009127329696308485, "sim_compute_performance-ego0": 0.002113451740958474}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.026380575296976, "get_ui_image": 0.026162194570434977, "step_physics": 0.10028590727209748, "survival_time": 59.99999999999873, "driven_lanedir": 9.791373176066305, "get_state_dump": 0.005043255101631921, "get_robot_state": 0.003779838126863071, "sim_render-ego0": 0.003743433932479871, "get_duckie_state": 1.366589091203294e-06, "in-drivable-lane": 4.80000000000003, "deviation-heading": 17.138757477523495, "agent_compute-ego0": 0.012171816170761528, "complete-iteration": 0.16150442011449656, "set_robot_commands": 0.0022520612022660356, "deviation-center-line": 4.68431430225937, "driven_lanedir_consec": 4.643178067107, "sim_compute_sim_state": 0.0060129040583881315, "sim_compute_performance-ego0": 0.0019697358864332417}}
set_robot_commands_max0.0024289430748105673
set_robot_commands_mean0.00233459929299269
set_robot_commands_median0.002328696447447079
set_robot_commands_min0.0022520612022660356
sim_compute_performance-ego0_max0.0022840687117651496
sim_compute_performance-ego0_mean0.0021330218771491395
sim_compute_performance-ego0_median0.002139141455199083
sim_compute_performance-ego0_min0.0019697358864332417
sim_compute_sim_state_max0.012751135152047842
sim_compute_sim_state_mean0.009472067662093946
sim_compute_sim_state_median0.009562115718969904
sim_compute_sim_state_min0.0060129040583881315
sim_render-ego0_max0.00409610433728283
sim_render-ego0_mean0.003961330148129904
sim_render-ego0_median0.004002891161378458
sim_render-ego0_min0.003743433932479871
simulation-passed1
step_physics_max0.1521877306294067
step_physics_mean0.12400066538590376
step_physics_median0.1217645118210554
step_physics_min0.10028590727209748
survival_time_max59.99999999999873
survival_time_mean44.66249999999923
survival_time_min10.95000000000002
No reset possible
5380811760Ayman Shams 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:46:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013423509740710358
agent_compute-ego0_mean0.01304906333713706
agent_compute-ego0_median0.013221229244330642
agent_compute-ego0_min0.012330285119176606
complete-iteration_max0.3700987992933847
complete-iteration_mean0.3155780300113383
complete-iteration_median0.31751057478311556
complete-iteration_min0.25719217118573723
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.722926601184397e-06
get_duckie_state_mean1.6021291778843964e-06
get_duckie_state_median1.5993499438232623e-06
get_duckie_state_min1.4868902227066635e-06
get_robot_state_max0.004192128566579954
get_robot_state_mean0.004081254994045388
get_robot_state_median0.00406784469340862
get_robot_state_min0.003997202022784358
get_state_dump_max0.0052683127115013
get_state_dump_mean0.00518609964281792
get_state_dump_median0.005167428897282762
get_state_dump_min0.005141228065204858
get_ui_image_max0.0371964960471478
get_ui_image_mean0.03196037897559427
get_ui_image_median0.03168236177033131
get_ui_image_min0.027280296314566656
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02931960556131914, "step_physics": 0.22637528305149, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005141228065204858, "get_robot_state": 0.003997202022784358, "sim_render-ego0": 0.0040534227515735995, "get_duckie_state": 1.634586661384068e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.013246990858168526, "complete-iteration": 0.29585765005646897, "set_robot_commands": 0.002365177219654499, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009046601613892008, "sim_compute_performance-ego0": 0.002207506506965123}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.0371964960471478, "step_physics": 0.28874618901896737, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.0052683127115013, "get_robot_state": 0.004096306928687052, "sim_render-ego0": 0.004206819994860545, "get_duckie_state": 1.722926601184397e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013195467630492758, "complete-iteration": 0.3700987992933847, "set_robot_commands": 0.002439648185939614, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012513989115833344, "sim_compute_performance-ego0": 0.002328363088247282}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03404511797934349, "step_physics": 0.263556327152808, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005164087860907841, "get_robot_state": 0.004192128566579954, "sim_render-ego0": 0.004202797252073773, "get_duckie_state": 1.4868902227066635e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.013423509740710358, "complete-iteration": 0.33916349950976216, "set_robot_commands": 0.002523510581150738, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009622706263190403, "sim_compute_performance-ego0": 0.002328061938385086}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.027280296314566656, "step_physics": 0.1929488553294135, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005170769933657682, "get_robot_state": 0.004039382458130188, "sim_render-ego0": 0.004070162475357246, "get_duckie_state": 1.564113226262457e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012330285119176606, "complete-iteration": 0.25719217118573723, "set_robot_commands": 0.002434279698317097, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006588311914004057, "sim_compute_performance-ego0": 0.002230437967203539}}
set_robot_commands_max0.002523510581150738
set_robot_commands_mean0.0024406539212654867
set_robot_commands_median0.0024369639421283553
set_robot_commands_min0.002365177219654499
sim_compute_performance-ego0_max0.002328363088247282
sim_compute_performance-ego0_mean0.002273592375200257
sim_compute_performance-ego0_median0.0022792499527943128
sim_compute_performance-ego0_min0.002207506506965123
sim_compute_sim_state_max0.012513989115833344
sim_compute_sim_state_mean0.009442902226729952
sim_compute_sim_state_median0.009334653938541203
sim_compute_sim_state_min0.006588311914004057
sim_render-ego0_max0.004206819994860545
sim_render-ego0_mean0.004133300618466291
sim_render-ego0_median0.004136479863715509
sim_render-ego0_min0.0040534227515735995
simulation-passed1
step_physics_max0.28874618901896737
step_physics_mean0.2429066636381697
step_physics_median0.244965805102149
step_physics_min0.1929488553294135
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5378811769Ayman Shams 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:11:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4813896653090119
survival_time_median12.025000000000036
deviation-center-line_median0.3334569885000165
in-drivable-lane_median7.375000000000044


other stats
agent_compute-ego0_max0.012712883818996408
agent_compute-ego0_mean0.012284909506951724
agent_compute-ego0_median0.012302340268255696
agent_compute-ego0_min0.011822073672299094
complete-iteration_max0.34561978147623124
complete-iteration_mean0.31011033705025853
complete-iteration_median0.31108509862071015
complete-iteration_min0.2726513694833826
deviation-center-line_max0.3802918531611038
deviation-center-line_mean0.30650288335966336
deviation-center-line_min0.17880570327751663
deviation-heading_max3.161354731862355
deviation-heading_mean1.9743534448386173
deviation-heading_median1.937326287169252
deviation-heading_min0.8614064731536104
driven_any_max3.021942659014262
driven_any_mean1.750628908649539
driven_any_median1.4585254891534003
driven_any_min1.0635219972770928
driven_lanedir_consec_max0.6434143025977583
driven_lanedir_consec_mean0.468631087384625
driven_lanedir_consec_min0.26833071632271777
driven_lanedir_max0.6434143025977583
driven_lanedir_mean0.468631087384625
driven_lanedir_median0.4813896653090119
driven_lanedir_min0.26833071632271777
get_duckie_state_max1.647737291124132e-06
get_duckie_state_mean1.5918307657858931e-06
get_duckie_state_median1.6148747433238528e-06
get_duckie_state_min1.4898362853717356e-06
get_robot_state_max0.0040670765770806205
get_robot_state_mean0.003867028721832477
get_robot_state_median0.0038672319518686894
get_robot_state_min0.0036665744065119063
get_state_dump_max0.004991141072026005
get_state_dump_mean0.004857443261147095
get_state_dump_median0.004861425465325656
get_state_dump_min0.004715781041911063
get_ui_image_max0.03588095181424853
get_ui_image_mean0.03188676504931359
get_ui_image_median0.0315825761534215
get_ui_image_min0.02850095607616283
in-drivable-lane_max20.200000000000177
in-drivable-lane_mean9.637500000000069
in-drivable-lane_min3.600000000000006
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.021942659014262, "get_ui_image": 0.029936810959310153, "step_physics": 0.22670860460469308, "survival_time": 23.800000000000203, "driven_lanedir": 0.26833071632271777, "get_state_dump": 0.004715781041911063, "get_robot_state": 0.003820920640317649, "sim_render-ego0": 0.003914423208816496, "get_duckie_state": 1.6194469523879718e-06, "in-drivable-lane": 20.200000000000177, "deviation-heading": 2.8274333658762356, "agent_compute-ego0": 0.01215982587082581, "complete-iteration": 0.29642419645121515, "set_robot_commands": 0.002321350249604359, "deviation-center-line": 0.3802918531611038, "driven_lanedir_consec": 0.26833071632271777, "sim_compute_sim_state": 0.010643822592009538, "sim_compute_performance-ego0": 0.002105632418106687}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2693221363997798, "get_ui_image": 0.03588095181424853, "step_physics": 0.27085076587300905, "survival_time": 10.600000000000016, "driven_lanedir": 0.35456522652489086, "get_state_dump": 0.00476257454061732, "get_robot_state": 0.0036665744065119063, "sim_render-ego0": 0.003758193181713982, "get_duckie_state": 1.4898362853717356e-06, "in-drivable-lane": 6.350000000000023, "deviation-heading": 3.161354731862355, "agent_compute-ego0": 0.011822073672299094, "complete-iteration": 0.34561978147623124, "set_robot_commands": 0.0022196635394029214, "deviation-center-line": 0.35733130213015035, "driven_lanedir_consec": 0.35456522652489086, "sim_compute_sim_state": 0.01056779942042391, "sim_compute_performance-ego0": 0.002004721914658524}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0635219972770928, "get_ui_image": 0.033228341347532844, "step_physics": 0.25321247408298847, "survival_time": 9.099999999999994, "driven_lanedir": 0.6434143025977583, "get_state_dump": 0.0049602763900339925, "get_robot_state": 0.00391354326341973, "sim_render-ego0": 0.004081335224089076, "get_duckie_state": 1.6103025342597337e-06, "in-drivable-lane": 3.600000000000006, "deviation-heading": 1.0472192084622685, "agent_compute-ego0": 0.012712883818996408, "complete-iteration": 0.32574600079020516, "set_robot_commands": 0.002383228208197922, "deviation-center-line": 0.17880570327751663, "driven_lanedir_consec": 0.6434143025977583, "sim_compute_sim_state": 0.008932503194756847, "sim_compute_performance-ego0": 0.002222745144953493}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6477288419070213, "get_ui_image": 0.02850095607616283, "step_physics": 0.20836668897558144, "survival_time": 13.450000000000056, "driven_lanedir": 0.608214104093133, "get_state_dump": 0.004991141072026005, "get_robot_state": 0.0040670765770806205, "sim_render-ego0": 0.003941051165262858, "get_duckie_state": 1.647737291124132e-06, "in-drivable-lane": 8.400000000000066, "deviation-heading": 0.8614064731536104, "agent_compute-ego0": 0.012444854665685585, "complete-iteration": 0.2726513694833826, "set_robot_commands": 0.002430824880246763, "deviation-center-line": 0.3095826748698826, "driven_lanedir_consec": 0.608214104093133, "sim_compute_sim_state": 0.0056577832610518845, "sim_compute_performance-ego0": 0.002151722378200955}}
set_robot_commands_max0.002430824880246763
set_robot_commands_mean0.002338766719362991
set_robot_commands_median0.0023522892289011407
set_robot_commands_min0.0022196635394029214
sim_compute_performance-ego0_max0.002222745144953493
sim_compute_performance-ego0_mean0.0021212054639799145
sim_compute_performance-ego0_median0.002128677398153821
sim_compute_performance-ego0_min0.002004721914658524
sim_compute_sim_state_max0.010643822592009538
sim_compute_sim_state_mean0.008950477117060545
sim_compute_sim_state_median0.00975015130759038
sim_compute_sim_state_min0.0056577832610518845
sim_render-ego0_max0.004081335224089076
sim_render-ego0_mean0.003923750694970603
sim_render-ego0_median0.003927737187039678
sim_render-ego0_min0.003758193181713982
simulation-passed1
step_physics_max0.27085076587300905
step_physics_mean0.239784633384068
step_physics_median0.23996053934384076
step_physics_min0.20836668897558144
survival_time_max23.800000000000203
survival_time_mean14.237500000000068
survival_time_min9.099999999999994
No reset possible
5377812020Ayman Shams 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.48138958790383146
survival_time_median12.025000000000036
deviation-center-line_median0.33345678746877366
in-drivable-lane_median7.375000000000044


other stats
agent_compute-ego0_max0.012832539980528784
agent_compute-ego0_mean0.01172570420912135
agent_compute-ego0_median0.011743148871913
agent_compute-ego0_min0.010583979112130625
complete-iteration_max0.33769771414743344
complete-iteration_mean0.2960611463078184
complete-iteration_median0.31237469224801656
complete-iteration_min0.221797486587807
deviation-center-line_max0.3802916658264969
deviation-center-line_mean0.30650273601039024
deviation-center-line_min0.17880570327751663
deviation-heading_max3.161356130982209
deviation-heading_mean1.9743522719863076
deviation-heading_median1.9373237576458648
deviation-heading_min0.8614054416712923
driven_any_max3.0219426596847994
driven_any_mean1.7506289087613158
driven_any_median1.4585254890416857
driven_any_min1.0635219972770928
driven_lanedir_consec_max0.6434143025977583
driven_lanedir_consec_mean0.46863120846268286
driven_lanedir_consec_min0.26833135544531017
driven_lanedir_max0.6434143025977583
driven_lanedir_mean0.46863120846268286
driven_lanedir_median0.48138958790383146
driven_lanedir_min0.26833135544531017
get_duckie_state_max1.7379802432867998e-06
get_duckie_state_mean1.4976826822215935e-06
get_duckie_state_median1.4958905558423218e-06
get_duckie_state_min1.2609693739149303e-06
get_robot_state_max0.003942367157649473
get_robot_state_mean0.0037440756746175505
get_robot_state_median0.0038206473956036422
get_robot_state_min0.003392640749613444
get_state_dump_max0.0049804064745460055
get_state_dump_mean0.004703151783724566
get_state_dump_median0.004737289186230365
get_state_dump_min0.004357622287891529
get_ui_image_max0.03558991660534496
get_ui_image_mean0.03136665889429588
get_ui_image_median0.032468142823123824
get_ui_image_min0.02494043332559091
in-drivable-lane_max20.200000000000177
in-drivable-lane_mean9.637500000000069
in-drivable-lane_min3.600000000000006
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0219426596847994, "get_ui_image": 0.030966586286916672, "step_physics": 0.2289744148214408, "survival_time": 23.800000000000203, "driven_lanedir": 0.26833135544531017, "get_state_dump": 0.004806338116307928, "get_robot_state": 0.003803089229815661, "sim_render-ego0": 0.003855975668885173, "get_duckie_state": 1.492990137895948e-06, "in-drivable-lane": 20.200000000000177, "deviation-heading": 2.827428306829461, "agent_compute-ego0": 0.01180254938217579, "complete-iteration": 0.29966660165686776, "set_robot_commands": 0.0023117735200957933, "deviation-center-line": 0.3802916658264969, "driven_lanedir_consec": 0.26833135544531017, "sim_compute_sim_state": 0.010943471260790556, "sim_compute_performance-ego0": 0.0021086523867753066}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2693221366233258, "get_ui_image": 0.03558991660534496, "step_physics": 0.26364394196881935, "survival_time": 10.600000000000016, "driven_lanedir": 0.35456502837156756, "get_state_dump": 0.004668240256152802, "get_robot_state": 0.003838205561391625, "sim_render-ego0": 0.0036547732465144057, "get_duckie_state": 1.4987909737886958e-06, "in-drivable-lane": 6.350000000000023, "deviation-heading": 3.161356130982209, "agent_compute-ego0": 0.011683748361650209, "complete-iteration": 0.33769771414743344, "set_robot_commands": 0.0021199497258719145, "deviation-center-line": 0.3573313604846532, "driven_lanedir_consec": 0.35456502837156756, "sim_compute_sim_state": 0.01045173658451564, "sim_compute_performance-ego0": 0.0019582963325607944}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0635219972770928, "get_ui_image": 0.033969699359330974, "step_physics": 0.2520597007105259, "survival_time": 9.099999999999994, "driven_lanedir": 0.6434143025977583, "get_state_dump": 0.0049804064745460055, "get_robot_state": 0.003942367157649473, "sim_render-ego0": 0.003956291844936017, "get_duckie_state": 1.7379802432867998e-06, "in-drivable-lane": 3.600000000000006, "deviation-heading": 1.0472192084622685, "agent_compute-ego0": 0.012832539980528784, "complete-iteration": 0.32508278283916536, "set_robot_commands": 0.0023347862431260407, "deviation-center-line": 0.17880570327751663, "driven_lanedir_consec": 0.6434143025977583, "sim_compute_sim_state": 0.008775574262024926, "sim_compute_performance-ego0": 0.0021296941517480734}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6477288414600455, "get_ui_image": 0.02494043332559091, "step_physics": 0.16634774914494269, "survival_time": 13.450000000000056, "driven_lanedir": 0.6082141474360954, "get_state_dump": 0.004357622287891529, "get_robot_state": 0.003392640749613444, "sim_render-ego0": 0.00342794347692419, "get_duckie_state": 1.2609693739149303e-06, "in-drivable-lane": 8.400000000000066, "deviation-heading": 0.8614054416712923, "agent_compute-ego0": 0.010583979112130625, "complete-iteration": 0.221797486587807, "set_robot_commands": 0.002025606014110424, "deviation-center-line": 0.30958221445289413, "driven_lanedir_consec": 0.6082141474360954, "sim_compute_sim_state": 0.004847162741201895, "sim_compute_performance-ego0": 0.0017913429825394242}}
set_robot_commands_max0.0023347862431260407
set_robot_commands_mean0.002198028875801043
set_robot_commands_median0.002215861622983854
set_robot_commands_min0.002025606014110424
sim_compute_performance-ego0_max0.0021296941517480734
sim_compute_performance-ego0_mean0.0019969964634058996
sim_compute_performance-ego0_median0.0020334743596680505
sim_compute_performance-ego0_min0.0017913429825394242
sim_compute_sim_state_max0.010943471260790556
sim_compute_sim_state_mean0.008754486212133254
sim_compute_sim_state_median0.009613655423270282
sim_compute_sim_state_min0.004847162741201895
sim_render-ego0_max0.003956291844936017
sim_render-ego0_mean0.003723746059314946
sim_render-ego0_median0.003755374457699789
sim_render-ego0_min0.00342794347692419
simulation-passed1
step_physics_max0.26364394196881935
step_physics_mean0.2277564516614322
step_physics_median0.24051705776598337
step_physics_min0.16634774914494269
survival_time_max23.800000000000203
survival_time_mean14.237500000000068
survival_time_min9.099999999999994
No reset possible
5372612095Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:27:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.74274380358015
survival_time_median59.99999999999873
deviation-center-line_median2.960249898646848
in-drivable-lane_median4.675000000000006


other stats
agent_compute-ego0_max0.012587302928165432
agent_compute-ego0_mean0.01211917069440864
agent_compute-ego0_median0.012209432011937024
agent_compute-ego0_min0.011470515825595076
complete-iteration_max0.22940905610023185
complete-iteration_mean0.18724179676264696
complete-iteration_median0.17751960115170698
complete-iteration_min0.16451892864694206
deviation-center-line_max3.5967526284029314
deviation-center-line_mean2.500803821085947
deviation-center-line_min0.4859628586471606
deviation-heading_max11.353099105305088
deviation-heading_mean7.449348465875007
deviation-heading_median8.350465575351599
deviation-heading_min1.7433636074917405
driven_any_max7.921209002454981
driven_any_mean6.186716918181534
driven_any_median7.9176206539943745
driven_any_min0.9904173622824044
driven_lanedir_consec_max6.486705308436724
driven_lanedir_consec_mean4.157981547902991
driven_lanedir_consec_min0.6597332760149406
driven_lanedir_max7.378912390176829
driven_lanedir_mean5.302382354681116
driven_lanedir_median6.585441876266348
driven_lanedir_min0.6597332760149406
get_duckie_state_max1.346855832819353e-06
get_duckie_state_mean1.269593648332247e-06
get_duckie_state_median1.2966119478783143e-06
get_duckie_state_min1.1382948647530053e-06
get_robot_state_max0.003799892285781339
get_robot_state_mean0.003699521348502542
get_robot_state_median0.003677849783616156
get_robot_state_min0.003642493540996517
get_state_dump_max0.004759834966095758
get_state_dump_mean0.004608003558835136
get_state_dump_median0.004603433143829555
get_state_dump_min0.004465312981585678
get_ui_image_max0.03360034429539017
get_ui_image_mean0.029878374501624477
get_ui_image_median0.029601339892880503
get_ui_image_min0.026710473925346735
in-drivable-lane_max8.399999999999945
in-drivable-lane_mean4.974999999999987
in-drivable-lane_min2.1499999999999924
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.921209002454981, "get_ui_image": 0.02787886968163229, "step_physics": 0.0978450866464175, "survival_time": 59.99999999999873, "driven_lanedir": 7.378912390176829, "get_state_dump": 0.004651956018262064, "get_robot_state": 0.0037069904317863778, "sim_render-ego0": 0.003792548953841668, "get_duckie_state": 1.301078574047994e-06, "in-drivable-lane": 3.0500000000000433, "deviation-heading": 6.015489182717777, "agent_compute-ego0": 0.012178328908750358, "complete-iteration": 0.16451892864694206, "set_robot_commands": 0.0022962401054185395, "deviation-center-line": 2.978550043992473, "driven_lanedir_consec": 4.140571401434622, "sim_compute_sim_state": 0.010022722215676289, "sim_compute_performance-ego0": 0.0020595913028637635}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.9904173622824044, "get_ui_image": 0.03360034429539017, "step_physics": 0.1583622059626886, "survival_time": 8.499999999999986, "driven_lanedir": 0.6597332760149406, "get_state_dump": 0.004554910269397044, "get_robot_state": 0.003648709135445935, "sim_render-ego0": 0.003657179269177175, "get_duckie_state": 1.346855832819353e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 1.7433636074917405, "agent_compute-ego0": 0.011470515825595076, "complete-iteration": 0.22940905610023185, "set_robot_commands": 0.002161621350293968, "deviation-center-line": 0.4859628586471606, "driven_lanedir_consec": 0.6597332760149406, "sim_compute_sim_state": 0.009919293442664788, "sim_compute_performance-ego0": 0.0019539936244139197}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914466403662505, "get_ui_image": 0.03132381010412872, "step_physics": 0.11454572447332911, "survival_time": 59.99999999999873, "driven_lanedir": 6.486705308436724, "get_state_dump": 0.004465312981585678, "get_robot_state": 0.003642493540996517, "sim_render-ego0": 0.0036870482362974296, "get_duckie_state": 1.1382948647530053e-06, "in-drivable-lane": 8.399999999999945, "deviation-heading": 10.68544196798542, "agent_compute-ego0": 0.012240535115123689, "complete-iteration": 0.1869718436893079, "set_robot_commands": 0.002178561578285287, "deviation-center-line": 2.9419497533012233, "driven_lanedir_consec": 6.486705308436724, "sim_compute_sim_state": 0.012856237100224807, "sim_compute_performance-ego0": 0.0019495137823709937}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920774904326243, "get_ui_image": 0.026710473925346735, "step_physics": 0.10606553751066464, "survival_time": 59.99999999999873, "driven_lanedir": 6.684178444095972, "get_state_dump": 0.004759834966095758, "get_robot_state": 0.003799892285781339, "sim_render-ego0": 0.003844828728732221, "get_duckie_state": 1.2921453217086348e-06, "in-drivable-lane": 6.299999999999969, "deviation-heading": 11.353099105305088, "agent_compute-ego0": 0.012587302928165432, "complete-iteration": 0.16806735861410607, "set_robot_commands": 0.0022788571874664586, "deviation-center-line": 3.5967526284029314, "driven_lanedir_consec": 5.344916205725678, "sim_compute_sim_state": 0.005906233878854312, "sim_compute_performance-ego0": 0.0020269297441773172}}
set_robot_commands_max0.0022962401054185395
set_robot_commands_mean0.0022288200553660636
set_robot_commands_median0.002228709382875873
set_robot_commands_min0.002161621350293968
sim_compute_performance-ego0_max0.0020595913028637635
sim_compute_performance-ego0_mean0.0019975071134564985
sim_compute_performance-ego0_median0.0019904616842956182
sim_compute_performance-ego0_min0.0019495137823709937
sim_compute_sim_state_max0.012856237100224807
sim_compute_sim_state_mean0.009676121659355047
sim_compute_sim_state_median0.009971007829170538
sim_compute_sim_state_min0.005906233878854312
sim_render-ego0_max0.003844828728732221
sim_render-ego0_mean0.003745401297012123
sim_render-ego0_median0.0037397985950695487
sim_render-ego0_min0.003657179269177175
simulation-passed1
step_physics_max0.1583622059626886
step_physics_mean0.11920463864827496
step_physics_median0.11030563099199688
step_physics_min0.0978450866464175
survival_time_max59.99999999999873
survival_time_mean47.12499999999904
survival_time_min8.499999999999986
No reset possible
5370812578Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:05:58
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1176, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 758, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5369712715Bea Baselines 🐤template-randomaido5-LFI-full-sim-testingLFVIv-simsuccessyesnogpu-prod-070:02:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6587966891077274
survival_time_median4.82499999999999
deviation-center-line_median0.18372681341530445
in-drivable-lane_median2.6749999999999927


other stats
agent_compute-ego0_max0.01135110855102539
agent_compute-ego0_mean0.010985014414546464
agent_compute-ego0_median0.010985014414546464
agent_compute-ego0_min0.01061892027806754
complete-iteration_max0.21210180471340817
complete-iteration_mean0.2059116596450107
complete-iteration_median0.2059116596450107
complete-iteration_min0.1997215145766133
deviation-center-line_max0.22270545771576217
deviation-center-line_mean0.18372681341530445
deviation-center-line_min0.14474816911484673
deviation-heading_max0.9254423888501632
deviation-heading_mean0.9131948861321344
deviation-heading_median0.9131948861321344
deviation-heading_min0.9009473834141052
driven_any_max1.7167609354270057
driven_any_mean1.6960945672591825
driven_any_median1.6960945672591825
driven_any_min1.6754281990913595
driven_lanedir_consec_max0.8731138199226813
driven_lanedir_consec_mean0.6587966891077274
driven_lanedir_consec_min0.4444795582927734
driven_lanedir_max0.8919331054681621
driven_lanedir_mean0.6682063318804677
driven_lanedir_median0.6682063318804677
driven_lanedir_min0.4444795582927734
get_duckie_state_max1.3237198193868e-06
get_duckie_state_mean1.2880097133944732e-06
get_duckie_state_median1.2880097133944732e-06
get_duckie_state_min1.2522996074021465e-06
get_robot_state_max0.003804999168473061
get_robot_state_mean0.00378002602644641
get_robot_state_median0.00378002602644641
get_robot_state_min0.0037550528844197593
get_state_dump_max0.004818952444827918
get_state_dump_mean0.004806062263069731
get_state_dump_median0.004806062263069731
get_state_dump_min0.0047931720813115435
get_ui_image_max0.037572083373864494
get_ui_image_mean0.036069088775401166
get_ui_image_median0.036069088775401166
get_ui_image_min0.03456609417693784
in-drivable-lane_max3.249999999999993
in-drivable-lane_mean2.6749999999999927
in-drivable-lane_min2.0999999999999925
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 1.6754281990913595, "get_ui_image": 0.037572083373864494, "step_physics": 0.1356559693813324, "survival_time": 4.749999999999991, "driven_lanedir": 0.8919331054681621, "get_state_dump": 0.0047931720813115435, "get_robot_state": 0.0037550528844197593, "sim_render-ego0": 0.003850862383842468, "get_duckie_state": 1.3237198193868e-06, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 0.9009473834141052, "agent_compute-ego0": 0.01135110855102539, "complete-iteration": 0.21210180471340817, "set_robot_commands": 0.0023074919978777566, "deviation-center-line": 0.22270545771576217, "driven_lanedir_consec": 0.8731138199226813, "sim_compute_sim_state": 0.01065657784541448, "sim_compute_performance-ego0": 0.002074579397837321}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7167609354270057, "get_ui_image": 0.03456609417693784, "step_physics": 0.12885754758661444, "survival_time": 4.899999999999991, "driven_lanedir": 0.4444795582927734, "get_state_dump": 0.004818952444827918, "get_robot_state": 0.003804999168473061, "sim_render-ego0": 0.0037386730463817865, "get_duckie_state": 1.2522996074021465e-06, "in-drivable-lane": 3.249999999999993, "deviation-heading": 0.9254423888501632, "agent_compute-ego0": 0.01061892027806754, "complete-iteration": 0.1997215145766133, "set_robot_commands": 0.0023376869432853928, "deviation-center-line": 0.14474816911484673, "driven_lanedir_consec": 0.4444795582927734, "sim_compute_sim_state": 0.00893581033957125, "sim_compute_performance-ego0": 0.0019641283786658087}}
set_robot_commands_max0.0023376869432853928
set_robot_commands_mean0.0023225894705815745
set_robot_commands_median0.0023225894705815745
set_robot_commands_min0.0023074919978777566
sim_compute_performance-ego0_max0.002074579397837321
sim_compute_performance-ego0_mean0.002019353888251565
sim_compute_performance-ego0_median0.002019353888251565
sim_compute_performance-ego0_min0.0019641283786658087
sim_compute_sim_state_max0.01065657784541448
sim_compute_sim_state_mean0.009796194092492863
sim_compute_sim_state_median0.009796194092492863
sim_compute_sim_state_min0.00893581033957125
sim_render-ego0_max0.003850862383842468
sim_render-ego0_mean0.003794767715112128
sim_render-ego0_median0.003794767715112128
sim_render-ego0_min0.0037386730463817865
simulation-passed1
step_physics_max0.1356559693813324
step_physics_mean0.13225675848397342
step_physics_median0.13225675848397342
step_physics_min0.12885754758661444
survival_time_max4.899999999999991
survival_time_mean4.82499999999999
survival_time_min4.749999999999991
No reset possible
5368712716Bea Baselines 🐤template-randomaido5-LFP-sim-validationLFP-simsuccessnonogpu-prod-070:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.324999999999992
in-drivable-lane_median2.774999999999994
driven_lanedir_consec_median0.4321482075534334
deviation-center-line_median0.15954927868599478


other stats
agent_compute-ego0_max0.012446154808175977
agent_compute-ego0_mean0.01125005368626568
agent_compute-ego0_median0.011244768188113258
agent_compute-ego0_min0.010064523560660224
complete-iteration_max0.2444745043049688
complete-iteration_mean0.21283973732941527
complete-iteration_median0.22198282798327051
complete-iteration_min0.16291878904615129
deviation-center-line_max0.22312966499424747
deviation-center-line_mean0.16355048574709427
deviation-center-line_min0.11197372062214005
deviation-heading_max1.1731765577527429
deviation-heading_mean0.919352453519212
deviation-heading_median0.85924234065638
deviation-heading_min0.7857485750113451
driven_any_max2.100847232339913
driven_any_mean1.5514062152548211
driven_any_median1.5034346079602865
driven_any_min1.0979084127587997
driven_lanedir_consec_max0.9767221791082258
driven_lanedir_consec_mean0.5077475888170035
driven_lanedir_consec_min0.1899717610529219
driven_lanedir_max0.9767221791082258
driven_lanedir_mean0.5077475888170035
driven_lanedir_median0.4321482075534334
driven_lanedir_min0.1899717610529219
get_duckie_state_max0.02493744266444239
get_duckie_state_mean0.017638012772370027
get_duckie_state_median0.020717183896967094
get_duckie_state_min0.004180240631103516
get_robot_state_max0.0037864590513295143
get_robot_state_mean0.003675018253601822
get_robot_state_median0.00368430619407638
get_robot_state_min0.003545001574925014
get_state_dump_max0.008999670373982397
get_state_dump_mean0.007617677049794458
get_state_dump_median0.008163399676605287
get_state_dump_min0.005144238471984863
get_ui_image_max0.03796220279875256
get_ui_image_mean0.03248044131245902
get_ui_image_median0.033284446586673705
get_ui_image_min0.02539066927773612
in-drivable-lane_max4.19999999999999
in-drivable-lane_mean2.637499999999994
in-drivable-lane_min0.7999999999999972
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.100847232339913, "get_ui_image": 0.031965864115747915, "step_physics": 0.11436600315159764, "survival_time": 5.749999999999988, "driven_lanedir": 0.1899717610529219, "get_state_dump": 0.008999670373982397, "get_robot_state": 0.0037864590513295143, "sim_render-ego0": 0.003770536389844171, "get_duckie_state": 0.02493744266444239, "in-drivable-lane": 4.19999999999999, "deviation-heading": 1.1731765577527429, "agent_compute-ego0": 0.012446154808175977, "complete-iteration": 0.21241339116260924, "set_robot_commands": 0.00222917260794804, "deviation-center-line": 0.15862358643039717, "driven_lanedir_consec": 0.1899717610529219, "sim_compute_sim_state": 0.007896314407217091, "sim_compute_performance-ego0": 0.0019110482314537312}, "LFP-norm-zigzag-000-ego0": {"driven_any": 1.88168671303, "get_ui_image": 0.03796220279875256, "step_physics": 0.13121963682628812, "survival_time": 5.1999999999999895, "driven_lanedir": 0.5108322939725443, "get_state_dump": 0.00819445564633324, "get_robot_state": 0.003657143456595285, "sim_render-ego0": 0.0038960116250174384, "get_duckie_state": 0.020988841283889045, "in-drivable-lane": 3.499999999999993, "deviation-heading": 0.8524889084427177, "agent_compute-ego0": 0.01187029339018322, "complete-iteration": 0.23155226480393185, "set_robot_commands": 0.002171128136771066, "deviation-center-line": 0.1604749709415924, "driven_lanedir_consec": 0.5108322939725443, "sim_compute_sim_state": 0.009420985267275856, "sim_compute_performance-ego0": 0.0020644551231747583}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.0979084127587997, "get_ui_image": 0.034603029057599495, "step_physics": 0.146916427474091, "survival_time": 3.399999999999996, "driven_lanedir": 0.9767221791082258, "get_state_dump": 0.008132343706877335, "get_robot_state": 0.003711468931557475, "sim_render-ego0": 0.003694081651991692, "get_duckie_state": 0.020445526510045147, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 0.7857485750113451, "agent_compute-ego0": 0.010619242986043297, "complete-iteration": 0.2444745043049688, "set_robot_commands": 0.002149450606194095, "deviation-center-line": 0.22312966499424747, "driven_lanedir_consec": 0.9767221791082258, "sim_compute_sim_state": 0.012144088745117188, "sim_compute_performance-ego0": 0.0019540268441905146}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.1251825028905729, "get_ui_image": 0.02539066927773612, "step_physics": 0.10188791751861571, "survival_time": 3.4499999999999957, "driven_lanedir": 0.3534641211343226, "get_state_dump": 0.005144238471984863, "get_robot_state": 0.003545001574925014, "sim_render-ego0": 0.003533581324986049, "get_duckie_state": 0.004180240631103516, "in-drivable-lane": 2.049999999999996, "deviation-heading": 0.8659957728700425, "agent_compute-ego0": 0.010064523560660224, "complete-iteration": 0.16291878904615129, "set_robot_commands": 0.00196817261832101, "deviation-center-line": 0.11197372062214005, "driven_lanedir_consec": 0.3534641211343226, "sim_compute_sim_state": 0.005288754190717425, "sim_compute_performance-ego0": 0.0018240656171526228}}
set_robot_commands_max0.00222917260794804
set_robot_commands_mean0.0021294809923085526
set_robot_commands_median0.0021602893714825805
set_robot_commands_min0.00196817261832101
sim_compute_performance-ego0_max0.0020644551231747583
sim_compute_performance-ego0_mean0.0019383989539929068
sim_compute_performance-ego0_median0.001932537537822123
sim_compute_performance-ego0_min0.0018240656171526228
sim_compute_sim_state_max0.012144088745117188
sim_compute_sim_state_mean0.008687535652581891
sim_compute_sim_state_median0.008658649837246474
sim_compute_sim_state_min0.005288754190717425
sim_render-ego0_max0.0038960116250174384
sim_render-ego0_mean0.0037235527479598375
sim_render-ego0_median0.003732309020917931
sim_render-ego0_min0.003533581324986049
simulation-passed1
step_physics_max0.146916427474091
step_physics_mean0.12359749624264812
step_physics_median0.12279281998894288
step_physics_min0.10188791751861571
survival_time_max5.749999999999988
survival_time_mean4.449999999999992
survival_time_min3.399999999999996
No reset possible
5365812724Bea Baselines 🐤template-randomaido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-070:09:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6236439464720721
survival_time_median4.199999999999993
deviation-center-line_median0.09374065272951372
in-drivable-lane_median2.374999999999992


other stats
agent_compute-ego0_max0.012938828081698031
agent_compute-ego0_mean0.011766621025518034
agent_compute-ego0_median0.011719457630143069
agent_compute-ego0_min0.010688740760087969
agent_compute-npc0_max0.025241822004318237
agent_compute-npc0_mean0.02288908414331848
agent_compute-npc0_median0.022414141712156502
agent_compute-npc0_min0.02148623114464267
agent_compute-npc1_max0.03788619105880325
agent_compute-npc1_mean0.03064755917039638
agent_compute-npc1_median0.027726443821951847
agent_compute-npc1_min0.026330042630434036
agent_compute-npc2_max0.03893450788549475
agent_compute-npc2_mean0.03430751711445482
agent_compute-npc2_median0.03666876256465912
agent_compute-npc2_min0.027319280893210597
agent_compute-npc3_max0.04442690685391426
agent_compute-npc3_mean0.04174649076623804
agent_compute-npc3_median0.04174649076623804
agent_compute-npc3_min0.03906607467856183
complete-iteration_max1.1830984810054703
complete-iteration_mean0.8757872549080197
complete-iteration_median0.995665961775828
complete-iteration_min0.3287186150749524
deviation-center-line_max0.1625086232473512
deviation-center-line_mean0.10755206385085148
deviation-center-line_min0.08021832669702722
deviation-heading_max1.3038475144852308
deviation-heading_mean0.570550987527489
deviation-heading_median0.35239451348805684
deviation-heading_min0.27356740864861157
driven_any_max2.8780824148039748
driven_any_mean1.6788425234675728
driven_any_median1.4211362236400564
driven_any_min0.9950152317862034
driven_lanedir_consec_max0.6484239443511952
driven_lanedir_consec_mean0.6261266584774561
driven_lanedir_consec_min0.6087947966144847
driven_lanedir_max0.6484239443511952
driven_lanedir_mean0.6261266584774561
driven_lanedir_median0.6236439464720721
driven_lanedir_min0.6087947966144847
get_duckie_state_max1.9943391954576647e-06
get_duckie_state_mean1.7619811674618608e-06
get_duckie_state_median1.7792511506368651e-06
get_duckie_state_min1.495083173116048e-06
get_robot_state_max0.01762641196282918
get_robot_state_mean0.014479746358673311
get_robot_state_median0.01635172963142395
get_robot_state_min0.007589114209016164
get_state_dump_max0.013260912150144575
get_state_dump_mean0.010297976722147386
get_state_dump_median0.010715057407471178
get_state_dump_min0.0065008799235026045
get_ui_image_max0.0532069057226181
get_ui_image_mean0.04468561953259258
get_ui_image_median0.04689478493636346
get_ui_image_min0.031746002535025276
in-drivable-lane_max5.549999999999981
in-drivable-lane_mean2.724999999999991
in-drivable-lane_min0.6000000000000004
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 1.1668442481887458, "get_ui_image": 0.045349417506037534, "step_physics": 0.672062458218755, "survival_time": 3.649999999999995, "driven_lanedir": 0.6110696011683454, "get_state_dump": 0.010210043675190694, "get_robot_state": 0.015191078186035156, "sim_render-ego0": 0.004042986276987437, "sim_render-npc0": 0.003826808285068821, "sim_render-npc1": 0.004116338652533454, "sim_render-npc2": 0.004049423578623179, "get_duckie_state": 1.9943391954576647e-06, "in-drivable-lane": 1.899999999999994, "deviation-heading": 0.3011164567871895, "agent_compute-ego0": 0.012938828081698031, "agent_compute-npc0": 0.021898562843735155, "agent_compute-npc1": 0.03788619105880325, "agent_compute-npc2": 0.03893450788549475, "complete-iteration": 0.9235473645699992, "set_robot_commands": 0.0023910161611196156, "deviation-center-line": 0.09972462360970276, "driven_lanedir_consec": 0.6110696011683454, "sim_compute_sim_state": 0.0346566696424742, "sim_compute_performance-ego0": 0.0022659333976539405, "sim_compute_performance-npc0": 0.002054304689974398, "sim_compute_performance-npc1": 0.0021802702465572874, "sim_compute_performance-npc2": 0.002151495701557881}, "LFV-norm-zigzag-000-ego0": {"driven_any": 0.9950152317862034, "get_ui_image": 0.0532069057226181, "step_physics": 0.7466300204396248, "survival_time": 3.149999999999997, "driven_lanedir": 0.6087947966144847, "get_state_dump": 0.013260912150144575, "get_robot_state": 0.017512381076812744, "sim_render-ego0": 0.0036792606115341182, "sim_render-npc0": 0.003656607121229172, "sim_render-npc1": 0.003702964633703232, "sim_render-npc2": 0.003797706216573715, "sim_render-npc3": 0.003741968423128128, "get_duckie_state": 1.7471611499786377e-06, "in-drivable-lane": 0.6000000000000004, "deviation-heading": 1.3038475144852308, "agent_compute-ego0": 0.010688740760087969, "agent_compute-npc0": 0.02292972058057785, "agent_compute-npc1": 0.026330042630434036, "agent_compute-npc2": 0.03666876256465912, "agent_compute-npc3": 0.04442690685391426, "complete-iteration": 1.067784558981657, "set_robot_commands": 0.0022610165178775787, "deviation-center-line": 0.1625086232473512, "driven_lanedir_consec": 0.6087947966144847, "sim_compute_sim_state": 0.05623379722237587, "sim_compute_performance-ego0": 0.002051837742328644, "sim_compute_performance-npc0": 0.0019897744059562683, "sim_compute_performance-npc1": 0.0020378828048706055, "sim_compute_performance-npc2": 0.0019752681255340576, "sim_compute_performance-npc3": 0.0019278153777122495}, "LFV-norm-techtrack-000-ego0": {"driven_any": 2.8780824148039748, "get_ui_image": 0.04844015236668939, "step_physics": 0.8854592534519682, "survival_time": 7.399999999999982, "driven_lanedir": 0.6362182917757988, "get_state_dump": 0.011220071139751663, "get_robot_state": 0.01762641196282918, "sim_render-ego0": 0.003749189760860981, "sim_render-npc0": 0.003631489388894715, "sim_render-npc1": 0.0036859352316632368, "sim_render-npc2": 0.0036674697927180553, "sim_render-npc3": 0.003684546323430618, "get_duckie_state": 1.8113411512950923e-06, "in-drivable-lane": 5.549999999999981, "deviation-heading": 0.27356740864861157, "agent_compute-ego0": 0.011722646303624917, "agent_compute-npc0": 0.02148623114464267, "agent_compute-npc1": 0.027726443821951847, "agent_compute-npc2": 0.027319280893210597, "agent_compute-npc3": 0.03906607467856183, "complete-iteration": 1.1830984810054703, "set_robot_commands": 0.0022293977289391843, "deviation-center-line": 0.08775668184932471, "driven_lanedir_consec": 0.6362182917757988, "sim_compute_sim_state": 0.05364508596842721, "sim_compute_performance-ego0": 0.0021349519691211266, "sim_compute_performance-npc0": 0.0018931027226800087, "sim_compute_performance-npc1": 0.0019194071724910864, "sim_compute_performance-npc2": 0.0019215945429449913, "sim_compute_performance-npc3": 0.0019052284675956572}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.6754281990913673, "get_ui_image": 0.031746002535025276, "step_physics": 0.2178677221139272, "survival_time": 4.749999999999991, "driven_lanedir": 0.6484239443511952, "get_state_dump": 0.0065008799235026045, "get_robot_state": 0.007589114209016164, "sim_render-ego0": 0.00383894145488739, "sim_render-npc0": 0.003732413053512573, "get_duckie_state": 1.495083173116048e-06, "in-drivable-lane": 2.84999999999999, "deviation-heading": 0.4036725701889241, "agent_compute-ego0": 0.011716268956661224, "agent_compute-npc0": 0.025241822004318237, "complete-iteration": 0.3287186150749524, "set_robot_commands": 0.0023277848958969116, "deviation-center-line": 0.08021832669702722, "driven_lanedir_consec": 0.6484239443511952, "sim_compute_sim_state": 0.011738883952299752, "sim_compute_performance-ego0": 0.002070168654123942, "sim_compute_performance-npc0": 0.0019257888197898865}}
set_robot_commands_max0.0023910161611196156
set_robot_commands_mean0.0023023038259583225
set_robot_commands_median0.002294400706887245
set_robot_commands_min0.0022293977289391843
sim_compute_performance-ego0_max0.0022659333976539405
sim_compute_performance-ego0_mean0.002130722940806913
sim_compute_performance-ego0_median0.002102560311622534
sim_compute_performance-ego0_min0.002051837742328644
sim_compute_performance-npc0_max0.002054304689974398
sim_compute_performance-npc0_mean0.0019657426596001405
sim_compute_performance-npc0_median0.0019577816128730774
sim_compute_performance-npc0_min0.0018931027226800087
sim_compute_performance-npc1_max0.0021802702465572874
sim_compute_performance-npc1_mean0.002045853407972993
sim_compute_performance-npc1_median0.0020378828048706055
sim_compute_performance-npc1_min0.0019194071724910864
sim_compute_performance-npc2_max0.002151495701557881
sim_compute_performance-npc2_mean0.002016119456678977
sim_compute_performance-npc2_median0.0019752681255340576
sim_compute_performance-npc2_min0.0019215945429449913
sim_compute_performance-npc3_max0.0019278153777122495
sim_compute_performance-npc3_mean0.0019165219226539537
sim_compute_performance-npc3_median0.0019165219226539537
sim_compute_performance-npc3_min0.0019052284675956572
sim_compute_sim_state_max0.05623379722237587
sim_compute_sim_state_mean0.03906860919639426
sim_compute_sim_state_median0.044150877805450704
sim_compute_sim_state_min0.011738883952299752
sim_render-ego0_max0.004042986276987437
sim_render-ego0_mean0.003827594526067482
sim_render-ego0_median0.003794065607874185
sim_render-ego0_min0.0036792606115341182
sim_render-npc0_max0.003826808285068821
sim_render-npc0_mean0.003711829462176321
sim_render-npc0_median0.003694510087370873
sim_render-npc0_min0.003631489388894715
sim_render-npc1_max0.004116338652533454
sim_render-npc1_mean0.003835079505966641
sim_render-npc1_median0.003702964633703232
sim_render-npc1_min0.0036859352316632368
sim_render-npc2_max0.004049423578623179
sim_render-npc2_mean0.0038381998626383167
sim_render-npc2_median0.003797706216573715
sim_render-npc2_min0.0036674697927180553
sim_render-npc3_max0.003741968423128128
sim_render-npc3_mean0.003713257373279373
sim_render-npc3_median0.003713257373279373
sim_render-npc3_min0.003684546323430618
simulation-passed1
step_physics_max0.8854592534519682
step_physics_mean0.6305048635560688
step_physics_median0.7093462393291898
step_physics_min0.2178677221139272
survival_time_max7.399999999999982
survival_time_mean4.737499999999992
survival_time_min3.149999999999997
No reset possible
5365312725Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-070:03:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2999735197577017
survival_time_median1.7750000000000008
deviation-center-line_median0.16116976962533835
in-drivable-lane_median0.37500000000000033


other stats
agent_compute-ego0_max0.012412363290786745
agent_compute-ego0_mean0.012248445369980552
agent_compute-ego0_median0.012248445369980552
agent_compute-ego0_min0.01208452744917436
agent_compute-npc0_max0.05218157172203064
agent_compute-npc0_mean0.043081375234054795
agent_compute-npc0_median0.043081375234054795
agent_compute-npc0_min0.033981178746078956
agent_compute-npc1_max0.05498137474060059
agent_compute-npc1_mean0.043092474070462315
agent_compute-npc1_median0.043092474070462315
agent_compute-npc1_min0.03120357340032404
agent_compute-npc2_max0.05561168789863587
agent_compute-npc2_mean0.04388406321857915
agent_compute-npc2_median0.04388406321857915
agent_compute-npc2_min0.03215643853852243
complete-iteration_max0.9987709224224092
complete-iteration_mean0.9241651942332584
complete-iteration_median0.9241651942332584
complete-iteration_min0.849559466044108
deviation-center-line_max0.2029614423431128
deviation-center-line_mean0.16116976962533835
deviation-center-line_min0.1193780969075639
deviation-heading_max0.42290029630167686
deviation-heading_mean0.33090990458760183
deviation-heading_median0.33090990458760183
deviation-heading_min0.2389195128735269
driven_any_max0.3866220460800679
driven_any_mean0.31982841800446105
driven_any_median0.31982841800446105
driven_any_min0.2530347899288541
driven_lanedir_consec_max0.3549885974886773
driven_lanedir_consec_mean0.2999735197577017
driven_lanedir_consec_min0.24495844202672612
driven_lanedir_max0.3549885974886773
driven_lanedir_mean0.2999735197577017
driven_lanedir_median0.2999735197577017
driven_lanedir_min0.24495844202672612
get_duckie_state_max1.806020736694336e-06
get_duckie_state_mean1.7158009789206766e-06
get_duckie_state_median1.7158009789206766e-06
get_duckie_state_min1.625581221147017e-06
get_robot_state_max0.01494249701499939
get_robot_state_mean0.01488653231750835
get_robot_state_median0.01488653231750835
get_robot_state_min0.014830567620017311
get_state_dump_max0.010236126003843365
get_state_dump_mean0.010038781075766593
get_state_dump_median0.010038781075766593
get_state_dump_min0.00984143614768982
get_ui_image_max0.05678275227546692
get_ui_image_mean0.05648594236735142
get_ui_image_median0.05648594236735142
get_ui_image_min0.05618913245923592
in-drivable-lane_max0.7500000000000007
in-drivable-lane_mean0.37500000000000033
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 0.2530347899288541, "get_ui_image": 0.05618913245923592, "step_physics": 0.5878319306807085, "survival_time": 1.6000000000000008, "driven_lanedir": 0.24495844202672612, "get_state_dump": 0.010236126003843365, "get_robot_state": 0.014830567620017311, "sim_render-ego0": 0.0037932395935058594, "sim_render-npc0": 0.003760113860621597, "sim_render-npc1": 0.0037503964973218513, "sim_render-npc2": 0.0037221402832956023, "get_duckie_state": 1.625581221147017e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.42290029630167686, "agent_compute-ego0": 0.01208452744917436, "agent_compute-npc0": 0.033981178746078956, "agent_compute-npc1": 0.03120357340032404, "agent_compute-npc2": 0.03215643853852243, "complete-iteration": 0.849559466044108, "set_robot_commands": 0.0023989099444765034, "deviation-center-line": 0.2029614423431128, "driven_lanedir_consec": 0.24495844202672612, "sim_compute_sim_state": 0.03836893312858813, "sim_compute_performance-ego0": 0.0021219976020581794, "sim_compute_performance-npc0": 0.0019881075078790836, "sim_compute_performance-npc1": 0.001944773124926018, "sim_compute_performance-npc2": 0.0020545901674212832}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.3866220460800679, "get_ui_image": 0.05678275227546692, "step_physics": 0.666094321012497, "survival_time": 1.950000000000001, "driven_lanedir": 0.3549885974886773, "get_state_dump": 0.00984143614768982, "get_robot_state": 0.01494249701499939, "sim_render-ego0": 0.004200994968414307, "sim_render-npc0": 0.003925424814224243, "sim_render-npc1": 0.0039028525352478023, "sim_render-npc2": 0.00408015251159668, "get_duckie_state": 1.806020736694336e-06, "in-drivable-lane": 0.7500000000000007, "deviation-heading": 0.2389195128735269, "agent_compute-ego0": 0.012412363290786745, "agent_compute-npc0": 0.05218157172203064, "agent_compute-npc1": 0.05498137474060059, "agent_compute-npc2": 0.05561168789863587, "complete-iteration": 0.9987709224224092, "set_robot_commands": 0.0025181591510772703, "deviation-center-line": 0.1193780969075639, "driven_lanedir_consec": 0.3549885974886773, "sim_compute_sim_state": 0.04164120554924011, "sim_compute_performance-ego0": 0.002283066511154175, "sim_compute_performance-npc0": 0.0019930899143218994, "sim_compute_performance-npc1": 0.0020612657070159914, "sim_compute_performance-npc2": 0.002149921655654907}}
set_robot_commands_max0.0025181591510772703
set_robot_commands_mean0.002458534547776887
set_robot_commands_median0.002458534547776887
set_robot_commands_min0.0023989099444765034
sim_compute_performance-ego0_max0.002283066511154175
sim_compute_performance-ego0_mean0.0022025320566061773
sim_compute_performance-ego0_median0.0022025320566061773
sim_compute_performance-ego0_min0.0021219976020581794
sim_compute_performance-npc0_max0.0019930899143218994
sim_compute_performance-npc0_mean0.0019905987111004915
sim_compute_performance-npc0_median0.0019905987111004915
sim_compute_performance-npc0_min0.0019881075078790836
sim_compute_performance-npc1_max0.0020612657070159914
sim_compute_performance-npc1_mean0.0020030194159710046
sim_compute_performance-npc1_median0.0020030194159710046
sim_compute_performance-npc1_min0.001944773124926018
sim_compute_performance-npc2_max0.002149921655654907
sim_compute_performance-npc2_mean0.002102255911538095
sim_compute_performance-npc2_median0.002102255911538095
sim_compute_performance-npc2_min0.0020545901674212832
sim_compute_sim_state_max0.04164120554924011
sim_compute_sim_state_mean0.04000506933891412
sim_compute_sim_state_median0.04000506933891412
sim_compute_sim_state_min0.03836893312858813
sim_render-ego0_max0.004200994968414307
sim_render-ego0_mean0.003997117280960083
sim_render-ego0_median0.003997117280960083
sim_render-ego0_min0.0037932395935058594
sim_render-npc0_max0.003925424814224243
sim_render-npc0_mean0.00384276933742292
sim_render-npc0_median0.00384276933742292
sim_render-npc0_min0.003760113860621597
sim_render-npc1_max0.0039028525352478023
sim_render-npc1_mean0.003826624516284827
sim_render-npc1_median0.003826624516284827
sim_render-npc1_min0.0037503964973218513
sim_render-npc2_max0.00408015251159668
sim_render-npc2_mean0.0039011463974461414
sim_render-npc2_median0.0039011463974461414
sim_render-npc2_min0.0037221402832956023
simulation-passed1
step_physics_max0.666094321012497
step_physics_mean0.6269631258466027
step_physics_median0.6269631258466027
step_physics_min0.5878319306807085
survival_time_max1.950000000000001
survival_time_mean1.7750000000000008
survival_time_min1.6000000000000008
No reset possible
5359712589Bea Baselines 🐤template-rosaido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-070:16:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6250097938549953
survival_time_median5.649999999999988
deviation-center-line_median0.1164022593463267
in-drivable-lane_median3.87499999999999


other stats
agent_compute-ego0_max0.014070938373434132
agent_compute-ego0_mean0.013231239269859594
agent_compute-ego0_median0.013366530950394645
agent_compute-ego0_min0.012120956805214952
agent_compute-npc0_max0.025546967006120525
agent_compute-npc0_mean0.023887455191586675
agent_compute-npc0_median0.023964892962159368
agent_compute-npc0_min0.02207306783590744
agent_compute-npc1_max0.03606171169500241
agent_compute-npc1_mean0.030828194767307818
agent_compute-npc1_median0.028664698351675004
agent_compute-npc1_min0.027758174255246022
agent_compute-npc2_max0.03652492884931893
agent_compute-npc2_mean0.03342678514995143
agent_compute-npc2_median0.03578714269106505
agent_compute-npc2_min0.027968283909470287
agent_compute-npc3_max0.048600175341621775
agent_compute-npc3_mean0.044667392006590104
agent_compute-npc3_median0.044667392006590104
agent_compute-npc3_min0.04073460867155844
complete-iteration_max1.3283309660740752
complete-iteration_mean0.9681452011995452
complete-iteration_median1.08982005345298
complete-iteration_min0.3646097318181451
deviation-center-line_max0.19684364267826177
deviation-center-line_mean0.12764289756334452
deviation-center-line_min0.08092342888246296
deviation-heading_max0.8386449545897601
deviation-heading_mean0.5708904735742475
deviation-heading_median0.5131319134325493
deviation-heading_min0.41865311284213136
driven_any_max3.736894184662736
driven_any_mean1.9061393767360657
driven_any_median1.42874450582083
driven_any_min1.030174310639866
driven_lanedir_consec_max0.7456126059061416
driven_lanedir_consec_mean0.5694628168490994
driven_lanedir_consec_min0.28221907378026545
driven_lanedir_max0.7456126059061416
driven_lanedir_mean0.5694628168490994
driven_lanedir_median0.6250097938549953
driven_lanedir_min0.28221907378026545
get_duckie_state_max2.4581777638402477e-06
get_duckie_state_mean1.905292666870776e-06
get_duckie_state_median1.7987637581672416e-06
get_duckie_state_min1.5654653873083727e-06
get_robot_state_max0.018919931083429056
get_robot_state_mean0.01493692146438358
get_robot_state_median0.0166245559554788
get_robot_state_min0.007578642863147664
get_state_dump_max0.01182500847050401
get_state_dump_mean0.009798903775241856
get_state_dump_median0.010391128913966432
get_state_dump_min0.00658834880253054
get_ui_image_max0.05860304441608367
get_ui_image_mean0.046781247672924214
get_ui_image_median0.04787329909404323
get_ui_image_min0.03277534808752672
in-drivable-lane_max10.400000000000055
in-drivable-lane_mean4.937500000000008
in-drivable-lane_min1.5999999999999943
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 1.030174310639866, "get_ui_image": 0.04460225982227545, "step_physics": 0.7157176664505882, "survival_time": 4.299999999999993, "driven_lanedir": 0.7075865652060018, "get_state_dump": 0.009858564398754602, "get_robot_state": 0.01534120241800944, "sim_render-ego0": 0.003902583286680024, "sim_render-npc0": 0.004054159953676421, "sim_render-npc1": 0.003911843245056854, "sim_render-npc2": 0.004014568767328372, "get_duckie_state": 2.4581777638402477e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 0.41865311284213136, "agent_compute-ego0": 0.014070938373434132, "agent_compute-npc0": 0.022540843349763716, "agent_compute-npc1": 0.03606171169500241, "agent_compute-npc2": 0.03652492884931893, "complete-iteration": 0.96503724174938, "set_robot_commands": 0.0024359582484453574, "deviation-center-line": 0.14465254525933224, "driven_lanedir_consec": 0.7075865652060018, "sim_compute_sim_state": 0.03608848582739117, "sim_compute_performance-ego0": 0.002265113523636741, "sim_compute_performance-npc0": 0.0020868641206587867, "sim_compute_performance-npc1": 0.0021521113384729146, "sim_compute_performance-npc2": 0.00209819037338783}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.58227866155815, "get_ui_image": 0.05860304441608367, "step_physics": 0.8616826964206383, "survival_time": 6.0499999999999865, "driven_lanedir": 0.5424330225039888, "get_state_dump": 0.01182500847050401, "get_robot_state": 0.018919931083429056, "sim_render-ego0": 0.0040857498763037505, "sim_render-npc0": 0.00388012948583384, "sim_render-npc1": 0.004135110339180368, "sim_render-npc2": 0.003956106842541304, "sim_render-npc3": 0.004096222705528384, "get_duckie_state": 1.7373288264040087e-06, "in-drivable-lane": 3.8499999999999894, "deviation-heading": 0.8386449545897601, "agent_compute-ego0": 0.01363400553093582, "agent_compute-npc0": 0.025546967006120525, "agent_compute-npc1": 0.027758174255246022, "agent_compute-npc2": 0.03578714269106505, "agent_compute-npc3": 0.048600175341621775, "complete-iteration": 1.21460286515658, "set_robot_commands": 0.002488265272046699, "deviation-center-line": 0.19684364267826177, "driven_lanedir_consec": 0.5424330225039888, "sim_compute_sim_state": 0.06843462732971692, "sim_compute_performance-ego0": 0.0022838643339813734, "sim_compute_performance-npc0": 0.00205354416956667, "sim_compute_performance-npc1": 0.0022069665252185257, "sim_compute_performance-npc2": 0.002143640987208632, "sim_compute_performance-npc3": 0.002200415877045178}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.736894184662736, "get_ui_image": 0.05114433836581102, "step_physics": 1.0209452901313554, "survival_time": 13.350000000000056, "driven_lanedir": 0.7456126059061416, "get_state_dump": 0.010923693429178266, "get_robot_state": 0.01790790949294816, "sim_render-ego0": 0.003824202872034329, "sim_render-npc0": 0.0036741601887033946, "sim_render-npc1": 0.003872834924441665, "sim_render-npc2": 0.003859659629081613, "sim_render-npc3": 0.0038221967754079335, "get_duckie_state": 1.8601986899304744e-06, "in-drivable-lane": 10.400000000000055, "deviation-heading": 0.4958516055086309, "agent_compute-ego0": 0.012120956805214952, "agent_compute-npc0": 0.02207306783590744, "agent_compute-npc1": 0.028664698351675004, "agent_compute-npc2": 0.027968283909470287, "agent_compute-npc3": 0.04073460867155844, "complete-iteration": 1.3283309660740752, "set_robot_commands": 0.002322398904544204, "deviation-center-line": 0.08815197343332117, "driven_lanedir_consec": 0.7456126059061416, "sim_compute_sim_state": 0.05473702256359271, "sim_compute_performance-ego0": 0.002159615950797921, "sim_compute_performance-npc0": 0.0019613895843278114, "sim_compute_performance-npc1": 0.002071635936623189, "sim_compute_performance-npc2": 0.0020880031941541985, "sim_compute_performance-npc3": 0.0020545694365430235}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.27521035008351, "get_ui_image": 0.03277534808752672, "step_physics": 0.25061867821891354, "survival_time": 5.249999999999989, "driven_lanedir": 0.28221907378026545, "get_state_dump": 0.00658834880253054, "get_robot_state": 0.007578642863147664, "sim_render-ego0": 0.003958211754852871, "sim_render-npc0": 0.0038209141425366673, "get_duckie_state": 1.5654653873083727e-06, "in-drivable-lane": 3.899999999999989, "deviation-heading": 0.5304122213564676, "agent_compute-ego0": 0.01309905636985347, "agent_compute-npc0": 0.02538894257455502, "complete-iteration": 0.3646097318181451, "set_robot_commands": 0.0023726314868567125, "deviation-center-line": 0.08092342888246296, "driven_lanedir_consec": 0.28221907378026545, "sim_compute_sim_state": 0.01181609900492542, "sim_compute_performance-ego0": 0.002125099020184211, "sim_compute_performance-npc0": 0.002020682928697118}}
set_robot_commands_max0.002488265272046699
set_robot_commands_mean0.002404813477973243
set_robot_commands_median0.0024042948676510347
set_robot_commands_min0.002322398904544204
sim_compute_performance-ego0_max0.0022838643339813734
sim_compute_performance-ego0_mean0.002208423207150062
sim_compute_performance-ego0_median0.002212364737217331
sim_compute_performance-ego0_min0.002125099020184211
sim_compute_performance-npc0_max0.0020868641206587867
sim_compute_performance-npc0_mean0.0020306202008125965
sim_compute_performance-npc0_median0.002037113549131894
sim_compute_performance-npc0_min0.0019613895843278114
sim_compute_performance-npc1_max0.0022069665252185257
sim_compute_performance-npc1_mean0.002143571266771543
sim_compute_performance-npc1_median0.0021521113384729146
sim_compute_performance-npc1_min0.002071635936623189
sim_compute_performance-npc2_max0.002143640987208632
sim_compute_performance-npc2_mean0.0021099448515835536
sim_compute_performance-npc2_median0.00209819037338783
sim_compute_performance-npc2_min0.0020880031941541985
sim_compute_performance-npc3_max0.002200415877045178
sim_compute_performance-npc3_mean0.002127492656794101
sim_compute_performance-npc3_median0.002127492656794101
sim_compute_performance-npc3_min0.0020545694365430235
sim_compute_sim_state_max0.06843462732971692
sim_compute_sim_state_mean0.042769058681406555
sim_compute_sim_state_median0.04541275419549194
sim_compute_sim_state_min0.01181609900492542
sim_render-ego0_max0.0040857498763037505
sim_render-ego0_mean0.003942686947467744
sim_render-ego0_median0.003930397520766448
sim_render-ego0_min0.003824202872034329
sim_render-npc0_max0.004054159953676421
sim_render-npc0_mean0.0038573409426875807
sim_render-npc0_median0.003850521814185254
sim_render-npc0_min0.0036741601887033946
sim_render-npc1_max0.004135110339180368
sim_render-npc1_mean0.003973262836226296
sim_render-npc1_median0.003911843245056854
sim_render-npc1_min0.003872834924441665
sim_render-npc2_max0.004014568767328372
sim_render-npc2_mean0.00394344507965043
sim_render-npc2_median0.003956106842541304
sim_render-npc2_min0.003859659629081613
sim_render-npc3_max0.004096222705528384
sim_render-npc3_mean0.003959209740468159
sim_render-npc3_median0.003959209740468159
sim_render-npc3_min0.0038221967754079335
simulation-passed1
step_physics_max1.0209452901313554
step_physics_mean0.7122410828053738
step_physics_median0.7887001814356133
step_physics_min0.25061867821891354
survival_time_max13.350000000000056
survival_time_mean7.237500000000006
survival_time_min4.299999999999993
No reset possible
5358712594Bea Baselines 🐤template-randomaido5-LFV-sim-validationLFVv-simabortedyesnogpu-prod-070:00:52
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5355812599Bea Baselines 🐤template-randomaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-070:13:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3386162956066159
survival_time_median7.199999999999982
deviation-center-line_median0.13150150834523444
in-drivable-lane_median5.1749999999999865


other stats
agent_compute-ego0_max0.012641669877993516
agent_compute-ego0_mean0.011619659240911377
agent_compute-ego0_median0.011586026350657143
agent_compute-ego0_min0.010894076992767026
agent_compute-ego1_max0.012019065470477337
agent_compute-ego1_mean0.011592224318034423
agent_compute-ego1_median0.011796319895777207
agent_compute-ego1_min0.010376951911232689
complete-iteration_max0.84176705865299
complete-iteration_mean0.6831705662735861
complete-iteration_median0.7620218211206896
complete-iteration_min0.24837218390570748
deviation-center-line_max1.1793353551209578
deviation-center-line_mean0.19682735223382447
deviation-center-line_min0.03781627258124975
deviation-heading_max4.13206271019058
deviation-heading_mean1.0463262829209203
deviation-heading_median0.9402685921450354
deviation-heading_min0.291348286294811
driven_any_max2.951704478527868
driven_any_mean1.9134596982041032
driven_any_median1.760372794839244
driven_any_min0.18489783262536005
driven_lanedir_consec_max0.7960762545928977
driven_lanedir_consec_mean0.3518580104312197
driven_lanedir_consec_min0.10162466951715476
driven_lanedir_max0.7960762545928977
driven_lanedir_mean0.3521650626338418
driven_lanedir_median0.3407656610249702
driven_lanedir_min0.10162466951715476
get_duckie_state_max1.6163135397023167e-06
get_duckie_state_mean1.4900677237258853e-06
get_duckie_state_median1.58789890264374e-06
get_duckie_state_min1.2643409497810132e-06
get_robot_state_max0.014383085412916797
get_robot_state_mean0.013315912863589296
get_robot_state_median0.014343879962789602
get_robot_state_min0.007291186939586292
get_state_dump_max0.009861692888983364
get_state_dump_mean0.009198123049686686
get_state_dump_median0.009716502981248244
get_state_dump_min0.006299962901105785
get_ui_image_max0.04981537029660981
get_ui_image_mean0.0448571658564264
get_ui_image_median0.0476071226830576
get_ui_image_min0.0295934026891535
in-drivable-lane_max6.599999999999981
in-drivable-lane_mean4.764285714285701
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.274124355035624, "get_ui_image": 0.04478088617324829, "step_physics": 0.4956331471602122, "survival_time": 5.949999999999987, "driven_lanedir": 0.7960762545928977, "get_state_dump": 0.009465253353118897, "get_robot_state": 0.014233136177062988, "sim_render-ego0": 0.003792136907577514, "sim_render-ego1": 0.0037997086842854817, "sim_render-ego2": 0.003740183512369792, "sim_render-ego3": 0.00367203156153361, "get_duckie_state": 1.3788541158040364e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.9316977066482196, "agent_compute-ego0": 0.011586026350657143, "agent_compute-ego1": 0.011568923791249594, "agent_compute-ego2": 0.012310824791590373, "agent_compute-ego3": 0.011521265904108685, "complete-iteration": 0.663122010231018, "set_robot_commands": 0.0022539734840393067, "deviation-center-line": 0.23307611918600285, "driven_lanedir_consec": 0.7960762545928977, "sim_compute_sim_state": 0.019973695278167725, "sim_compute_performance-ego0": 0.002052334944407145, "sim_compute_performance-ego1": 0.001967062552769979, "sim_compute_performance-ego2": 0.0019204159577687584, "sim_compute_performance-ego3": 0.0019391914208730064}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.7771107787938447, "get_ui_image": 0.04478088617324829, "step_physics": 0.4956331471602122, "survival_time": 5.949999999999987, "driven_lanedir": 0.4079052940890945, "get_state_dump": 0.009465253353118897, "get_robot_state": 0.014233136177062988, "sim_render-ego0": 0.003792136907577514, "sim_render-ego1": 0.0037997086842854817, "sim_render-ego2": 0.003740183512369792, "sim_render-ego3": 0.00367203156153361, "get_duckie_state": 1.3788541158040364e-06, "in-drivable-lane": 4.64999999999999, "deviation-heading": 0.5815629454748248, "agent_compute-ego0": 0.011586026350657143, "agent_compute-ego1": 0.011568923791249594, "agent_compute-ego2": 0.012310824791590373, "agent_compute-ego3": 0.011521265904108685, "complete-iteration": 0.663122010231018, "set_robot_commands": 0.0022539734840393067, "deviation-center-line": 0.15345155549638095, "driven_lanedir_consec": 0.4079052940890945, "sim_compute_sim_state": 0.019973695278167725, "sim_compute_performance-ego0": 0.002052334944407145, "sim_compute_performance-ego1": 0.001967062552769979, "sim_compute_performance-ego2": 0.0019204159577687584, "sim_compute_performance-ego3": 0.0019391914208730064}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.615892599054939, "get_ui_image": 0.04478088617324829, "step_physics": 0.4956331471602122, "survival_time": 5.949999999999987, "driven_lanedir": 0.3409414151275487, "get_state_dump": 0.009465253353118897, "get_robot_state": 0.014233136177062988, "sim_render-ego0": 0.003792136907577514, "sim_render-ego1": 0.0037997086842854817, "sim_render-ego2": 0.003740183512369792, "sim_render-ego3": 0.00367203156153361, "get_duckie_state": 1.3788541158040364e-06, "in-drivable-lane": 4.599999999999988, "deviation-heading": 0.9488394776418512, "agent_compute-ego0": 0.011586026350657143, "agent_compute-ego1": 0.011568923791249594, "agent_compute-ego2": 0.012310824791590373, "agent_compute-ego3": 0.011521265904108685, "complete-iteration": 0.663122010231018, "set_robot_commands": 0.0022539734840393067, "deviation-center-line": 0.09422141413744677, "driven_lanedir_consec": 0.3409414151275487, "sim_compute_sim_state": 0.019973695278167725, "sim_compute_performance-ego0": 0.002052334944407145, "sim_compute_performance-ego1": 0.001967062552769979, "sim_compute_performance-ego2": 0.0019204159577687584, "sim_compute_performance-ego3": 0.0019391914208730064}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.6398074009825068, "get_ui_image": 0.04478088617324829, "step_physics": 0.4956331471602122, "survival_time": 5.949999999999987, "driven_lanedir": 0.21369386022737347, "get_state_dump": 0.009465253353118897, "get_robot_state": 0.014233136177062988, "sim_render-ego0": 0.003792136907577514, "sim_render-ego1": 0.0037997086842854817, "sim_render-ego2": 0.003740183512369792, "sim_render-ego3": 0.00367203156153361, "get_duckie_state": 1.3788541158040364e-06, "in-drivable-lane": 5.099999999999986, "deviation-heading": 0.36485645822221113, "agent_compute-ego0": 0.011586026350657143, "agent_compute-ego1": 0.011568923791249594, "agent_compute-ego2": 0.012310824791590373, "agent_compute-ego3": 0.011521265904108685, "complete-iteration": 0.663122010231018, "set_robot_commands": 0.0022539734840393067, "deviation-center-line": 0.06914054888435704, "driven_lanedir_consec": 0.21369386022737347, "sim_compute_sim_state": 0.019973695278167725, "sim_compute_performance-ego0": 0.002052334944407145, "sim_compute_performance-ego1": 0.001967062552769979, "sim_compute_performance-ego2": 0.0019204159577687584, "sim_compute_performance-ego3": 0.0019391914208730064}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.5559095507228855, "get_ui_image": 0.04981537029660981, "step_physics": 0.5775430662878629, "survival_time": 7.199999999999982, "driven_lanedir": 0.16582071872096904, "get_state_dump": 0.009861692888983364, "get_robot_state": 0.014343879962789602, "sim_render-ego0": 0.0036975581070472457, "sim_render-ego1": 0.003694031156342605, "sim_render-ego2": 0.003670358657836914, "sim_render-ego3": 0.0036738494346881738, "get_duckie_state": 1.6163135397023167e-06, "in-drivable-lane": 6.449999999999982, "deviation-heading": 0.3586823355775982, "agent_compute-ego0": 0.010994072618155644, "agent_compute-ego1": 0.011796319895777207, "agent_compute-ego2": 0.011814273636916587, "agent_compute-ego3": 0.011576396021349676, "complete-iteration": 0.7620218211206896, "set_robot_commands": 0.002102616737628805, "deviation-center-line": 0.059631431224197985, "driven_lanedir_consec": 0.16582071872096904, "sim_compute_sim_state": 0.032621891745205585, "sim_compute_performance-ego0": 0.002158740471149313, "sim_compute_performance-ego1": 0.0019012451171875, "sim_compute_performance-ego2": 0.0018770316551471576, "sim_compute_performance-ego3": 0.001924917615693191}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.8734985354242055, "get_ui_image": 0.04981537029660981, "step_physics": 0.5775430662878629, "survival_time": 7.199999999999982, "driven_lanedir": 0.19265203980442447, "get_state_dump": 0.009861692888983364, "get_robot_state": 0.014343879962789602, "sim_render-ego0": 0.0036975581070472457, "sim_render-ego1": 0.003694031156342605, "sim_render-ego2": 0.003670358657836914, "sim_render-ego3": 0.0036738494346881738, "get_duckie_state": 1.6163135397023167e-06, "in-drivable-lane": 5.949999999999984, "deviation-heading": 1.2444813548952531, "agent_compute-ego0": 0.010994072618155644, "agent_compute-ego1": 0.011796319895777207, "agent_compute-ego2": 0.011814273636916587, "agent_compute-ego3": 0.011576396021349676, "complete-iteration": 0.7620218211206896, "set_robot_commands": 0.002102616737628805, "deviation-center-line": 0.09612169677476312, "driven_lanedir_consec": 0.19265203980442447, "sim_compute_sim_state": 0.032621891745205585, "sim_compute_performance-ego0": 0.002158740471149313, "sim_compute_performance-ego1": 0.0019012451171875, "sim_compute_performance-ego2": 0.0018770316551471576, "sim_compute_performance-ego3": 0.001924917615693191}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 2.3178974013322633, "get_ui_image": 0.04981537029660981, "step_physics": 0.5775430662878629, "survival_time": 7.199999999999982, "driven_lanedir": 0.10162466951715476, "get_state_dump": 0.009861692888983364, "get_robot_state": 0.014343879962789602, "sim_render-ego0": 0.0036975581070472457, "sim_render-ego1": 0.003694031156342605, "sim_render-ego2": 0.003670358657836914, "sim_render-ego3": 0.0036738494346881738, "get_duckie_state": 1.6163135397023167e-06, "in-drivable-lane": 6.499999999999982, "deviation-heading": 0.5541987636288823, "agent_compute-ego0": 0.010994072618155644, "agent_compute-ego1": 0.011796319895777207, "agent_compute-ego2": 0.011814273636916587, "agent_compute-ego3": 0.011576396021349676, "complete-iteration": 0.7620218211206896, "set_robot_commands": 0.002102616737628805, "deviation-center-line": 0.03781627258124975, "driven_lanedir_consec": 0.10162466951715476, "sim_compute_sim_state": 0.032621891745205585, "sim_compute_performance-ego0": 0.002158740471149313, "sim_compute_performance-ego1": 0.0019012451171875, "sim_compute_performance-ego2": 0.0018770316551471576, "sim_compute_performance-ego3": 0.001924917615693191}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.7765427252108315, "get_ui_image": 0.04981537029660981, "step_physics": 0.5775430662878629, "survival_time": 7.199999999999982, "driven_lanedir": 0.6452515830462522, "get_state_dump": 0.009861692888983364, "get_robot_state": 0.014343879962789602, "sim_render-ego0": 0.0036975581070472457, "sim_render-ego1": 0.003694031156342605, "sim_render-ego2": 0.003670358657836914, "sim_render-ego3": 0.0036738494346881738, "get_duckie_state": 1.6163135397023167e-06, "in-drivable-lane": 5.249999999999986, "deviation-heading": 0.9734465477255804, "agent_compute-ego0": 0.010994072618155644, "agent_compute-ego1": 0.011796319895777207, "agent_compute-ego2": 0.011814273636916587, "agent_compute-ego3": 0.011576396021349676, "complete-iteration": 0.7620218211206896, "set_robot_commands": 0.002102616737628805, "deviation-center-line": 0.1436614022182105, "driven_lanedir_consec": 0.6452515830462522, "sim_compute_sim_state": 0.032621891745205585, "sim_compute_performance-ego0": 0.002158740471149313, "sim_compute_performance-ego1": 0.0019012451171875, "sim_compute_performance-ego2": 0.0018770316551471576, "sim_compute_performance-ego3": 0.001924917615693191}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.18489783262536005, "get_ui_image": 0.0476071226830576, "step_physics": 0.6637986438726288, "survival_time": 7.599999999999981, "driven_lanedir": 0.16126759294861004, "get_state_dump": 0.009716502981248244, "get_robot_state": 0.014383085412916797, "sim_render-ego0": 0.0039649960262323515, "sim_render-ego1": 0.003918814503289516, "sim_render-ego2": 0.003778805140576331, "sim_render-ego3": 0.003845464170368668, "get_duckie_state": 1.58789890264374e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.13206271019058, "agent_compute-ego0": 0.012641669877993516, "agent_compute-ego1": 0.012019065470477337, "agent_compute-ego2": 0.011672674440870098, "agent_compute-ego3": 0.01211857328227922, "complete-iteration": 0.84176705865299, "set_robot_commands": 0.002227086646884095, "deviation-center-line": 1.1793353551209578, "driven_lanedir_consec": 0.16126759294861004, "sim_compute_sim_state": 0.024664155798020705, "sim_compute_performance-ego0": 0.0022166507696014604, "sim_compute_performance-ego1": 0.0020056440939311107, "sim_compute_performance-ego2": 0.0020099387449376725, "sim_compute_performance-ego3": 0.0020150966893613727}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.7205864887254294, "get_ui_image": 0.0476071226830576, "step_physics": 0.6637986438726288, "survival_time": 7.599999999999981, "driven_lanedir": 0.34433052196676683, "get_state_dump": 0.009716502981248244, "get_robot_state": 0.014383085412916797, "sim_render-ego0": 0.0039649960262323515, "sim_render-ego1": 0.003918814503289516, "sim_render-ego2": 0.003778805140576331, "sim_render-ego3": 0.003845464170368668, "get_duckie_state": 1.58789890264374e-06, "in-drivable-lane": 6.049999999999983, "deviation-heading": 1.1722790788608328, "agent_compute-ego0": 0.012641669877993516, "agent_compute-ego1": 0.012019065470477337, "agent_compute-ego2": 0.011672674440870098, "agent_compute-ego3": 0.01211857328227922, "complete-iteration": 0.84176705865299, "set_robot_commands": 0.002227086646884095, "deviation-center-line": 0.1193416144722584, "driven_lanedir_consec": 0.34433052196676683, "sim_compute_sim_state": 0.024664155798020705, "sim_compute_performance-ego0": 0.0022166507696014604, "sim_compute_performance-ego1": 0.0020056440939311107, "sim_compute_performance-ego2": 0.0020099387449376725, "sim_compute_performance-ego3": 0.0020150966893613727}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.7436348108846431, "get_ui_image": 0.0476071226830576, "step_physics": 0.6637986438726288, "survival_time": 7.599999999999981, "driven_lanedir": 0.3484125379459806, "get_state_dump": 0.009716502981248244, "get_robot_state": 0.014383085412916797, "sim_render-ego0": 0.0039649960262323515, "sim_render-ego1": 0.003918814503289516, "sim_render-ego2": 0.003778805140576331, "sim_render-ego3": 0.003845464170368668, "get_duckie_state": 1.58789890264374e-06, "in-drivable-lane": 6.049999999999981, "deviation-heading": 0.9782946667514604, "agent_compute-ego0": 0.012641669877993516, "agent_compute-ego1": 0.012019065470477337, "agent_compute-ego2": 0.011672674440870098, "agent_compute-ego3": 0.01211857328227922, "complete-iteration": 0.84176705865299, "set_robot_commands": 0.002227086646884095, "deviation-center-line": 0.14721758995799067, "driven_lanedir_consec": 0.3484125379459806, "sim_compute_sim_state": 0.024664155798020705, "sim_compute_performance-ego0": 0.0022166507696014604, "sim_compute_performance-ego1": 0.0020056440939311107, "sim_compute_performance-ego2": 0.0020099387449376725, "sim_compute_performance-ego3": 0.0020150966893613727}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.951704478527868, "get_ui_image": 0.0476071226830576, "step_physics": 0.6637986438726288, "survival_time": 7.599999999999981, "driven_lanedir": 0.2576470504888566, "get_state_dump": 0.009716502981248244, "get_robot_state": 0.014383085412916797, "sim_render-ego0": 0.0039649960262323515, "sim_render-ego1": 0.003918814503289516, "sim_render-ego2": 0.003778805140576331, "sim_render-ego3": 0.003845464170368668, "get_duckie_state": 1.58789890264374e-06, "in-drivable-lane": 6.599999999999981, "deviation-heading": 0.3481560818464254, "agent_compute-ego0": 0.012641669877993516, "agent_compute-ego1": 0.012019065470477337, "agent_compute-ego2": 0.011672674440870098, "agent_compute-ego3": 0.01211857328227922, "complete-iteration": 0.84176705865299, "set_robot_commands": 0.002227086646884095, "deviation-center-line": 0.086677958791832, "driven_lanedir_consec": 0.2576470504888566, "sim_compute_sim_state": 0.024664155798020705, "sim_compute_performance-ego0": 0.0022166507696014604, "sim_compute_performance-ego1": 0.0020056440939311107, "sim_compute_performance-ego2": 0.0020099387449376725, "sim_compute_performance-ego3": 0.0020150966893613727}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.678414408768526, "get_ui_image": 0.0295934026891535, "step_physics": 0.16042719946967232, "survival_time": 4.899999999999991, "driven_lanedir": 0.6140974314754637, "get_state_dump": 0.006299962901105785, "get_robot_state": 0.007291186939586292, "sim_render-ego0": 0.0035853096933075876, "sim_render-ego1": 0.0035223816380356297, "get_duckie_state": 1.2643409497810132e-06, "in-drivable-lane": 3.1499999999999897, "deviation-heading": 0.291348286294811, "agent_compute-ego0": 0.010894076992767026, "agent_compute-ego1": 0.010376951911232689, "complete-iteration": 0.24837218390570748, "set_robot_commands": 0.0021290706865715256, "deviation-center-line": 0.16192487225063373, "driven_lanedir_consec": 0.6140974314754637, "sim_compute_sim_state": 0.008311440246273774, "sim_compute_performance-ego0": 0.0019285630698155872, "sim_compute_performance-ego1": 0.0018717207089819089}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6784144087685244, "get_ui_image": 0.0295934026891535, "step_physics": 0.16042719946967232, "survival_time": 4.899999999999991, "driven_lanedir": 0.34058990692239166, "get_state_dump": 0.006299962901105785, "get_robot_state": 0.007291186939586292, "sim_render-ego0": 0.0035853096933075876, "sim_render-ego1": 0.0035223816380356297, "get_duckie_state": 1.2643409497810132e-06, "in-drivable-lane": 2.8999999999999924, "deviation-heading": 1.768661547134351, "agent_compute-ego0": 0.010894076992767026, "agent_compute-ego1": 0.010376951911232689, "complete-iteration": 0.24837218390570748, "set_robot_commands": 0.0021290706865715256, "deviation-center-line": 0.17396510017726105, "driven_lanedir_consec": 0.33629117608568304, "sim_compute_sim_state": 0.008311440246273774, "sim_compute_performance-ego0": 0.0019285630698155872, "sim_compute_performance-ego1": 0.0018717207089819089}}
set_robot_commands_max0.0022539734840393067
set_robot_commands_mean0.0021852034890965633
set_robot_commands_median0.002227086646884095
set_robot_commands_min0.002102616737628805
sim_compute_performance-ego0_max0.0022166507696014604
sim_compute_performance-ego0_mean0.0021120022057330608
sim_compute_performance-ego0_median0.002158740471149313
sim_compute_performance-ego0_min0.0019285630698155872
sim_compute_performance-ego1_max0.0020056440939311107
sim_compute_performance-ego1_mean0.0019456606052512975
sim_compute_performance-ego1_median0.001967062552769979
sim_compute_performance-ego1_min0.0018717207089819089
sim_compute_sim_state_max0.032621891745205585
sim_compute_sim_state_mean0.023261560841294545
sim_compute_sim_state_median0.024664155798020705
sim_compute_sim_state_min0.008311440246273774
sim_render-ego0_max0.0039649960262323515
sim_render-ego0_mean0.003784955967860259
sim_render-ego0_median0.003792136907577514
sim_render-ego0_min0.0035853096933075876
sim_render-ego1_max0.003918814503289516
sim_render-ego1_mean0.0037639271894101193
sim_render-ego1_median0.0037997086842854817
sim_render-ego1_min0.0035223816380356297
simulation-passed1
step_physics_max0.6637986438726288
step_physics_mean0.5191967020158684
step_physics_median0.5775430662878629
step_physics_min0.16042719946967232
survival_time_max7.599999999999981
survival_time_mean6.628571428571413
survival_time_min4.899999999999991
No reset possible
5354112602Bea Baselines 🐤template-randomaido5-LFI-full-sim-validationLFVIv-simsuccessyesnogpu-prod-070:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6587966891077274
survival_time_median4.82499999999999
deviation-center-line_median0.18372681341530445
in-drivable-lane_median2.6749999999999927


other stats
agent_compute-ego0_max0.011066236881294636
agent_compute-ego0_mean0.010953451836048955
agent_compute-ego0_median0.010953451836048955
agent_compute-ego0_min0.010840666790803274
complete-iteration_max0.2048157224751482
complete-iteration_mean0.20093194865668665
complete-iteration_median0.20093194865668665
complete-iteration_min0.19704817483822504
deviation-center-line_max0.22270545771576217
deviation-center-line_mean0.18372681341530445
deviation-center-line_min0.14474816911484673
deviation-heading_max0.9254423888501632
deviation-heading_mean0.9131948861321344
deviation-heading_median0.9131948861321344
deviation-heading_min0.9009473834141052
driven_any_max1.7167609354270057
driven_any_mean1.6960945672591825
driven_any_median1.6960945672591825
driven_any_min1.6754281990913595
driven_lanedir_consec_max0.8731138199226813
driven_lanedir_consec_mean0.6587966891077274
driven_lanedir_consec_min0.4444795582927734
driven_lanedir_max0.8919331054681621
driven_lanedir_mean0.6682063318804677
driven_lanedir_median0.6682063318804677
driven_lanedir_min0.4444795582927734
get_duckie_state_max1.3336539268493652e-06
get_duckie_state_mean1.300201572553076e-06
get_duckie_state_median1.300201572553076e-06
get_duckie_state_min1.2667492182567866e-06
get_robot_state_max0.0037181859064583825
get_robot_state_mean0.003706177564883473
get_robot_state_median0.003706177564883473
get_robot_state_min0.0036941692233085632
get_state_dump_max0.0049297188719113665
get_state_dump_mean0.004782797373605497
get_state_dump_median0.004782797373605497
get_state_dump_min0.004635875875299627
get_ui_image_max0.035981585281063815
get_ui_image_mean0.03586975097505733
get_ui_image_median0.03586975097505733
get_ui_image_min0.03575791666905085
in-drivable-lane_max3.249999999999993
in-drivable-lane_mean2.6749999999999927
in-drivable-lane_min2.0999999999999925
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 1.6754281990913595, "get_ui_image": 0.03575791666905085, "step_physics": 0.12340694417556126, "survival_time": 4.749999999999991, "driven_lanedir": 0.8919331054681621, "get_state_dump": 0.0049297188719113665, "get_robot_state": 0.0036941692233085632, "sim_render-ego0": 0.0036877070864041648, "get_duckie_state": 1.3336539268493652e-06, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 0.9009473834141052, "agent_compute-ego0": 0.010840666790803274, "complete-iteration": 0.19704817483822504, "set_robot_commands": 0.002099191149075826, "deviation-center-line": 0.22270545771576217, "driven_lanedir_consec": 0.8731138199226813, "sim_compute_sim_state": 0.010547764599323273, "sim_compute_performance-ego0": 0.0019960602124532065}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7167609354270057, "get_ui_image": 0.035981585281063815, "step_physics": 0.13166511420047644, "survival_time": 4.899999999999991, "driven_lanedir": 0.4444795582927734, "get_state_dump": 0.004635875875299627, "get_robot_state": 0.0037181859064583825, "sim_render-ego0": 0.003753801788946595, "get_duckie_state": 1.2667492182567866e-06, "in-drivable-lane": 3.249999999999993, "deviation-heading": 0.9254423888501632, "agent_compute-ego0": 0.011066236881294636, "complete-iteration": 0.2048157224751482, "set_robot_commands": 0.002147036369400795, "deviation-center-line": 0.14474816911484673, "driven_lanedir_consec": 0.4444795582927734, "sim_compute_sim_state": 0.009804390897654523, "sim_compute_performance-ego0": 0.0019593142499827374}}
set_robot_commands_max0.002147036369400795
set_robot_commands_mean0.0021231137592383105
set_robot_commands_median0.0021231137592383105
set_robot_commands_min0.002099191149075826
sim_compute_performance-ego0_max0.0019960602124532065
sim_compute_performance-ego0_mean0.001977687231217972
sim_compute_performance-ego0_median0.001977687231217972
sim_compute_performance-ego0_min0.0019593142499827374
sim_compute_sim_state_max0.010547764599323273
sim_compute_sim_state_mean0.010176077748488898
sim_compute_sim_state_median0.010176077748488898
sim_compute_sim_state_min0.009804390897654523
sim_render-ego0_max0.003753801788946595
sim_render-ego0_mean0.00372075443767538
sim_render-ego0_median0.00372075443767538
sim_render-ego0_min0.0036877070864041648
simulation-passed1
step_physics_max0.13166511420047644
step_physics_mean0.12753602918801885
step_physics_median0.12753602918801885
step_physics_min0.12340694417556126
survival_time_max4.899999999999991
survival_time_mean4.82499999999999
survival_time_min4.749999999999991
No reset possible
5352812605Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-070:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2999735197577017
survival_time_median1.7750000000000008
deviation-center-line_median0.16116976962533835
in-drivable-lane_median0.37500000000000033


other stats
agent_compute-ego0_max0.012174129486083984
agent_compute-ego0_mean0.012049737572669982
agent_compute-ego0_median0.012049737572669982
agent_compute-ego0_min0.011925345659255982
agent_compute-npc0_max0.050560271739959715
agent_compute-npc0_mean0.04168817473180366
agent_compute-npc0_median0.04168817473180366
agent_compute-npc0_min0.032816077723647606
agent_compute-npc1_max0.0500909686088562
agent_compute-npc1_mean0.04080304142200586
agent_compute-npc1_median0.04080304142200586
agent_compute-npc1_min0.03151511423515551
agent_compute-npc2_max0.0505155086517334
agent_compute-npc2_mean0.04213732733870998
agent_compute-npc2_median0.04213732733870998
agent_compute-npc2_min0.033759146025686554
complete-iteration_max0.9349378168582916
complete-iteration_mean0.8713956638719096
complete-iteration_median0.8713956638719096
complete-iteration_min0.8078535108855276
deviation-center-line_max0.2029614423431128
deviation-center-line_mean0.16116976962533835
deviation-center-line_min0.1193780969075639
deviation-heading_max0.42290029630167686
deviation-heading_mean0.33090990458760183
deviation-heading_median0.33090990458760183
deviation-heading_min0.2389195128735269
driven_any_max0.3866220460800679
driven_any_mean0.31982841800446105
driven_any_median0.31982841800446105
driven_any_min0.2530347899288541
driven_lanedir_consec_max0.3549885974886773
driven_lanedir_consec_mean0.2999735197577017
driven_lanedir_consec_min0.24495844202672612
driven_lanedir_max0.3549885974886773
driven_lanedir_mean0.2999735197577017
driven_lanedir_median0.2999735197577017
driven_lanedir_min0.24495844202672612
get_duckie_state_max1.7845269405480586e-06
get_duckie_state_mean1.720768032651959e-06
get_duckie_state_median1.720768032651959e-06
get_duckie_state_min1.6570091247558594e-06
get_robot_state_max0.014773333072662351
get_robot_state_mean0.014559966325759888
get_robot_state_median0.014559966325759888
get_robot_state_min0.014346599578857422
get_state_dump_max0.009856843948364256
get_state_dump_mean0.00970220493547844
get_state_dump_median0.00970220493547844
get_state_dump_min0.009547565922592625
get_ui_image_max0.05155030886332194
get_ui_image_mean0.05076348086198171
get_ui_image_median0.05076348086198171
get_ui_image_min0.04997665286064148
in-drivable-lane_max0.7500000000000007
in-drivable-lane_mean0.37500000000000033
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 0.2530347899288541, "get_ui_image": 0.05155030886332194, "step_physics": 0.5515889471227472, "survival_time": 1.6000000000000008, "driven_lanedir": 0.24495844202672612, "get_state_dump": 0.009547565922592625, "get_robot_state": 0.014346599578857422, "sim_render-ego0": 0.0039987853079131155, "sim_render-npc0": 0.0036786108305959992, "sim_render-npc1": 0.003958022955692176, "sim_render-npc2": 0.0037173357876864343, "get_duckie_state": 1.7845269405480586e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.42290029630167686, "agent_compute-ego0": 0.012174129486083984, "agent_compute-npc0": 0.032816077723647606, "agent_compute-npc1": 0.03151511423515551, "agent_compute-npc2": 0.033759146025686554, "complete-iteration": 0.8078535108855276, "set_robot_commands": 0.00225247758807558, "deviation-center-line": 0.2029614423431128, "driven_lanedir_consec": 0.24495844202672612, "sim_compute_sim_state": 0.037527178273056495, "sim_compute_performance-ego0": 0.002255367510246508, "sim_compute_performance-npc0": 0.0019384514201771128, "sim_compute_performance-npc1": 0.002081488118027196, "sim_compute_performance-npc2": 0.0020349964951023912}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.3866220460800679, "get_ui_image": 0.04997665286064148, "step_physics": 0.6266618490219116, "survival_time": 1.950000000000001, "driven_lanedir": 0.3549885974886773, "get_state_dump": 0.009856843948364256, "get_robot_state": 0.014773333072662351, "sim_render-ego0": 0.003861355781555176, "sim_render-npc0": 0.0037739753723144537, "sim_render-npc1": 0.00407368540763855, "sim_render-npc2": 0.003773736953735352, "get_duckie_state": 1.6570091247558594e-06, "in-drivable-lane": 0.7500000000000007, "deviation-heading": 0.2389195128735269, "agent_compute-ego0": 0.011925345659255982, "agent_compute-npc0": 0.050560271739959715, "agent_compute-npc1": 0.0500909686088562, "agent_compute-npc2": 0.0505155086517334, "complete-iteration": 0.9349378168582916, "set_robot_commands": 0.002357828617095947, "deviation-center-line": 0.1193780969075639, "driven_lanedir_consec": 0.3549885974886773, "sim_compute_sim_state": 0.03751172423362732, "sim_compute_performance-ego0": 0.002223438024520874, "sim_compute_performance-npc0": 0.00195455551147461, "sim_compute_performance-npc1": 0.002033710479736328, "sim_compute_performance-npc2": 0.001995009183883667}}
set_robot_commands_max0.002357828617095947
set_robot_commands_mean0.0023051531025857636
set_robot_commands_median0.0023051531025857636
set_robot_commands_min0.00225247758807558
sim_compute_performance-ego0_max0.002255367510246508
sim_compute_performance-ego0_mean0.002239402767383691
sim_compute_performance-ego0_median0.002239402767383691
sim_compute_performance-ego0_min0.002223438024520874
sim_compute_performance-npc0_max0.00195455551147461
sim_compute_performance-npc0_mean0.001946503465825861
sim_compute_performance-npc0_median0.001946503465825861
sim_compute_performance-npc0_min0.0019384514201771128
sim_compute_performance-npc1_max0.002081488118027196
sim_compute_performance-npc1_mean0.002057599298881762
sim_compute_performance-npc1_median0.002057599298881762
sim_compute_performance-npc1_min0.002033710479736328
sim_compute_performance-npc2_max0.0020349964951023912
sim_compute_performance-npc2_mean0.002015002839493029
sim_compute_performance-npc2_median0.002015002839493029
sim_compute_performance-npc2_min0.001995009183883667
sim_compute_sim_state_max0.037527178273056495
sim_compute_sim_state_mean0.03751945125334191
sim_compute_sim_state_median0.03751945125334191
sim_compute_sim_state_min0.03751172423362732
sim_render-ego0_max0.0039987853079131155
sim_render-ego0_mean0.003930070544734146
sim_render-ego0_median0.003930070544734146
sim_render-ego0_min0.003861355781555176
sim_render-npc0_max0.0037739753723144537
sim_render-npc0_mean0.0037262931014552265
sim_render-npc0_median0.0037262931014552265
sim_render-npc0_min0.0036786108305959992
sim_render-npc1_max0.00407368540763855
sim_render-npc1_mean0.0040158541816653626
sim_render-npc1_median0.0040158541816653626
sim_render-npc1_min0.003958022955692176
sim_render-npc2_max0.003773736953735352
sim_render-npc2_mean0.003745536370710893
sim_render-npc2_median0.003745536370710893
sim_render-npc2_min0.0037173357876864343
simulation-passed1
step_physics_max0.6266618490219116
step_physics_mean0.5891253980723294
step_physics_median0.5891253980723294
step_physics_min0.5515889471227472
survival_time_max1.950000000000001
survival_time_mean1.7750000000000008
survival_time_min1.6000000000000008
No reset possible
5351512607Bea Baselines 🐤template-randomaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-070:08:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5758601445640131
survival_time_median6.099999999999986
deviation-center-line_median0.17553830655708547
in-drivable-lane_median3.29999999999999


other stats
agent_compute-ego0_max0.012170924638447008
agent_compute-ego0_mean0.011218779325568333
agent_compute-ego0_median0.011218779325568333
agent_compute-ego0_min0.010266634012689652
agent_compute-ego1_max0.011805431466353569
agent_compute-ego1_mean0.011334963848716332
agent_compute-ego1_median0.011334963848716332
agent_compute-ego1_min0.010864496231079102
agent_compute-ego2_max0.0122791892603824
agent_compute-ego2_mean0.01126297621329764
agent_compute-ego2_median0.01126297621329764
agent_compute-ego2_min0.010246763166212878
agent_compute-ego3_max0.012773968044080233
agent_compute-ego3_mean0.011753592029104832
agent_compute-ego3_median0.011753592029104832
agent_compute-ego3_min0.010733216014129436
complete-iteration_max1.002036072078504
complete-iteration_mean0.8996539405598047
complete-iteration_median0.8996539405598047
complete-iteration_min0.7972718090411054
deviation-center-line_max0.47013425987002005
deviation-center-line_mean0.2174177284809568
deviation-center-line_min0.0720091252708566
deviation-heading_max3.0542186889712815
deviation-heading_mean1.2634654122591242
deviation-heading_median1.0697442157871273
deviation-heading_min0.3081468886732283
driven_any_max2.8773005288041658
driven_any_mean1.716787495843618
driven_any_median1.6399654313822998
driven_any_min0.38662204608009304
driven_lanedir_consec_max1.8220023141314807
driven_lanedir_consec_mean0.7121644428869928
driven_lanedir_consec_min0.30949264303267476
driven_lanedir_max1.8220034571617316
driven_lanedir_mean0.7349677350690881
driven_lanedir_median0.5758601445640131
driven_lanedir_min0.30949264303267476
get_duckie_state_max1.6357725029749587e-06
get_duckie_state_mean1.6297642550596422e-06
get_duckie_state_median1.6297642550596422e-06
get_duckie_state_min1.6237560071443255e-06
get_robot_state_max0.015183245508294356
get_robot_state_mean0.014641110670196756
get_robot_state_median0.014641110670196756
get_robot_state_min0.014098975832099157
get_state_dump_max0.010164439050774824
get_state_dump_mean0.009738357534970337
get_state_dump_median0.009738357534970337
get_state_dump_min0.009312276019165847
get_ui_image_max0.05385080638684724
get_ui_image_mean0.05351866755846195
get_ui_image_median0.05351866755846195
get_ui_image_min0.05318652873007667
in-drivable-lane_max6.049999999999983
in-drivable-lane_mean3.4749999999999894
in-drivable-lane_min0.9999999999999998
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 2.831813082003494, "get_ui_image": 0.05318652873007667, "step_physics": 0.6163853588483191, "survival_time": 7.499999999999981, "driven_lanedir": 1.8220034571617316, "get_state_dump": 0.009312276019165847, "get_robot_state": 0.014098975832099157, "sim_render-ego0": 0.003653859460590691, "sim_render-ego1": 0.0036366964807573537, "sim_render-ego2": 0.0035823654654799707, "sim_render-ego3": 0.003716164077354583, "get_duckie_state": 1.6357725029749587e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 0.3442852314393885, "agent_compute-ego0": 0.010266634012689652, "agent_compute-ego1": 0.010864496231079102, "agent_compute-ego2": 0.010246763166212878, "agent_compute-ego3": 0.010733216014129436, "complete-iteration": 0.7972718090411054, "set_robot_commands": 0.0020773095010921654, "deviation-center-line": 0.22968417496144336, "driven_lanedir_consec": 1.8220023141314807, "sim_compute_sim_state": 0.03121768401948032, "sim_compute_performance-ego0": 0.0020238232138930566, "sim_compute_performance-ego1": 0.001828938919976847, "sim_compute_performance-ego2": 0.001903616039958221, "sim_compute_performance-ego3": 0.0018697827067596232}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.3028841294963844, "get_ui_image": 0.05318652873007667, "step_physics": 0.6163853588483191, "survival_time": 7.499999999999981, "driven_lanedir": 0.4284094322301284, "get_state_dump": 0.009312276019165847, "get_robot_state": 0.014098975832099157, "sim_render-ego0": 0.003653859460590691, "sim_render-ego1": 0.0036366964807573537, "sim_render-ego2": 0.0035823654654799707, "sim_render-ego3": 0.003716164077354583, "get_duckie_state": 1.6357725029749587e-06, "in-drivable-lane": 5.799999999999981, "deviation-heading": 1.002056979235454, "agent_compute-ego0": 0.010266634012689652, "agent_compute-ego1": 0.010864496231079102, "agent_compute-ego2": 0.010246763166212878, "agent_compute-ego3": 0.010733216014129436, "complete-iteration": 0.7972718090411054, "set_robot_commands": 0.0020773095010921654, "deviation-center-line": 0.1213924381527276, "driven_lanedir_consec": 0.4284094322301284, "sim_compute_sim_state": 0.03121768401948032, "sim_compute_performance-ego0": 0.0020238232138930566, "sim_compute_performance-ego1": 0.001828938919976847, "sim_compute_performance-ego2": 0.001903616039958221, "sim_compute_performance-ego3": 0.0018697827067596232}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 1.9654839397698145, "get_ui_image": 0.05318652873007667, "step_physics": 0.6163853588483191, "survival_time": 7.499999999999981, "driven_lanedir": 0.3166075872147196, "get_state_dump": 0.009312276019165847, "get_robot_state": 0.014098975832099157, "sim_render-ego0": 0.003653859460590691, "sim_render-ego1": 0.0036366964807573537, "sim_render-ego2": 0.0035823654654799707, "sim_render-ego3": 0.003716164077354583, "get_duckie_state": 1.6357725029749587e-06, "in-drivable-lane": 6.049999999999983, "deviation-heading": 1.1374314523388007, "agent_compute-ego0": 0.010266634012689652, "agent_compute-ego1": 0.010864496231079102, "agent_compute-ego2": 0.010246763166212878, "agent_compute-ego3": 0.010733216014129436, "complete-iteration": 0.7972718090411054, "set_robot_commands": 0.0020773095010921654, "deviation-center-line": 0.10797637530751922, "driven_lanedir_consec": 0.3166075872147196, "sim_compute_sim_state": 0.03121768401948032, "sim_compute_performance-ego0": 0.0020238232138930566, "sim_compute_performance-ego1": 0.001828938919976847, "sim_compute_performance-ego2": 0.001903616039958221, "sim_compute_performance-ego3": 0.0018697827067596232}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 2.8773005288041658, "get_ui_image": 0.05318652873007667, "step_physics": 0.6163853588483191, "survival_time": 7.499999999999981, "driven_lanedir": 1.093112188430767, "get_state_dump": 0.009312276019165847, "get_robot_state": 0.014098975832099157, "sim_render-ego0": 0.003653859460590691, "sim_render-ego1": 0.0036366964807573537, "sim_render-ego2": 0.0035823654654799707, "sim_render-ego3": 0.003716164077354583, "get_duckie_state": 1.6357725029749587e-06, "in-drivable-lane": 4.199999999999985, "deviation-heading": 1.4050102318329205, "agent_compute-ego0": 0.010266634012689652, "agent_compute-ego1": 0.010864496231079102, "agent_compute-ego2": 0.010246763166212878, "agent_compute-ego3": 0.010733216014129436, "complete-iteration": 0.7972718090411054, "set_robot_commands": 0.0020773095010921654, "deviation-center-line": 0.2963999319120335, "driven_lanedir_consec": 1.019001024923512, "sim_compute_sim_state": 0.03121768401948032, "sim_compute_performance-ego0": 0.0020238232138930566, "sim_compute_performance-ego1": 0.001828938919976847, "sim_compute_performance-ego2": 0.001903616039958221, "sim_compute_performance-ego3": 0.0018697827067596232}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 1.6280751458799152, "get_ui_image": 0.05385080638684724, "step_physics": 0.8118370783956428, "survival_time": 4.699999999999991, "driven_lanedir": 0.7583962833546565, "get_state_dump": 0.010164439050774824, "get_robot_state": 0.015183245508294356, "sim_render-ego0": 0.0038730144500732423, "sim_render-ego1": 0.0037469060797440377, "sim_render-ego2": 0.0038469038511577407, "sim_render-ego3": 0.0038858463889674135, "get_duckie_state": 1.6237560071443255e-06, "in-drivable-lane": 1.2999999999999958, "deviation-heading": 2.3745112943922093, "agent_compute-ego0": 0.012170924638447008, "agent_compute-ego1": 0.011805431466353569, "agent_compute-ego2": 0.0122791892603824, "agent_compute-ego3": 0.012773968044080233, "complete-iteration": 1.002036072078504, "set_robot_commands": 0.002347077821430407, "deviation-center-line": 0.35315000024132365, "driven_lanedir_consec": 0.6500822524354004, "sim_compute_sim_state": 0.028945355666311165, "sim_compute_performance-ego0": 0.0021593043678685237, "sim_compute_performance-ego1": 0.001978299492283871, "sim_compute_performance-ego2": 0.00194287802043714, "sim_compute_performance-ego3": 0.0019765527624832956}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.651855716884684, "get_ui_image": 0.05385080638684724, "step_physics": 0.8118370783956428, "survival_time": 4.699999999999991, "driven_lanedir": 0.6448691596131364, "get_state_dump": 0.010164439050774824, "get_robot_state": 0.015183245508294356, "sim_render-ego0": 0.0038730144500732423, "sim_render-ego1": 0.0037469060797440377, "sim_render-ego2": 0.0038469038511577407, "sim_render-ego3": 0.0038858463889674135, "get_duckie_state": 1.6237560071443255e-06, "in-drivable-lane": 2.8499999999999903, "deviation-heading": 0.3081468886732283, "agent_compute-ego0": 0.012170924638447008, "agent_compute-ego1": 0.011805431466353569, "agent_compute-ego2": 0.0122791892603824, "agent_compute-ego3": 0.012773968044080233, "complete-iteration": 1.002036072078504, "set_robot_commands": 0.002347077821430407, "deviation-center-line": 0.08859552213173046, "driven_lanedir_consec": 0.6448691596131364, "sim_compute_sim_state": 0.028945355666311165, "sim_compute_performance-ego0": 0.0021593043678685237, "sim_compute_performance-ego1": 0.001978299492283871, "sim_compute_performance-ego2": 0.00194287802043714, "sim_compute_performance-ego3": 0.0019765527624832956}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 1.0902653778303937, "get_ui_image": 0.05385080638684724, "step_physics": 0.8118370783956428, "survival_time": 4.699999999999991, "driven_lanedir": 0.5068511295148899, "get_state_dump": 0.010164439050774824, "get_robot_state": 0.015183245508294356, "sim_render-ego0": 0.0038730144500732423, "sim_render-ego1": 0.0037469060797440377, "sim_render-ego2": 0.0038469038511577407, "sim_render-ego3": 0.0038858463889674135, "get_duckie_state": 1.6237560071443255e-06, "in-drivable-lane": 0.9999999999999998, "deviation-heading": 3.0542186889712815, "agent_compute-ego0": 0.012170924638447008, "agent_compute-ego1": 0.011805431466353569, "agent_compute-ego2": 0.0122791892603824, "agent_compute-ego3": 0.012773968044080233, "complete-iteration": 1.002036072078504, "set_robot_commands": 0.002347077821430407, "deviation-center-line": 0.47013425987002005, "driven_lanedir_consec": 0.5068511295148899, "sim_compute_sim_state": 0.028945355666311165, "sim_compute_performance-ego0": 0.0021593043678685237, "sim_compute_performance-ego1": 0.001978299492283871, "sim_compute_performance-ego2": 0.00194287802043714, "sim_compute_performance-ego3": 0.0019765527624832956}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.38662204608009304, "get_ui_image": 0.05385080638684724, "step_physics": 0.8118370783956428, "survival_time": 4.699999999999991, "driven_lanedir": 0.30949264303267476, "get_state_dump": 0.010164439050774824, "get_robot_state": 0.015183245508294356, "sim_render-ego0": 0.0038730144500732423, "sim_render-ego1": 0.0037469060797440377, "sim_render-ego2": 0.0038469038511577407, "sim_render-ego3": 0.0038858463889674135, "get_duckie_state": 1.6237560071443255e-06, "in-drivable-lane": 3.549999999999991, "deviation-heading": 0.4820625311897111, "agent_compute-ego0": 0.012170924638447008, "agent_compute-ego1": 0.011805431466353569, "agent_compute-ego2": 0.0122791892603824, "agent_compute-ego3": 0.012773968044080233, "complete-iteration": 1.002036072078504, "set_robot_commands": 0.002347077821430407, "deviation-center-line": 0.0720091252708566, "driven_lanedir_consec": 0.30949264303267476, "sim_compute_sim_state": 0.028945355666311165, "sim_compute_performance-ego0": 0.0021593043678685237, "sim_compute_performance-ego1": 0.001978299492283871, "sim_compute_performance-ego2": 0.00194287802043714, "sim_compute_performance-ego3": 0.0019765527624832956}}
set_robot_commands_max0.002347077821430407
set_robot_commands_mean0.0022121936612612865
set_robot_commands_median0.0022121936612612865
set_robot_commands_min0.0020773095010921654
sim_compute_performance-ego0_max0.0021593043678685237
sim_compute_performance-ego0_mean0.00209156379088079
sim_compute_performance-ego0_median0.00209156379088079
sim_compute_performance-ego0_min0.0020238232138930566
sim_compute_performance-ego1_max0.001978299492283871
sim_compute_performance-ego1_mean0.0019036192061303592
sim_compute_performance-ego1_median0.0019036192061303592
sim_compute_performance-ego1_min0.001828938919976847
sim_compute_performance-ego2_max0.00194287802043714
sim_compute_performance-ego2_mean0.0019232470301976808
sim_compute_performance-ego2_median0.0019232470301976808
sim_compute_performance-ego2_min0.001903616039958221
sim_compute_performance-ego3_max0.0019765527624832956
sim_compute_performance-ego3_mean0.0019231677346214595
sim_compute_performance-ego3_median0.0019231677346214595
sim_compute_performance-ego3_min0.0018697827067596232
sim_compute_sim_state_max0.03121768401948032
sim_compute_sim_state_mean0.03008151984289574
sim_compute_sim_state_median0.03008151984289574
sim_compute_sim_state_min0.028945355666311165
sim_render-ego0_max0.0038730144500732423
sim_render-ego0_mean0.0037634369553319665
sim_render-ego0_median0.0037634369553319665
sim_render-ego0_min0.003653859460590691
sim_render-ego1_max0.0037469060797440377
sim_render-ego1_mean0.003691801280250696
sim_render-ego1_median0.003691801280250696
sim_render-ego1_min0.0036366964807573537
sim_render-ego2_max0.0038469038511577407
sim_render-ego2_mean0.003714634658318856
sim_render-ego2_median0.003714634658318856
sim_render-ego2_min0.0035823654654799707
sim_render-ego3_max0.0038858463889674135
sim_render-ego3_mean0.003801005233160998
sim_render-ego3_median0.003801005233160998
sim_render-ego3_min0.003716164077354583
simulation-passed1
step_physics_max0.8118370783956428
step_physics_mean0.7141112186219809
step_physics_median0.7141112186219809
step_physics_min0.6163853588483191
survival_time_max7.499999999999981
survival_time_mean6.099999999999986
survival_time_min4.699999999999991
No reset possible
5349312677Bea Baselines 🐤baseline-duckietownaido5-LFI-full-sim-validationLFVIv-simsuccessyesnogpu-prod-070:18:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.339205156330838
survival_time_median46.72499999999948
deviation-center-line_median1.600384626099745
in-drivable-lane_median23.949999999999346


other stats
agent_compute-ego0_max0.01357896858012051
agent_compute-ego0_mean0.01342142907453783
agent_compute-ego0_median0.01342142907453783
agent_compute-ego0_min0.013263889568955151
complete-iteration_max0.3436676598309875
complete-iteration_mean0.2881283075063678
complete-iteration_median0.2881283075063678
complete-iteration_min0.23258895518174813
deviation-center-line_max2.258012673324021
deviation-center-line_mean1.600384626099745
deviation-center-line_min0.9427565788754688
deviation-heading_max7.551517531884621
deviation-heading_mean5.481959536179345
deviation-heading_median5.481959536179345
deviation-heading_min3.4124015404740686
driven_any_max7.9107943852236255
driven_any_mean6.10691052401285
driven_any_median6.10691052401285
driven_any_min4.3030266628020755
driven_lanedir_consec_max3.289344668744074
driven_lanedir_consec_mean2.339205156330838
driven_lanedir_consec_min1.389065643917602
driven_lanedir_max3.974904117626865
driven_lanedir_mean2.72924657090151
driven_lanedir_median2.72924657090151
driven_lanedir_min1.4835890241761542
get_duckie_state_max1.5148475988587336e-06
get_duckie_state_mean1.4186829892605946e-06
get_duckie_state_median1.4186829892605946e-06
get_duckie_state_min1.3225183796624557e-06
get_robot_state_max0.004092942778743914
get_robot_state_mean0.00403984366891155
get_robot_state_median0.00403984366891155
get_robot_state_min0.003986744559079185
get_state_dump_max0.005286117809921948
get_state_dump_mean0.005116618709364388
get_state_dump_median0.005116618709364388
get_state_dump_min0.004947119608806829
get_ui_image_max0.04092620671738395
get_ui_image_mean0.03998568275108244
get_ui_image_median0.03998568275108244
get_ui_image_min0.03904515878478093
in-drivable-lane_max47.59999999999869
in-drivable-lane_mean23.949999999999346
in-drivable-lane_min0.29999999999999893
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 7.9107943852236255, "get_ui_image": 0.04092620671738395, "step_physics": 0.2594028831421584, "survival_time": 59.99999999999873, "driven_lanedir": 1.4835890241761542, "get_state_dump": 0.004947119608806829, "get_robot_state": 0.003986744559079185, "sim_render-ego0": 0.003967933114819681, "get_duckie_state": 1.3225183796624557e-06, "in-drivable-lane": 47.59999999999869, "deviation-heading": 3.4124015404740686, "agent_compute-ego0": 0.01357896858012051, "complete-iteration": 0.3436676598309875, "set_robot_commands": 0.0023987817327545445, "deviation-center-line": 0.9427565788754688, "driven_lanedir_consec": 1.389065643917602, "sim_compute_sim_state": 0.012229928763879528, "sim_compute_performance-ego0": 0.0021378195950828125}, "LFI-full-udem1-000-ego0": {"driven_any": 4.3030266628020755, "get_ui_image": 0.03904515878478093, "step_physics": 0.14852660485168, "survival_time": 33.45000000000024, "driven_lanedir": 3.974904117626865, "get_state_dump": 0.005286117809921948, "get_robot_state": 0.004092942778743914, "sim_render-ego0": 0.004085800896829634, "get_duckie_state": 1.5148475988587336e-06, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 7.551517531884621, "agent_compute-ego0": 0.013263889568955151, "complete-iteration": 0.23258895518174813, "set_robot_commands": 0.002452204832390173, "deviation-center-line": 2.258012673324021, "driven_lanedir_consec": 3.289344668744074, "sim_compute_sim_state": 0.013514182460841849, "sim_compute_performance-ego0": 0.002227453687297764}}
set_robot_commands_max0.002452204832390173
set_robot_commands_mean0.0024254932825723587
set_robot_commands_median0.0024254932825723587
set_robot_commands_min0.0023987817327545445
sim_compute_performance-ego0_max0.002227453687297764
sim_compute_performance-ego0_mean0.0021826366411902883
sim_compute_performance-ego0_median0.0021826366411902883
sim_compute_performance-ego0_min0.0021378195950828125
sim_compute_sim_state_max0.013514182460841849
sim_compute_sim_state_mean0.012872055612360689
sim_compute_sim_state_median0.012872055612360689
sim_compute_sim_state_min0.012229928763879528
sim_render-ego0_max0.004085800896829634
sim_render-ego0_mean0.0040268670058246575
sim_render-ego0_median0.0040268670058246575
sim_render-ego0_min0.003967933114819681
simulation-passed1
step_physics_max0.2594028831421584
step_physics_mean0.2039647439969192
step_physics_median0.2039647439969192
step_physics_min0.14852660485168
survival_time_max59.99999999999873
survival_time_mean46.72499999999948
survival_time_min33.45000000000024
No reset possible
5346512564Bea Baselines 🐤straightaido5-LFV-sim-validationLFVv-simsuccessyesnogpu-prod-070:17:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6111249934350206
survival_time_median10.375000000000012
deviation-center-line_median0.3289032233668977
in-drivable-lane_median6.075000000000026


other stats
agent_compute-ego0_max0.010926735501329438
agent_compute-ego0_mean0.010220218836674176
agent_compute-ego0_median0.010196315398492207
agent_compute-ego0_min0.009561509048382853
agent_compute-npc0_max0.026245644049985067
agent_compute-npc0_mean0.022137590800168437
agent_compute-npc0_median0.021366279305426387
agent_compute-npc0_min0.01957216053983591
agent_compute-npc1_max0.031408316897649835
agent_compute-npc1_mean0.0292244177856948
agent_compute-npc1_median0.029918512376416632
agent_compute-npc1_min0.026346424083017933
agent_compute-npc2_max0.03081093739419088
agent_compute-npc2_mean0.02712201147217515
agent_compute-npc2_median0.026557079884184508
agent_compute-npc2_min0.02399801713815007
agent_compute-npc3_max0.037728362750512945
agent_compute-npc3_mean0.03539227438869934
agent_compute-npc3_median0.03539227438869934
agent_compute-npc3_min0.03305618602688573
complete-iteration_max1.1681326116834367
complete-iteration_mean0.8455945853748009
complete-iteration_median0.947666009423466
complete-iteration_min0.31891371096883503
deviation-center-line_max0.4020719844429631
deviation-center-line_mean0.3039323060899035
deviation-center-line_min0.1558507931828555
deviation-heading_max2.6014820831000502
deviation-heading_mean1.3142043552437723
deviation-heading_median1.0339592049419246
deviation-heading_min0.5874169279911909
driven_any_max1.7856212315220987
driven_any_mean1.4540063834269006
driven_any_median1.5364362609816873
driven_any_min0.9575317802221288
driven_lanedir_consec_max0.7766595174703629
driven_lanedir_consec_mean0.6222730404710497
driven_lanedir_consec_min0.4901826575437944
driven_lanedir_max0.7766595174703629
driven_lanedir_mean0.6222730404710497
driven_lanedir_median0.6111249934350206
driven_lanedir_min0.4901826575437944
get_duckie_state_max1.6939740221039589e-06
get_duckie_state_mean1.5121664776735783e-06
get_duckie_state_median1.5454749432047663e-06
get_duckie_state_min1.263742002180821e-06
get_robot_state_max0.018595733562437423
get_robot_state_mean0.01430094163573135
get_robot_state_median0.015496842714468896
get_robot_state_min0.007614347551550184
get_state_dump_max0.0114659662006282
get_state_dump_mean0.009691065500143998
get_state_dump_median0.01035930465576188
get_state_dump_min0.006579686488424029
get_ui_image_max0.05825732235147172
get_ui_image_mean0.04511813646728486
get_ui_image_median0.04475934824394046
get_ui_image_min0.032696527029786794
in-drivable-lane_max7.800000000000027
in-drivable-lane_mean5.387500000000019
in-drivable-lane_min1.5999999999999943
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 0.9575317802221288, "get_ui_image": 0.041302395563056, "step_physics": 0.5930122598244326, "survival_time": 6.799999999999984, "driven_lanedir": 0.7766595174703629, "get_state_dump": 0.00967966727096669, "get_robot_state": 0.013880249357571569, "sim_render-ego0": 0.0036978652007388377, "sim_render-npc0": 0.003576868641985594, "sim_render-npc1": 0.00371835005544398, "sim_render-npc2": 0.003627616993702241, "get_duckie_state": 1.521006117772012e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 0.8011106083148233, "agent_compute-ego0": 0.010103683402068424, "agent_compute-npc0": 0.01957216053983591, "agent_compute-npc1": 0.031408316897649835, "agent_compute-npc2": 0.03081093739419088, "complete-iteration": 0.8062071243341822, "set_robot_commands": 0.0020850157215647454, "deviation-center-line": 0.1558507931828555, "driven_lanedir_consec": 0.7766595174703629, "sim_compute_sim_state": 0.02556434338980347, "sim_compute_performance-ego0": 0.0020065707881955336, "sim_compute_performance-npc0": 0.0018320170632244027, "sim_compute_performance-npc1": 0.001895170142180728, "sim_compute_performance-npc2": 0.0019083492947320868}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.7856212315220987, "get_ui_image": 0.05825732235147172, "step_physics": 0.8521897642552352, "survival_time": 11.850000000000032, "driven_lanedir": 0.6844270440640212, "get_state_dump": 0.0114659662006282, "get_robot_state": 0.018595733562437423, "sim_render-ego0": 0.004023363610275653, "sim_render-npc0": 0.0038619011390109022, "sim_render-npc1": 0.003902144792701016, "sim_render-npc2": 0.00385591563056497, "sim_render-npc3": 0.0038790572591188574, "get_duckie_state": 1.6939740221039589e-06, "in-drivable-lane": 7.200000000000042, "deviation-heading": 1.266807801569026, "agent_compute-ego0": 0.010926735501329438, "agent_compute-npc0": 0.022545751403359807, "agent_compute-npc1": 0.029918512376416632, "agent_compute-npc2": 0.026557079884184508, "agent_compute-npc3": 0.03305618602688573, "complete-iteration": 1.1681326116834367, "set_robot_commands": 0.002420320230371812, "deviation-center-line": 0.301513281556401, "driven_lanedir_consec": 0.6844270440640212, "sim_compute_sim_state": 0.06285341346965116, "sim_compute_performance-ego0": 0.002220730821625525, "sim_compute_performance-npc0": 0.0020061480898817046, "sim_compute_performance-npc1": 0.002023436442142775, "sim_compute_performance-npc2": 0.002051979553799669, "sim_compute_performance-npc3": 0.002026902527368369}, "LFV-norm-techtrack-000-ego0": {"driven_any": 1.4053278356982355, "get_ui_image": 0.04821630092482493, "step_physics": 0.8052217676231899, "survival_time": 9.6, "driven_lanedir": 0.5378229428060199, "get_state_dump": 0.011038942040557073, "get_robot_state": 0.017113436071366225, "sim_render-ego0": 0.00371798950155782, "sim_render-npc0": 0.0034384517472025025, "sim_render-npc1": 0.0034372015938240012, "sim_render-npc2": 0.0036048864453567743, "sim_render-npc3": 0.0035262960226424616, "get_duckie_state": 1.263742002180821e-06, "in-drivable-lane": 4.95000000000001, "deviation-heading": 2.6014820831000502, "agent_compute-ego0": 0.009561509048382853, "agent_compute-npc0": 0.02018680720749297, "agent_compute-npc1": 0.026346424083017933, "agent_compute-npc2": 0.02399801713815007, "agent_compute-npc3": 0.037728362750512945, "complete-iteration": 1.0891248945127496, "set_robot_commands": 0.0022418746058805003, "deviation-center-line": 0.4020719844429631, "driven_lanedir_consec": 0.5378229428060199, "sim_compute_sim_state": 0.051965130425487775, "sim_compute_performance-ego0": 0.002006240459303782, "sim_compute_performance-npc0": 0.001940120687138849, "sim_compute_performance-npc1": 0.001850492596008617, "sim_compute_performance-npc2": 0.001893535179177714, "sim_compute_performance-npc3": 0.0017802764714690688}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.667544686265139, "get_ui_image": 0.032696527029786794, "step_physics": 0.2090130490916116, "survival_time": 11.150000000000023, "driven_lanedir": 0.4901826575437944, "get_state_dump": 0.006579686488424029, "get_robot_state": 0.007614347551550184, "sim_render-ego0": 0.0038767755031585698, "sim_render-npc0": 0.003834260361535208, "get_duckie_state": 1.569943768637521e-06, "in-drivable-lane": 7.800000000000027, "deviation-heading": 0.5874169279911909, "agent_compute-ego0": 0.01028894739491599, "agent_compute-npc0": 0.026245644049985067, "complete-iteration": 0.31891371096883503, "set_robot_commands": 0.002281335847718375, "deviation-center-line": 0.35629316517739434, "driven_lanedir_consec": 0.4901826575437944, "sim_compute_sim_state": 0.01001442755971636, "sim_compute_performance-ego0": 0.002099386283329555, "sim_compute_performance-npc0": 0.001961211008684976}}
set_robot_commands_max0.002420320230371812
set_robot_commands_mean0.002257136601383858
set_robot_commands_median0.0022616052267994376
set_robot_commands_min0.0020850157215647454
sim_compute_performance-ego0_max0.002220730821625525
sim_compute_performance-ego0_mean0.002083232088113599
sim_compute_performance-ego0_median0.002052978535762544
sim_compute_performance-ego0_min0.002006240459303782
sim_compute_performance-npc0_max0.0020061480898817046
sim_compute_performance-npc0_mean0.0019348742122324832
sim_compute_performance-npc0_median0.0019506658479119124
sim_compute_performance-npc0_min0.0018320170632244027
sim_compute_performance-npc1_max0.002023436442142775
sim_compute_performance-npc1_mean0.0019230330601107068
sim_compute_performance-npc1_median0.001895170142180728
sim_compute_performance-npc1_min0.001850492596008617
sim_compute_performance-npc2_max0.002051979553799669
sim_compute_performance-npc2_mean0.00195128800923649
sim_compute_performance-npc2_median0.0019083492947320868
sim_compute_performance-npc2_min0.001893535179177714
sim_compute_performance-npc3_max0.002026902527368369
sim_compute_performance-npc3_mean0.0019035894994187189
sim_compute_performance-npc3_median0.0019035894994187189
sim_compute_performance-npc3_min0.0017802764714690688
sim_compute_sim_state_max0.06285341346965116
sim_compute_sim_state_mean0.0375993287111647
sim_compute_sim_state_median0.038764736907645626
sim_compute_sim_state_min0.01001442755971636
sim_render-ego0_max0.004023363610275653
sim_render-ego0_mean0.00382899845393272
sim_render-ego0_median0.0037973825023581943
sim_render-ego0_min0.0036978652007388377
sim_render-npc0_max0.0038619011390109022
sim_render-npc0_mean0.003677870472433552
sim_render-npc0_median0.003705564501760401
sim_render-npc0_min0.0034384517472025025
sim_render-npc1_max0.003902144792701016
sim_render-npc1_mean0.0036858988139896656
sim_render-npc1_median0.00371835005544398
sim_render-npc1_min0.0034372015938240012
sim_render-npc2_max0.00385591563056497
sim_render-npc2_mean0.003696139689874662
sim_render-npc2_median0.003627616993702241
sim_render-npc2_min0.0036048864453567743
sim_render-npc3_max0.0038790572591188574
sim_render-npc3_mean0.003702676640880659
sim_render-npc3_median0.003702676640880659
sim_render-npc3_min0.0035262960226424616
simulation-passed1
step_physics_max0.8521897642552352
step_physics_mean0.6148592101986173
step_physics_median0.6991170137238112
step_physics_min0.2090130490916116
survival_time_max11.850000000000032
survival_time_mean9.85000000000001
survival_time_min6.799999999999984
No reset possible
5345912571Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simsuccessyesnogpu-prod-070:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.23974057674616897
survival_time_median5.424999999999988
deviation-center-line_median0.23310124682878197
in-drivable-lane_median2.799999999999992


other stats
agent_compute-ego0_max0.01062879657113789
agent_compute-ego0_mean0.010419520332881065
agent_compute-ego0_median0.010419520332881065
agent_compute-ego0_min0.01021024409462424
complete-iteration_max0.23612857916775873
complete-iteration_mean0.22774637587162416
complete-iteration_median0.22774637587162416
complete-iteration_min0.21936417257548957
deviation-center-line_max0.33643301407152215
deviation-center-line_mean0.23310124682878197
deviation-center-line_min0.12976947958604176
deviation-heading_max3.0449714976825573
deviation-heading_mean1.8836627406238904
deviation-heading_median1.8836627406238904
deviation-heading_min0.7223539835652234
driven_any_max1.0681241059453177
driven_any_mean0.7231944252080988
driven_any_median0.7231944252080988
driven_any_min0.37826474447088027
driven_lanedir_consec_max0.3545049150661136
driven_lanedir_consec_mean0.23974057674616897
driven_lanedir_consec_min0.1249762384262243
driven_lanedir_max0.3545049150661136
driven_lanedir_mean0.23974057674616897
driven_lanedir_median0.23974057674616897
driven_lanedir_min0.1249762384262243
get_duckie_state_max2.208924451411165e-06
get_duckie_state_mean2.1475435092749185e-06
get_duckie_state_median2.1475435092749185e-06
get_duckie_state_min2.086162567138672e-06
get_robot_state_max0.0038757850142086257
get_robot_state_mean0.003826254494792996
get_robot_state_median0.003826254494792996
get_robot_state_min0.003776723975377367
get_state_dump_max0.005130760809954475
get_state_dump_mean0.004921661748652055
get_state_dump_median0.004921661748652055
get_state_dump_min0.0047125626873496355
get_ui_image_max0.03628760142042147
get_ui_image_mean0.03622914721262701
get_ui_image_median0.03622914721262701
get_ui_image_min0.03617069300483255
in-drivable-lane_max3.4999999999999876
in-drivable-lane_mean2.799999999999992
in-drivable-lane_min2.0999999999999956
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.37826474447088027, "get_ui_image": 0.03617069300483255, "step_physics": 0.16339017713771148, "survival_time": 3.349999999999996, "driven_lanedir": 0.1249762384262243, "get_state_dump": 0.005130760809954475, "get_robot_state": 0.0038757850142086257, "sim_render-ego0": 0.0037766063914579503, "get_duckie_state": 2.086162567138672e-06, "in-drivable-lane": 2.0999999999999956, "deviation-heading": 0.7223539835652234, "agent_compute-ego0": 0.01021024409462424, "complete-iteration": 0.23612857916775873, "set_robot_commands": 0.0021602546467500575, "deviation-center-line": 0.12976947958604176, "driven_lanedir_consec": 0.1249762384262243, "sim_compute_sim_state": 0.00934359255959006, "sim_compute_performance-ego0": 0.0019833305302788228}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.0681241059453177, "get_ui_image": 0.03628760142042147, "step_physics": 0.14493439844901987, "survival_time": 7.499999999999981, "driven_lanedir": 0.3545049150661136, "get_state_dump": 0.0047125626873496355, "get_robot_state": 0.003776723975377367, "sim_render-ego0": 0.003841108044251701, "get_duckie_state": 2.208924451411165e-06, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 3.0449714976825573, "agent_compute-ego0": 0.01062879657113789, "complete-iteration": 0.21936417257548957, "set_robot_commands": 0.00220216978464695, "deviation-center-line": 0.33643301407152215, "driven_lanedir_consec": 0.3545049150661136, "sim_compute_sim_state": 0.010833223923942112, "sim_compute_performance-ego0": 0.002054205003953138}}
set_robot_commands_max0.00220216978464695
set_robot_commands_mean0.002181212215698504
set_robot_commands_median0.002181212215698504
set_robot_commands_min0.0021602546467500575
sim_compute_performance-ego0_max0.002054205003953138
sim_compute_performance-ego0_mean0.0020187677671159804
sim_compute_performance-ego0_median0.0020187677671159804
sim_compute_performance-ego0_min0.0019833305302788228
sim_compute_sim_state_max0.010833223923942112
sim_compute_sim_state_mean0.010088408241766086
sim_compute_sim_state_median0.010088408241766086
sim_compute_sim_state_min0.00934359255959006
sim_render-ego0_max0.003841108044251701
sim_render-ego0_mean0.003808857217854826
sim_render-ego0_median0.003808857217854826
sim_render-ego0_min0.0037766063914579503
simulation-passed1
step_physics_max0.16339017713771148
step_physics_mean0.15416228779336566
step_physics_median0.15416228779336566
step_physics_min0.14493439844901987
survival_time_max7.499999999999981
survival_time_mean5.424999999999988
survival_time_min3.349999999999996
No reset possible
5345312572Bea Baselines 🐤straightaido5-LFI-full-sim-validationLFVIv-simsuccessyesnogpu-prod-070:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.621882608807794
survival_time_median11.375000000000028
deviation-center-line_median0.49572588831599385
in-drivable-lane_median6.400000000000036


other stats
agent_compute-ego0_max0.011425566780192967
agent_compute-ego0_mean0.011004449111239895
agent_compute-ego0_median0.011004449111239895
agent_compute-ego0_min0.010583331442286825
complete-iteration_max0.2219033786534194
complete-iteration_mean0.2163529541327887
complete-iteration_median0.2163529541327887
complete-iteration_min0.2108025296121581
deviation-center-line_max0.6702797201467701
deviation-center-line_mean0.49572588831599385
deviation-center-line_min0.3211720564852176
deviation-heading_max2.537022110462463
deviation-heading_mean2.4150494970903633
deviation-heading_median2.4150494970903633
deviation-heading_min2.293076883718264
driven_any_max1.7598441791834574
driven_any_mean1.7096148384926255
driven_any_median1.7096148384926255
driven_any_min1.6593854978017943
driven_lanedir_consec_max0.8696473510010638
driven_lanedir_consec_mean0.621882608807794
driven_lanedir_consec_min0.3741178666145242
driven_lanedir_max0.8790926140769271
driven_lanedir_mean0.6266052403457256
driven_lanedir_median0.6266052403457256
driven_lanedir_min0.3741178666145242
get_duckie_state_max1.5994358490400784e-06
get_duckie_state_mean1.568974451108414e-06
get_duckie_state_median1.568974451108414e-06
get_duckie_state_min1.5385130531767495e-06
get_robot_state_max0.00404684532918203
get_robot_state_mean0.0038534482804461743
get_robot_state_median0.0038534482804461743
get_robot_state_min0.00366005123171032
get_state_dump_max0.005195466926814195
get_state_dump_mean0.004937000277125453
get_state_dump_median0.004937000277125453
get_state_dump_min0.0046785336274367114
get_ui_image_max0.039036582938224214
get_ui_image_mean0.038065697523062755
get_ui_image_median0.038065697523062755
get_ui_image_min0.03709481210790129
in-drivable-lane_max8.200000000000035
in-drivable-lane_mean6.400000000000036
in-drivable-lane_min4.600000000000038
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 1.6593854978017943, "get_ui_image": 0.039036582938224214, "step_physics": 0.14124002905704516, "survival_time": 11.100000000000025, "driven_lanedir": 0.8790926140769271, "get_state_dump": 0.005195466926814195, "get_robot_state": 0.00404684532918203, "sim_render-ego0": 0.004074190764149208, "get_duckie_state": 1.5994358490400784e-06, "in-drivable-lane": 4.600000000000038, "deviation-heading": 2.537022110462463, "agent_compute-ego0": 0.011425566780192967, "complete-iteration": 0.2219033786534194, "set_robot_commands": 0.0024432569341274655, "deviation-center-line": 0.6702797201467701, "driven_lanedir_consec": 0.8696473510010638, "sim_compute_sim_state": 0.012148212424308196, "sim_compute_performance-ego0": 0.0021854558867723953}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7598441791834574, "get_ui_image": 0.03709481210790129, "step_physics": 0.13659584522247314, "survival_time": 11.65000000000003, "driven_lanedir": 0.3741178666145242, "get_state_dump": 0.0046785336274367114, "get_robot_state": 0.00366005123171032, "sim_render-ego0": 0.0037637011617676825, "get_duckie_state": 1.5385130531767495e-06, "in-drivable-lane": 8.200000000000035, "deviation-heading": 2.293076883718264, "agent_compute-ego0": 0.010583331442286825, "complete-iteration": 0.2108025296121581, "set_robot_commands": 0.002170017641833705, "deviation-center-line": 0.3211720564852176, "driven_lanedir_consec": 0.3741178666145242, "sim_compute_sim_state": 0.010163934821756477, "sim_compute_performance-ego0": 0.0019991408046494182}}
set_robot_commands_max0.0024432569341274655
set_robot_commands_mean0.002306637287980585
set_robot_commands_median0.002306637287980585
set_robot_commands_min0.002170017641833705
sim_compute_performance-ego0_max0.0021854558867723953
sim_compute_performance-ego0_mean0.0020922983457109068
sim_compute_performance-ego0_median0.0020922983457109068
sim_compute_performance-ego0_min0.0019991408046494182
sim_compute_sim_state_max0.012148212424308196
sim_compute_sim_state_mean0.011156073623032337
sim_compute_sim_state_median0.011156073623032337
sim_compute_sim_state_min0.010163934821756477
sim_render-ego0_max0.004074190764149208
sim_render-ego0_mean0.003918945962958446
sim_render-ego0_median0.003918945962958446
sim_render-ego0_min0.0037637011617676825
simulation-passed1
step_physics_max0.14124002905704516
step_physics_mean0.13891793713975914
step_physics_median0.13891793713975914
step_physics_min0.13659584522247314
survival_time_max11.65000000000003
survival_time_mean11.375000000000028
survival_time_min11.100000000000025
No reset possible
5344212576Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-070:11:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.57719292024425
survival_time_median11.15000000000006
deviation-center-line_median0.49998082892113976
in-drivable-lane_median6.2000000000000535


other stats
agent_compute-ego0_max0.011298679443727056
agent_compute-ego0_mean0.010727607119809402
agent_compute-ego0_median0.010727607119809402
agent_compute-ego0_min0.010156534795891748
agent_compute-npc0_max0.04304225738734415
agent_compute-npc0_mean0.04279318045893013
agent_compute-npc0_median0.04279318045893013
agent_compute-npc0_min0.04254410353051611
agent_compute-npc1_max0.04319526201271149
agent_compute-npc1_mean0.04060563877443804
agent_compute-npc1_median0.04060563877443804
agent_compute-npc1_min0.038016015536164585
agent_compute-npc2_max0.04260115163872041
agent_compute-npc2_mean0.03731975782859992
agent_compute-npc2_median0.03731975782859992
agent_compute-npc2_min0.03203836401847944
complete-iteration_max1.093121491282819
complete-iteration_mean1.0324365801456286
complete-iteration_median1.0324365801456286
complete-iteration_min0.971751669008438
deviation-center-line_max0.880854907567805
deviation-center-line_mean0.49998082892113976
deviation-center-line_min0.11910675027447444
deviation-heading_max2.497198994678309
deviation-heading_mean1.7143984686681213
deviation-heading_median1.7143984686681213
deviation-heading_min0.9315979426579334
driven_any_max2.836260992045463
driven_any_mean1.67123286605405
driven_any_median1.67123286605405
driven_any_min0.5062047400626375
driven_lanedir_consec_max0.980436367760506
driven_lanedir_consec_mean0.57719292024425
driven_lanedir_consec_min0.17394947272799377
driven_lanedir_max1.160056111801557
driven_lanedir_mean0.6670027922647754
driven_lanedir_median0.6670027922647754
driven_lanedir_min0.17394947272799377
get_duckie_state_max1.625842358692583e-06
get_duckie_state_mean1.586965059443145e-06
get_duckie_state_median1.586965059443145e-06
get_duckie_state_min1.5480877601937072e-06
get_robot_state_max0.015684762632990457
get_robot_state_mean0.015015294737185478
get_robot_state_median0.015015294737185478
get_robot_state_min0.0143458268413805
get_state_dump_max0.01052607398435294
get_state_dump_mean0.010052348910670288
get_state_dump_median0.010052348910670288
get_state_dump_min0.00957862383698764
get_ui_image_max0.053948468472584186
get_ui_image_mean0.05297678893382527
get_ui_image_median0.05297678893382527
get_ui_image_min0.052005109395066355
in-drivable-lane_max9.900000000000114
in-drivable-lane_mean6.2000000000000535
in-drivable-lane_min2.499999999999993
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 2.836260992045463, "get_ui_image": 0.052005109395066355, "step_physics": 0.7005549019330168, "survival_time": 18.200000000000124, "driven_lanedir": 1.160056111801557, "get_state_dump": 0.00957862383698764, "get_robot_state": 0.0143458268413805, "sim_render-ego0": 0.0037842391288443783, "sim_render-npc0": 0.003708783241167461, "sim_render-npc1": 0.003772066717278468, "sim_render-npc2": 0.0038524523173293023, "get_duckie_state": 1.5480877601937072e-06, "in-drivable-lane": 9.900000000000114, "deviation-heading": 2.497198994678309, "agent_compute-ego0": 0.010156534795891748, "agent_compute-npc0": 0.04304225738734415, "agent_compute-npc1": 0.038016015536164585, "agent_compute-npc2": 0.03203836401847944, "complete-iteration": 0.971751669008438, "set_robot_commands": 0.0022393494436185653, "deviation-center-line": 0.880854907567805, "driven_lanedir_consec": 0.980436367760506, "sim_compute_sim_state": 0.0398883094526317, "sim_compute_performance-ego0": 0.002158237483403454, "sim_compute_performance-npc0": 0.0019281589821593403, "sim_compute_performance-npc1": 0.001965394085400725, "sim_compute_performance-npc2": 0.0019269747276828711}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.5062047400626375, "get_ui_image": 0.053948468472584186, "step_physics": 0.7904092346329287, "survival_time": 4.099999999999993, "driven_lanedir": 0.17394947272799377, "get_state_dump": 0.01052607398435294, "get_robot_state": 0.015684762632990457, "sim_render-ego0": 0.004206783800240022, "sim_render-npc0": 0.004004412386790815, "sim_render-npc1": 0.004074386803500624, "sim_render-npc2": 0.00407193654991058, "get_duckie_state": 1.625842358692583e-06, "in-drivable-lane": 2.499999999999993, "deviation-heading": 0.9315979426579334, "agent_compute-ego0": 0.011298679443727056, "agent_compute-npc0": 0.04254410353051611, "agent_compute-npc1": 0.04319526201271149, "agent_compute-npc2": 0.04260115163872041, "complete-iteration": 1.093121491282819, "set_robot_commands": 0.0025348433529038027, "deviation-center-line": 0.11910675027447444, "driven_lanedir_consec": 0.17394947272799377, "sim_compute_sim_state": 0.04760258743561894, "sim_compute_performance-ego0": 0.00238595813153738, "sim_compute_performance-npc0": 0.002047696745539286, "sim_compute_performance-npc1": 0.002224060426275414, "sim_compute_performance-npc2": 0.0022082443696906768}}
set_robot_commands_max0.0025348433529038027
set_robot_commands_mean0.002387096398261184
set_robot_commands_median0.002387096398261184
set_robot_commands_min0.0022393494436185653
sim_compute_performance-ego0_max0.00238595813153738
sim_compute_performance-ego0_mean0.0022720978074704168
sim_compute_performance-ego0_median0.0022720978074704168
sim_compute_performance-ego0_min0.002158237483403454
sim_compute_performance-npc0_max0.002047696745539286
sim_compute_performance-npc0_mean0.0019879278638493133
sim_compute_performance-npc0_median0.0019879278638493133
sim_compute_performance-npc0_min0.0019281589821593403
sim_compute_performance-npc1_max0.002224060426275414
sim_compute_performance-npc1_mean0.0020947272558380697
sim_compute_performance-npc1_median0.0020947272558380697
sim_compute_performance-npc1_min0.001965394085400725
sim_compute_performance-npc2_max0.0022082443696906768
sim_compute_performance-npc2_mean0.002067609548686774
sim_compute_performance-npc2_median0.002067609548686774
sim_compute_performance-npc2_min0.0019269747276828711
sim_compute_sim_state_max0.04760258743561894
sim_compute_sim_state_mean0.04374544844412532
sim_compute_sim_state_median0.04374544844412532
sim_compute_sim_state_min0.0398883094526317
sim_render-ego0_max0.004206783800240022
sim_render-ego0_mean0.0039955114645422
sim_render-ego0_median0.0039955114645422
sim_render-ego0_min0.0037842391288443783
sim_render-npc0_max0.004004412386790815
sim_render-npc0_mean0.003856597813979138
sim_render-npc0_median0.003856597813979138
sim_render-npc0_min0.003708783241167461
sim_render-npc1_max0.004074386803500624
sim_render-npc1_mean0.003923226760389546
sim_render-npc1_median0.003923226760389546
sim_render-npc1_min0.003772066717278468
sim_render-npc2_max0.00407193654991058
sim_render-npc2_mean0.003962194433619941
sim_render-npc2_median0.003962194433619941
sim_render-npc2_min0.0038524523173293023
simulation-passed1
step_physics_max0.7904092346329287
step_physics_mean0.7454820682829728
step_physics_median0.7454820682829728
step_physics_min0.7005549019330168
survival_time_max18.200000000000124
survival_time_mean11.15000000000006
survival_time_min4.099999999999993
No reset possible
5341512563Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:07:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4679448379078439
survival_time_median9.099999999999994
deviation-center-line_median0.28010547392805896
in-drivable-lane_median5.3999999999999995


other stats
agent_compute-ego0_max0.010766703893642614
agent_compute-ego0_mean0.010614426370980574
agent_compute-ego0_median0.010615799525598489
agent_compute-ego0_min0.01045940253908271
complete-iteration_max0.21892207490522309
complete-iteration_mean0.1858205654680254
complete-iteration_median0.18212021002768847
complete-iteration_min0.1601197669115016
deviation-center-line_max0.32072493910540395
deviation-center-line_mean0.25559979359844043
deviation-center-line_min0.14146328743223982
deviation-heading_max2.573443739016378
deviation-heading_mean1.5714288535293366
deviation-heading_median1.510197503673426
deviation-heading_min0.6918766677541162
driven_any_max3.1619666979301324
driven_any_mean1.7218199472807565
driven_any_median1.3303261886048383
driven_any_min1.064660713983217
driven_lanedir_consec_max0.6348088856547565
driven_lanedir_consec_mean0.46870191550881374
driven_lanedir_consec_min0.30410910056481066
driven_lanedir_max0.6348088856547565
driven_lanedir_mean0.46870191550881374
driven_lanedir_median0.4679448379078439
driven_lanedir_min0.30410910056481066
get_duckie_state_max1.4794935094247951e-06
get_duckie_state_mean1.4027498583400915e-06
get_duckie_state_median1.4041808782356352e-06
get_duckie_state_min1.3231441674643006e-06
get_robot_state_max0.0040509759789646264
get_robot_state_mean0.003924190360658612
get_robot_state_median0.003963444128388002
get_robot_state_min0.00371889720689382
get_state_dump_max0.005262744489800993
get_state_dump_mean0.005160070211792591
get_state_dump_median0.005213818329322283
get_state_dump_min0.00494989969872481
get_ui_image_max0.038264195124308266
get_ui_image_mean0.03161864384601171
get_ui_image_median0.030451413496823617
get_ui_image_min0.02730755326609132
in-drivable-lane_max17.10000000000013
in-drivable-lane_mean7.750000000000028
in-drivable-lane_min3.099999999999989
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.1619666979301324, "get_ui_image": 0.030560385472703688, "step_physics": 0.11178503414191822, "survival_time": 20.15000000000015, "driven_lanedir": 0.30410910056481066, "get_state_dump": 0.005190939596383878, "get_robot_state": 0.0040509759789646264, "sim_render-ego0": 0.0041352008829022395, "get_duckie_state": 1.4794935094247951e-06, "in-drivable-lane": 17.10000000000013, "deviation-heading": 2.2006053649220667, "agent_compute-ego0": 0.010766703893642614, "complete-iteration": 0.1821390172042469, "set_robot_commands": 0.002466975462318647, "deviation-center-line": 0.32072493910540395, "driven_lanedir_consec": 0.30410910056481066, "sim_compute_sim_state": 0.010799081018655609, "sim_compute_performance-ego0": 0.0022787622886128946}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2799908315657689, "get_ui_image": 0.038264195124308266, "step_physics": 0.14099742463753048, "survival_time": 8.79999999999999, "driven_lanedir": 0.36310013377323225, "get_state_dump": 0.005236697062260687, "get_robot_state": 0.00398594646130578, "sim_render-ego0": 0.0040588284616416455, "get_duckie_state": 1.336221641066384e-06, "in-drivable-lane": 5.2999999999999945, "deviation-heading": 2.573443739016378, "agent_compute-ego0": 0.010733019834184378, "complete-iteration": 0.21892207490522309, "set_robot_commands": 0.0024426454878122795, "deviation-center-line": 0.290227640897717, "driven_lanedir_consec": 0.36310013377323225, "sim_compute_sim_state": 0.01093871175906079, "sim_compute_performance-ego0": 0.002158710512064271}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.064660713983217, "get_ui_image": 0.030342441520943543, "step_physics": 0.11642417844557604, "survival_time": 7.499999999999981, "driven_lanedir": 0.6348088856547565, "get_state_dump": 0.00494989969872481, "get_robot_state": 0.00371889720689382, "sim_render-ego0": 0.0038279523912644543, "get_duckie_state": 1.3231441674643006e-06, "in-drivable-lane": 3.099999999999989, "deviation-heading": 0.8197896424247854, "agent_compute-ego0": 0.01045940253908271, "complete-iteration": 0.18210140285113, "set_robot_commands": 0.002209889178244483, "deviation-center-line": 0.14146328743223982, "driven_lanedir_consec": 0.6348088856547565, "sim_compute_sim_state": 0.008064566858556886, "sim_compute_performance-ego0": 0.002012358595993345}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3806615456439078, "get_ui_image": 0.02730755326609132, "step_physics": 0.09886401923245224, "survival_time": 9.4, "driven_lanedir": 0.5727895420424556, "get_state_dump": 0.005262744489800993, "get_robot_state": 0.003940941795470223, "sim_render-ego0": 0.004044868327953198, "get_duckie_state": 1.472140115404886e-06, "in-drivable-lane": 5.500000000000004, "deviation-heading": 0.6918766677541162, "agent_compute-ego0": 0.010498579217012596, "complete-iteration": 0.1601197669115016, "set_robot_commands": 0.0024333693993785393, "deviation-center-line": 0.26998330695840084, "driven_lanedir_consec": 0.5727895420424556, "sim_compute_sim_state": 0.005493841474018399, "sim_compute_performance-ego0": 0.0021687462216331845}}
set_robot_commands_max0.002466975462318647
set_robot_commands_mean0.002388219881938487
set_robot_commands_median0.0024380074435954094
set_robot_commands_min0.002209889178244483
sim_compute_performance-ego0_max0.0022787622886128946
sim_compute_performance-ego0_mean0.002154644404575924
sim_compute_performance-ego0_median0.002163728366848728
sim_compute_performance-ego0_min0.002012358595993345
sim_compute_sim_state_max0.01093871175906079
sim_compute_sim_state_mean0.008824050277572921
sim_compute_sim_state_median0.009431823938606247
sim_compute_sim_state_min0.005493841474018399
sim_render-ego0_max0.0041352008829022395
sim_render-ego0_mean0.004016712515940385
sim_render-ego0_median0.004051848394797422
sim_render-ego0_min0.0038279523912644543
simulation-passed1
step_physics_max0.14099742463753048
step_physics_mean0.11701766411436926
step_physics_median0.11410460629374714
step_physics_min0.09886401923245224
survival_time_max20.15000000000015
survival_time_mean11.46250000000003
survival_time_min7.499999999999981
No reset possible
5339712567Bea Baselines 🐤straightaido5-LFP-sim-testingLFP-simabortednonogpu-prod-070:01:38
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5337612577Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simabortednonogpu-prod-070:46:17
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5333412574Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simabortednonogpu-prod-070:09:00
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5331612540Bea Baselines 🐤template-rosaido5-LFI-sim-validationLFVIv-simabortednonogpu-prod-070:09:28
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5330612485Bea Baselines 🐤straightaido5-LFVI-sim-validationLFVIv-simabortednonogpu-prod-070:12:58
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5328411410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simabortednonogpu-prod-070:07:13
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5324212479Bea Baselines 🐤straightaido5-LFV_multi-sim-testingLFVmultibodyv-simerrornonogpu-prod-070:07:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140357774296352
- M:video_aido:cmdline(in:/;out:/) 140357775045008
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5323212483Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simerrornonogpu-prod-070:01:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139995709523664
- M:video_aido:cmdline(in:/;out:/) 139995709524336
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5320412484Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simerrornonogpu-prod-070:02:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140013143664816
- M:video_aido:cmdline(in:/;out:/) 140013143733680
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5319612485Bea Baselines 🐤straightaido5-LFVI-sim-validationLFVIv-simerrornonogpu-prod-070:02:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140266933797696
- M:video_aido:cmdline(in:/;out:/) 140266933798608
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5319112486Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-070:03:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140048093524080
- M:video_aido:cmdline(in:/;out:/) 140048093524320
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5315911768Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-070:08:52
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140275619920384
- M:video_aido:cmdline(in:/;out:/) 140275619917936
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5314211771Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-070:03:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139927085612960
- M:video_aido:cmdline(in:/;out:/) 139927086504208
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5311511778Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-070:06:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139709746375600
- M:video_aido:cmdline(in:/;out:/) 139709746369056
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5308712341Bea Baselines 🐤template-rosaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-070:03:32
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1176, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 758, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5307212347Bea Baselines 🐤template-rosaido5-LFI-full-sim-validationLFVIv-simerrornonogpu-prod-070:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139894821250432
- M:video_aido:cmdline(in:/;out:/) 139899594053904
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5305912345Bea Baselines 🐤template-rosaido5-LFI-sim-validationLFVIv-simerrornonogpu-prod-070:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140474484887120
- M:video_aido:cmdline(in:/;out:/) 140474459377824
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5304812351Bea Baselines 🐤template-rosaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-070:04:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139784386593456
- M:video_aido:cmdline(in:/;out:/) 139784387919200
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5304112384Bea Baselines 🐤baseline-duckietownaido5-LFV-sim-validationLFVv-simerrornonogpu-prod-070:07:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140714406684128
- M:video_aido:cmdline(in:/;out:/) 140714405448912
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5303512385Bea Baselines 🐤baseline-duckietownaido5-LFI-full-sim-testingLFVIv-simerrornonogpu-prod-070:03:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140669238077040
- M:video_aido:cmdline(in:/;out:/) 140669238180544
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5299912396Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-070:25:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139817054192688
- M:video_aido:cmdline(in:/;out:/) 139817054194992
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5298712399Bea Baselines 🐤template-randomaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:01:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139788691816560
- M:video_aido:cmdline(in:/;out:/) 139788691799200
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5297312401Bea Baselines 🐤template-randomaido5-LFI-full-sim-testingLFVIv-simerrornonogpu-prod-070:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140508043004752
- M:video_aido:cmdline(in:/;out:/) 140508042263616
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5295812407Bea Baselines 🐤template-randomaido5-LFI-sim-testingLFVIv-simerrornonogpu-prod-070:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140374995280800
- M:video_aido:cmdline(in:/;out:/) 140374995281520
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5294612406Bea Baselines 🐤template-randomaido5-LFI-sim-validationLFVIv-simerrornonogpu-prod-070:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140544740837264
- M:video_aido:cmdline(in:/;out:/) 140544740852736
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
529189367Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-070:03:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140620825746112
- M:video_aido:cmdline(in:/;out:/) 140620825743424
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5290311122Olga (Ge Ya) Xu 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailednonogpu-prod-070:02:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5289012436Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simerrornonogpu-prod-070:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140344917292608
- M:video_aido:cmdline(in:/;out:/) 140344917294864
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5288212436Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simerrornonogpu-prod-070:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139993362079456
- M:video_aido:cmdline(in:/;out:/) 139993362079072
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5287112429Bea Baselines 🐤straightaido5-LFV-sim-validationLFVv-simerrornonogpu-prod-070:01:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140536661463920
- M:video_aido:cmdline(in:/;out:/) 140536660740992
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5285312433Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simabortednonogpu-prod-070:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5282912434Bea Baselines 🐤straightaido5-LFV_multi-sim-testingLFVmultibodyv-simabortednonogpu-prod-070:01:28
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5281112440Bea Baselines 🐤straightaido5-LFVI-sim-validationLFVIv-simerrornonogpu-prod-070:02:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140302650103984
- M:video_aido:cmdline(in:/;out:/) 140302650102448
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5279512413Bea Baselines 🐤template-randomaido5-LFVI_multi-sim-validationLFVIv-simhost-errornonogpu-prod-070:01:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5278112224Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simabortednonogpu-prod-070:01:52
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5276512352Bea Baselines 🐤template-rosaido5-LFVI_multi-sim-validationLFVIv-simabortednonogpu-prod-070:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5274812335Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simerrornonogpu-prod-070:02:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139641398610144
- M:video_aido:cmdline(in:/;out:/) 139641398610000
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5267111772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednonogpu-prod-070:00:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5261210936Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:04:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140140006406272
- M:video_aido:cmdline(in:/;out:/) 140140005992048
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525766806Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:04:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140335854201776
- M:video_aido:cmdline(in:/;out:/) 140335854202448
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525176831Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:10:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140070354730864
- M:video_aido:cmdline(in:/;out:/) 140070354753136
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524656848Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-070:08:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 791 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
523669301Raphael Jeanreal-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-070:10:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140440469879728
- M:video_aido:cmdline(in:/;out:/) 140440470213248
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
523469307Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-070:02:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
522979330Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:05:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140255288802512
- M:video_aido:cmdline(in:/;out:/) 140255288236880
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
522699339Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140487293987808
- M:video_aido:cmdline(in:/;out:/) 140487293985600
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5219010004Mo Kleit 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-070:07:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139837439293664
- M:video_aido:cmdline(in:/;out:/) 139837125516160
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5207010024Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-070:09:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140310674796016
- M:video_aido:cmdline(in:/;out:/) 140310675528768
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5201910066Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:06:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140073390838784
- M:video_aido:cmdline(in:/;out:/) 140073391044928
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5199010067Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:02:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140274759566480
- M:video_aido:cmdline(in:/;out:/) 140274759579584
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5196510066Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:02:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140160916867488
- M:video_aido:cmdline(in:/;out:/) 140160916959392
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5194310933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednonogpu-prod-070:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5189010073Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:03:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139633350803072
- M:video_aido:cmdline(in:/;out:/) 139633351262272
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5181410732Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:08:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140641381012912
- M:video_aido:cmdline(in:/;out:/) 140640927117856
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5172610772Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:09:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139989630360112
- M:video_aido:cmdline(in:/;out:/) 139989630379536
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5163410807Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:09:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139787662466880
- M:video_aido:cmdline(in:/;out:/) 139787660637904
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5159010833Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-070:03:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 31 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5155910829Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-070:03:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 29 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5146910871Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-070:09:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140031836409184
- M:video_aido:cmdline(in:/;out:/) 140031836828288
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5135810882Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:09:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139662600183232
- M:video_aido:cmdline(in:/;out:/) 139662601375216
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5133010888Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:02:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140267761151808
- M:video_aido:cmdline(in:/;out:/) 140267761255712
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5129910898Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-070:04:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140560190517648
- M:video_aido:cmdline(in:/;out:/) 140560190519376
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes: