Duckietown Challenges Home Challenges Submissions

Evaluator 2216

ID2216
evaluatorreg05-221dc42400b8-1
ownerI don't have one 😀
machinearchimede
processreg05-221dc42400b8-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success21 39546
# timeout1 39771
# failed10 39481
# error15 39488
# aborted4 39420
# host-error15 39407
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3987911122Olga (Ge Ya) Xu 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simabortednoreg05-221dc42400b8-10:49:42
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3986610942Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:12:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.027178296248118083
agent_compute-ego_mean0.02475785811742147
agent_compute-ego_median0.024131534496943156
agent_compute-ego_min0.023590067227681477
complete-iteration_max0.3396123115221659
complete-iteration_mean0.32103987455368044
complete-iteration_median0.31723334471384684
complete-iteration_min0.3100804972648621
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max4.0062268575032555e-06
get_duckie_state_mean3.615617752075195e-06
get_duckie_state_median3.528197606404622e-06
get_duckie_state_min3.399848937988281e-06
get_robot_state_max0.02136080026626587
get_robot_state_mean0.021016695896784465
get_robot_state_median0.02106401920318603
get_robot_state_min0.02057794491449992
get_state_dump_max0.017448464234670003
get_state_dump_mean0.017134941418965655
get_state_dump_median0.017061753273010252
get_state_dump_min0.01696779489517212
get_ui_image_max0.06016951958338419
get_ui_image_mean0.0590640127658844
get_ui_image_median0.05907274166742961
get_ui_image_min0.05794104814529419
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.05855909109115601, "step_physics": 0.13929948250452678, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01707847833633423, "sim_render-ego": 0.008889821370442709, "get_robot_state": 0.02136080026626587, "get_duckie_state": 3.650983174641927e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024478986263275142, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.31471366246541344, "set_robot_commands": 0.006643230120340983, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.032336823145548504, "sim_compute_performance-ego": 0.005856363773345947}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.05794104814529419, "step_physics": 0.1396997610727946, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01696779489517212, "sim_render-ego": 0.008899633884429931, "get_robot_state": 0.020846160252888997, "get_duckie_state": 3.4054120381673177e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.023784082730611167, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.3100804972648621, "set_robot_commands": 0.0066350030899047854, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02941269795099894, "sim_compute_performance-ego": 0.005695153077443441}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.059586392243703205, "step_physics": 0.14212331612904866, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.017448464234670003, "sim_render-ego": 0.008744923273722331, "get_robot_state": 0.02128187815348307, "get_duckie_state": 4.0062268575032555e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.027178296248118083, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.31975302696228025, "set_robot_commands": 0.0065078051884969075, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.030689982573191325, "sim_compute_performance-ego": 0.005986244678497315}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.06016951958338419, "step_physics": 0.16322335799535115, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01704502820968628, "sim_render-ego": 0.008648911317189534, "get_robot_state": 0.02057794491449992, "get_duckie_state": 3.399848937988281e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.023590067227681477, "deviation-heading": 0.486072248607516, "complete-iteration": 0.3396123115221659, "set_robot_commands": 0.0064815704027811685, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0342360782623291, "sim_compute_performance-ego": 0.0054413755734761555}}
set_robot_commands_max0.006643230120340983
set_robot_commands_mean0.006566902200380961
set_robot_commands_median0.0065714041392008465
set_robot_commands_min0.0064815704027811685
sim_compute_performance-ego_max0.005986244678497315
sim_compute_performance-ego_mean0.005744784275690714
sim_compute_performance-ego_median0.005775758425394694
sim_compute_performance-ego_min0.0054413755734761555
sim_compute_sim_state_max0.0342360782623291
sim_compute_sim_state_mean0.03166889548301697
sim_compute_sim_state_median0.03151340285936992
sim_compute_sim_state_min0.02941269795099894
sim_render-ego_max0.008899633884429931
sim_render-ego_mean0.008795822461446126
sim_render-ego_median0.00881737232208252
sim_render-ego_min0.008648911317189534
simulation-passed1
step_physics_max0.16322335799535115
step_physics_mean0.1460864794254303
step_physics_median0.14091153860092165
step_physics_min0.13929948250452678
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3986110943Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednoreg05-221dc42400b8-10:04:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 163 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3984710950Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:13:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8504405625048497
survival_time_median14.950000000000076
deviation-center-line_median0.4588812907032077
in-drivable-lane_median1.0750000000000153


other stats
agent_compute-ego_max0.06187569141387939
agent_compute-ego_mean0.0550755093495051
agent_compute-ego_median0.058440050681432085
agent_compute-ego_min0.04154624462127685
complete-iteration_max0.38631289958953857
complete-iteration_mean0.3684660087029139
complete-iteration_median0.3636003776391347
complete-iteration_min0.36035037994384767
deviation-center-line_max0.6482997681021622
deviation-center-line_mean0.4966073544149006
deviation-center-line_min0.4203670681510248
deviation-heading_max3.193893189277673
deviation-heading_mean1.9741309031502436
deviation-heading_median1.6757317170334725
deviation-heading_min1.3511669892563565
driven_any_max2.0421002467352904
driven_any_mean2.0374638722217573
driven_any_median2.0382905611321056
driven_any_min2.0311741198875275
driven_lanedir_consec_max2.0127740834531234
driven_lanedir_consec_mean1.8431373194479943
driven_lanedir_consec_min1.658894069329154
driven_lanedir_max2.0127740834531234
driven_lanedir_mean1.8431373194479943
driven_lanedir_median1.8504405625048497
driven_lanedir_min1.658894069329154
get_duckie_state_max4.3241182963053386e-06
get_duckie_state_mean4.227161407470703e-06
get_duckie_state_median4.238684972127279e-06
get_duckie_state_min4.107157389322917e-06
get_robot_state_max0.021203320026397705
get_robot_state_mean0.02069217264652252
get_robot_state_median0.02066792567571004
get_robot_state_min0.020229519208272297
get_state_dump_max0.017947558561960855
get_state_dump_mean0.017166792949040728
get_state_dump_median0.017149722973505657
get_state_dump_min0.016420167287190757
get_ui_image_max0.06929934978485107
get_ui_image_mean0.06381435056527456
get_ui_image_median0.06426438053448995
get_ui_image_min0.057429291407267255
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean1.0375000000000147
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.0311741198875275, "get_ui_image": 0.06500286102294922, "step_physics": 0.1578231128056844, "survival_time": 14.950000000000076, "driven_lanedir": 1.7137431973934238, "get_state_dump": 0.017059664726257324, "sim_render-ego": 0.009046061833699545, "get_robot_state": 0.020543081760406492, "get_duckie_state": 4.3241182963053386e-06, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.04154624462127685, "deviation-heading": 1.9297738511842033, "complete-iteration": 0.36035037994384767, "set_robot_commands": 0.0064983614285786945, "deviation-center-line": 0.4378372551314143, "driven_lanedir_consec": 1.7137431973934238, "sim_compute_sim_state": 0.03691694180170695, "sim_compute_performance-ego": 0.005725645224253337}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.0420852512314944, "get_ui_image": 0.06929934978485107, "step_physics": 0.16651150306065876, "survival_time": 14.950000000000076, "driven_lanedir": 2.0127740834531234, "get_state_dump": 0.016420167287190757, "sim_render-ego": 0.008588673273722331, "get_robot_state": 0.020229519208272297, "get_duckie_state": 4.107157389322917e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.057894538243611654, "deviation-heading": 1.4216895828827416, "complete-iteration": 0.38631289958953857, "set_robot_commands": 0.0061252133051554365, "deviation-center-line": 0.47992532627500106, "driven_lanedir_consec": 2.0127740834531234, "sim_compute_sim_state": 0.03557662010192871, "sim_compute_performance-ego": 0.005494472980499268}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.034495871032717, "get_ui_image": 0.06352590004603068, "step_physics": 0.14729553778966267, "survival_time": 14.950000000000076, "driven_lanedir": 1.658894069329154, "get_state_dump": 0.017239781220753987, "sim_render-ego": 0.009097317854563396, "get_robot_state": 0.02079276959101359, "get_duckie_state": 4.287560780843099e-06, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.05898556311925252, "deviation-heading": 3.193893189277673, "complete-iteration": 0.36568100611368815, "set_robot_commands": 0.009696067174275716, "deviation-center-line": 0.6482997681021622, "driven_lanedir_consec": 1.658894069329154, "sim_compute_sim_state": 0.033004788557688396, "sim_compute_performance-ego": 0.005858449935913086}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.0421002467352904, "get_ui_image": 0.057429291407267255, "step_physics": 0.1440281637509664, "survival_time": 14.950000000000076, "driven_lanedir": 1.9871379276162755, "get_state_dump": 0.017947558561960855, "sim_render-ego": 0.008896079063415527, "get_robot_state": 0.021203320026397705, "get_duckie_state": 4.1898091634114585e-06, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.06187569141387939, "deviation-heading": 1.3511669892563565, "complete-iteration": 0.3615197491645813, "set_robot_commands": 0.006469841003417969, "deviation-center-line": 0.4203670681510248, "driven_lanedir_consec": 1.9871379276162755, "sim_compute_sim_state": 0.037721261978149415, "sim_compute_performance-ego": 0.005762368043263753}}
set_robot_commands_max0.009696067174275716
set_robot_commands_mean0.007197370727856954
set_robot_commands_median0.006484101215998331
set_robot_commands_min0.0061252133051554365
sim_compute_performance-ego_max0.005858449935913086
sim_compute_performance-ego_mean0.005710234045982361
sim_compute_performance-ego_median0.005744006633758545
sim_compute_performance-ego_min0.005494472980499268
sim_compute_sim_state_max0.037721261978149415
sim_compute_sim_state_mean0.03580490310986836
sim_compute_sim_state_median0.03624678095181783
sim_compute_sim_state_min0.033004788557688396
sim_render-ego_max0.009097317854563396
sim_render-ego_mean0.0089070330063502
sim_render-ego_median0.008971070448557536
sim_render-ego_min0.008588673273722331
simulation-passed1
step_physics_max0.16651150306065876
step_physics_mean0.15391457935174305
step_physics_median0.15255932529767352
step_physics_min0.1440281637509664
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3984010955Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8216645625943867
survival_time_median4.3499999999999925
deviation-center-line_median0.14373370221582524
in-drivable-lane_median2.1999999999999935


other stats
agent_compute-ego_max0.04646003057086279
agent_compute-ego_mean0.029517536957876733
agent_compute-ego_median0.02411788170736497
agent_compute-ego_min0.023374353845914204
complete-iteration_max0.35595617975507465
complete-iteration_mean0.3183288688206265
complete-iteration_median0.3100615212368587
complete-iteration_min0.2972362530537141
deviation-center-line_max0.19535332213294643
deviation-center-line_mean0.13635590254704444
deviation-center-line_min0.06260288362358085
deviation-heading_max1.1243895888003586
deviation-heading_mean0.6446881538760754
deviation-heading_median0.5987320643834566
deviation-heading_min0.2568988979370295
driven_any_max2.91602964222727
driven_any_mean1.901313779289926
driven_any_median1.962157226603262
driven_any_min0.7649110217259106
driven_lanedir_consec_max1.1043001974149829
driven_lanedir_consec_mean0.7982282217431316
driven_lanedir_consec_min0.4452835643687699
driven_lanedir_max1.1043001974149829
driven_lanedir_mean0.7982282217431316
driven_lanedir_median0.8216645625943867
driven_lanedir_min0.4452835643687699
get_duckie_state_max3.930849906725761e-06
get_duckie_state_mean3.3776602174481777e-06
get_duckie_state_median3.2252735561794707e-06
get_duckie_state_min3.129243850708008e-06
get_robot_state_max0.025628969782874697
get_robot_state_mean0.02246344801816311
get_robot_state_median0.021651651232670516
get_robot_state_min0.020921519824436737
get_state_dump_max0.021500979151044573
get_state_dump_mean0.019137823315148537
get_state_dump_median0.018652840111500178
get_state_dump_min0.01774463388654921
get_ui_image_max0.05889295207129584
get_ui_image_mean0.05618749392902313
get_ui_image_median0.05700039047570456
get_ui_image_min0.051856242693387546
in-drivable-lane_max3.4999999999999876
in-drivable-lane_mean2.0499999999999936
in-drivable-lane_min0.30000000000000027
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.7649110217259106, "get_ui_image": 0.051856242693387546, "step_physics": 0.1270041954823029, "survival_time": 1.950000000000001, "driven_lanedir": 0.6063847661182338, "get_state_dump": 0.01930079093346229, "sim_render-ego": 0.008742735936091496, "get_robot_state": 0.02231437120682154, "get_duckie_state": 3.930849906725761e-06, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.02338071358509553, "deviation-heading": 0.2568988979370295, "complete-iteration": 0.2972362530537141, "set_robot_commands": 0.006992431787344126, "deviation-center-line": 0.10517763650507642, "driven_lanedir_consec": 0.6063847661182338, "sim_compute_sim_state": 0.02851421405107547, "sim_compute_performance-ego": 0.008953473506829677}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9160254967961245, "get_ui_image": 0.0570784296308245, "step_physics": 0.13357792014167422, "survival_time": 6.299999999999986, "driven_lanedir": 1.1043001974149829, "get_state_dump": 0.01774463388654921, "sim_render-ego": 0.00857785391429114, "get_robot_state": 0.020921519824436737, "get_duckie_state": 3.20351313030909e-06, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.02485504982963441, "deviation-heading": 1.1243895888003586, "complete-iteration": 0.3063487249707419, "set_robot_commands": 0.006617305770752922, "deviation-center-line": 0.19535332213294643, "driven_lanedir_consec": 1.1043001974149829, "sim_compute_sim_state": 0.03124400736793639, "sim_compute_performance-ego": 0.005545226354447622}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.008288956410399, "get_ui_image": 0.05692235132058462, "step_physics": 0.1375106523434321, "survival_time": 2.3999999999999995, "driven_lanedir": 0.4452835643687699, "get_state_dump": 0.018004889289538067, "sim_render-ego": 0.008902157346407572, "get_robot_state": 0.02098893125851949, "get_duckie_state": 3.129243850708008e-06, "in-drivable-lane": 1.099999999999999, "agent_compute-ego": 0.023374353845914204, "deviation-heading": 0.28648670906790585, "complete-iteration": 0.31377431750297546, "set_robot_commands": 0.013998915751775106, "deviation-center-line": 0.06260288362358085, "driven_lanedir_consec": 0.4452835643687699, "sim_compute_sim_state": 0.028045137723286945, "sim_compute_performance-ego": 0.005836054682731628}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.91602964222727, "get_ui_image": 0.05889295207129584, "step_physics": 0.13984205609276182, "survival_time": 6.299999999999986, "driven_lanedir": 1.0369443590705396, "get_state_dump": 0.021500979151044573, "sim_render-ego": 0.010000946029784187, "get_robot_state": 0.025628969782874697, "get_duckie_state": 3.247033982049851e-06, "in-drivable-lane": 3.4999999999999876, "agent_compute-ego": 0.04646003057086279, "deviation-heading": 0.9109774196990076, "complete-iteration": 0.35595617975507465, "set_robot_commands": 0.007724778992789132, "deviation-center-line": 0.1822897679265741, "driven_lanedir_consec": 1.0369443590705396, "sim_compute_sim_state": 0.03858639891185458, "sim_compute_performance-ego": 0.007125462804521833}}
set_robot_commands_max0.013998915751775106
set_robot_commands_mean0.00883335807566532
set_robot_commands_median0.007358605390066629
set_robot_commands_min0.006617305770752922
sim_compute_performance-ego_max0.008953473506829677
sim_compute_performance-ego_mean0.0068650543371326905
sim_compute_performance-ego_median0.006480758743626731
sim_compute_performance-ego_min0.005545226354447622
sim_compute_sim_state_max0.03858639891185458
sim_compute_sim_state_mean0.03159743951353835
sim_compute_sim_state_median0.02987911070950593
sim_compute_sim_state_min0.028045137723286945
sim_render-ego_max0.010000946029784187
sim_render-ego_mean0.009055923306643598
sim_render-ego_median0.008822446641249534
sim_render-ego_min0.00857785391429114
simulation-passed1
step_physics_max0.13984205609276182
step_physics_mean0.13448370601504275
step_physics_median0.13554428624255316
step_physics_min0.1270041954823029
survival_time_max6.299999999999986
survival_time_mean4.237499999999993
survival_time_min1.950000000000001
No reset possible
3983110962Himanshu Arora 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:11:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6865797639665203
survival_time_median14.950000000000076
deviation-center-line_median0.5928207735312181
in-drivable-lane_median1.3000000000000165


other stats
agent_compute-ego_max0.02543699343999227
agent_compute-ego_mean0.02456899046897888
agent_compute-ego_median0.024386072556177776
agent_compute-ego_min0.02406682332356771
complete-iteration_max0.323675008614858
complete-iteration_mean0.3091528449455897
complete-iteration_median0.30899362166722616
complete-iteration_min0.2949491278330485
deviation-center-line_max1.1667462951589205
deviation-center-line_mean0.6801361251384005
deviation-center-line_min0.3681566583322456
deviation-heading_max3.196786139177423
deviation-heading_mean2.177172040216756
deviation-heading_median1.9634966763083352
deviation-heading_min1.584908669072929
driven_any_max2.95830738790116
driven_any_mean2.8398510317921333
driven_any_median2.924042897069696
driven_any_min2.553010945127982
driven_lanedir_consec_max2.814398240980391
driven_lanedir_consec_mean2.5157282578837847
driven_lanedir_consec_min1.875355262621709
driven_lanedir_max2.814398240980391
driven_lanedir_mean2.5157282578837847
driven_lanedir_median2.6865797639665203
driven_lanedir_min1.875355262621709
get_duckie_state_max3.6843617757161458e-06
get_duckie_state_mean3.428061803181966e-06
get_duckie_state_median3.50038210550944e-06
get_duckie_state_min3.0271212259928387e-06
get_robot_state_max0.0221052877108256
get_robot_state_mean0.021296018759409587
get_robot_state_median0.02116953531901042
get_robot_state_min0.02073971668879191
get_state_dump_max0.019756419658660887
get_state_dump_mean0.018206710020701088
get_state_dump_median0.017994899749755856
get_state_dump_min0.017080620924631754
get_ui_image_max0.05866117477416992
get_ui_image_mean0.05510174016157786
get_ui_image_median0.054155757824579875
get_ui_image_min0.05343427022298177
in-drivable-lane_max3.6000000000000316
in-drivable-lane_mean1.7000000000000182
in-drivable-lane_min0.6000000000000085
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.9137323227726206, "get_ui_image": 0.05866117477416992, "step_physics": 0.1436131731669108, "survival_time": 14.950000000000076, "driven_lanedir": 2.738892924454047, "get_state_dump": 0.01856278896331787, "sim_render-ego": 0.010458736419677737, "get_robot_state": 0.0221052877108256, "get_duckie_state": 3.6080678304036457e-06, "in-drivable-lane": 0.8500000000000076, "agent_compute-ego": 0.02543699343999227, "deviation-heading": 1.7891490246960846, "complete-iteration": 0.323675008614858, "set_robot_commands": 0.0066957775751749675, "deviation-center-line": 0.46295749736660463, "driven_lanedir_consec": 2.738892924454047, "sim_compute_sim_state": 0.03216575702031454, "sim_compute_performance-ego": 0.005787083307902018}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.95830738790116, "get_ui_image": 0.05466927925745646, "step_physics": 0.126828564008077, "survival_time": 14.950000000000076, "driven_lanedir": 2.814398240980391, "get_state_dump": 0.017427010536193846, "sim_render-ego": 0.008532896041870117, "get_robot_state": 0.02073971668879191, "get_duckie_state": 3.3926963806152345e-06, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.02406682332356771, "deviation-heading": 2.137844327920586, "complete-iteration": 0.2949491278330485, "set_robot_commands": 0.006501382191975912, "deviation-center-line": 0.7226840496958316, "driven_lanedir_consec": 2.814398240980391, "sim_compute_sim_state": 0.030463701089223225, "sim_compute_performance-ego": 0.005536313851674398}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.553010945127982, "get_ui_image": 0.05343427022298177, "step_physics": 0.1327705224355062, "survival_time": 14.950000000000076, "driven_lanedir": 1.875355262621709, "get_state_dump": 0.019756419658660887, "sim_render-ego": 0.009006622632344564, "get_robot_state": 0.02156606674194336, "get_duckie_state": 3.6843617757161458e-06, "in-drivable-lane": 3.6000000000000316, "agent_compute-ego": 0.024665534496307373, "deviation-heading": 3.196786139177423, "complete-iteration": 0.304654974937439, "set_robot_commands": 0.006441756089528402, "deviation-center-line": 1.1667462951589205, "driven_lanedir_consec": 1.875355262621709, "sim_compute_sim_state": 0.03105786641438802, "sim_compute_performance-ego": 0.00576141357421875}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9343534713667707, "get_ui_image": 0.05364223639170329, "step_physics": 0.1417347510655721, "survival_time": 14.950000000000076, "driven_lanedir": 2.634266603478993, "get_state_dump": 0.017080620924631754, "sim_render-ego": 0.008405423959096273, "get_robot_state": 0.02077300389607747, "get_duckie_state": 3.0271212259928387e-06, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.02410661061604818, "deviation-heading": 1.584908669072929, "complete-iteration": 0.31333226839701334, "set_robot_commands": 0.006344123681386312, "deviation-center-line": 0.3681566583322456, "driven_lanedir_consec": 2.634266603478993, "sim_compute_sim_state": 0.03546601931254069, "sim_compute_performance-ego": 0.00559544563293457}}
set_robot_commands_max0.0066957775751749675
set_robot_commands_mean0.006495759884516399
set_robot_commands_median0.006471569140752156
set_robot_commands_min0.006344123681386312
sim_compute_performance-ego_max0.005787083307902018
sim_compute_performance-ego_mean0.005670064091682434
sim_compute_performance-ego_median0.00567842960357666
sim_compute_performance-ego_min0.005536313851674398
sim_compute_sim_state_max0.03546601931254069
sim_compute_sim_state_mean0.03228833595911662
sim_compute_sim_state_median0.03161181171735128
sim_compute_sim_state_min0.030463701089223225
sim_render-ego_max0.010458736419677737
sim_render-ego_mean0.009100919763247173
sim_render-ego_median0.00876975933710734
sim_render-ego_min0.008405423959096273
simulation-passed1
step_physics_max0.1436131731669108
step_physics_mean0.13623675266901653
step_physics_median0.13725263675053914
step_physics_min0.126828564008077
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3981810975Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:11:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0743389825309757
survival_time_median14.950000000000076
deviation-center-line_median0.5098390253106062
in-drivable-lane_median2.950000000000042


other stats
agent_compute-ego_max0.024745024840037027
agent_compute-ego_mean0.02441032961393014
agent_compute-ego_median0.02434145172437032
agent_compute-ego_min0.02421339016694289
complete-iteration_max0.32625586112340293
complete-iteration_mean0.3212834981007454
complete-iteration_median0.321588727419193
complete-iteration_min0.31570067644119265
deviation-center-line_max0.6741727489485848
deviation-center-line_mean0.5146903672158019
deviation-center-line_min0.3649106692934101
deviation-heading_max2.2410734772137237
deviation-heading_mean1.1964364113703445
deviation-heading_median0.8778595706563987
deviation-heading_min0.7889530269548559
driven_any_max2.6138891529962995
driven_any_mean2.524532715983602
driven_any_median2.6138584874501976
driven_any_min2.2565247360377123
driven_lanedir_consec_max2.434802012289152
driven_lanedir_consec_mean2.014352047358297
driven_lanedir_consec_min1.4739282120820851
driven_lanedir_max2.434802012289152
driven_lanedir_mean2.014352047358297
driven_lanedir_median2.0743389825309757
driven_lanedir_min1.4739282120820851
get_duckie_state_max5.097389221191406e-06
get_duckie_state_mean4.943456405248397e-06
get_duckie_state_median4.924230086497771e-06
get_duckie_state_min4.827976226806641e-06
get_robot_state_max0.02125980854034424
get_robot_state_mean0.021049671601026484
get_robot_state_median0.02105668789301163
get_robot_state_min0.020825502077738443
get_state_dump_max0.01801280419031779
get_state_dump_mean0.01742416799068451
get_state_dump_median0.017317730585734048
get_state_dump_min0.017048406600952148
get_ui_image_max0.05818979978561401
get_ui_image_mean0.05760777875398978
get_ui_image_median0.05758441656063765
get_ui_image_min0.05707248210906982
in-drivable-lane_max4.25000000000006
in-drivable-lane_mean2.7125000000000385
in-drivable-lane_min0.70000000000001
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2565247360377123, "get_ui_image": 0.05759026545744675, "step_physics": 0.1387808708044199, "survival_time": 13.00000000000005, "driven_lanedir": 1.4739282120820851, "get_state_dump": 0.017048406600952148, "sim_render-ego": 0.009014298365666315, "get_robot_state": 0.020964075051821195, "get_duckie_state": 4.906837756817158e-06, "in-drivable-lane": 4.25000000000006, "agent_compute-ego": 0.02421339016694289, "deviation-heading": 0.8407119488569719, "complete-iteration": 0.32031406439267673, "set_robot_commands": 0.006475426600529598, "deviation-center-line": 0.3649106692934101, "driven_lanedir_consec": 1.4739282120820851, "sim_compute_sim_state": 0.040142904795133154, "sim_compute_performance-ego": 0.0058753683016850395}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.6138891529962995, "get_ui_image": 0.05707248210906982, "step_physics": 0.14270278533299763, "survival_time": 14.950000000000076, "driven_lanedir": 2.0731492434771877, "get_state_dump": 0.01715009053548177, "sim_render-ego": 0.008713301022847493, "get_robot_state": 0.020825502077738443, "get_duckie_state": 4.941622416178385e-06, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.02423482815424601, "deviation-heading": 0.9150071924558256, "complete-iteration": 0.31570067644119265, "set_robot_commands": 0.006433804829915364, "deviation-center-line": 0.4428643135993823, "driven_lanedir_consec": 2.0731492434771877, "sim_compute_sim_state": 0.03270931323369344, "sim_compute_performance-ego": 0.005649898846944173}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.613829372202431, "get_ui_image": 0.05757856766382853, "step_physics": 0.1479289976755778, "survival_time": 14.950000000000076, "driven_lanedir": 2.434802012289152, "get_state_dump": 0.01748537063598633, "sim_render-ego": 0.008961907227834066, "get_robot_state": 0.021149300734202067, "get_duckie_state": 5.097389221191406e-06, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.02444807529449463, "deviation-heading": 2.2410734772137237, "complete-iteration": 0.3228633904457092, "set_robot_commands": 0.006370502312978109, "deviation-center-line": 0.6741727489485848, "driven_lanedir_consec": 2.434802012289152, "sim_compute_sim_state": 0.03294458866119385, "sim_compute_performance-ego": 0.005780386130015055}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.613887602697964, "get_ui_image": 0.05818979978561401, "step_physics": 0.14560510873794555, "survival_time": 14.950000000000076, "driven_lanedir": 2.075528721584764, "get_state_dump": 0.01801280419031779, "sim_render-ego": 0.008839178085327148, "get_robot_state": 0.02125980854034424, "get_duckie_state": 4.827976226806641e-06, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.024745024840037027, "deviation-heading": 0.7889530269548559, "complete-iteration": 0.32625586112340293, "set_robot_commands": 0.007373193899790446, "deviation-center-line": 0.57681373702183, "driven_lanedir_consec": 2.075528721584764, "sim_compute_sim_state": 0.03631832520167033, "sim_compute_performance-ego": 0.005702640215555827}}
set_robot_commands_max0.007373193899790446
set_robot_commands_mean0.006663231910803379
set_robot_commands_median0.0064546157152224806
set_robot_commands_min0.006370502312978109
sim_compute_performance-ego_max0.0058753683016850395
sim_compute_performance-ego_mean0.005752073373550024
sim_compute_performance-ego_median0.005741513172785441
sim_compute_performance-ego_min0.005649898846944173
sim_compute_sim_state_max0.040142904795133154
sim_compute_sim_state_mean0.035528782972922696
sim_compute_sim_state_median0.03463145693143209
sim_compute_sim_state_min0.03270931323369344
sim_render-ego_max0.009014298365666315
sim_render-ego_mean0.008882171175418755
sim_render-ego_median0.008900542656580607
sim_render-ego_min0.008713301022847493
simulation-passed1
step_physics_max0.1479289976755778
step_physics_mean0.1437544406377352
step_physics_median0.14415394703547155
step_physics_min0.1387808708044199
survival_time_max14.950000000000076
survival_time_mean14.46250000000007
survival_time_min13.00000000000005
No reset possible
3980810973Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:10:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5714360472809292
survival_time_median12.700000000000044
deviation-center-line_median0.3603844839579504
in-drivable-lane_median6.62500000000003


other stats
agent_compute-ego_max0.04791096369425456
agent_compute-ego_mean0.03028211186992703
agent_compute-ego_median0.02512987693531091
agent_compute-ego_min0.022957729914831734
complete-iteration_max0.3601857757568359
complete-iteration_mean0.33519308768163186
complete-iteration_median0.33548420895344366
complete-iteration_min0.3096181570628043
deviation-center-line_max0.6068538787377453
deviation-center-line_mean0.3910860226698648
deviation-center-line_min0.23672124402581315
deviation-heading_max2.470265522274854
deviation-heading_mean1.4050869105788466
deviation-heading_median1.3459337300759548
deviation-heading_min0.458214659888623
driven_any_max3.773870028187255
driven_any_mean2.728945841262248
driven_any_median2.5735668432703185
driven_any_min1.9947796503210984
driven_lanedir_consec_max1.9815324468169788
driven_lanedir_consec_mean1.6031223478432597
driven_lanedir_consec_min1.2880848499942006
driven_lanedir_max2.8130790644788
driven_lanedir_mean1.8110090022587149
driven_lanedir_median1.5714360472809292
driven_lanedir_min1.2880848499942006
get_duckie_state_max2.9969215393066407e-06
get_duckie_state_mean2.9480623892900512e-06
get_duckie_state_median2.9357607547357015e-06
get_duckie_state_min2.9238065083821615e-06
get_robot_state_max0.024042484760284425
get_robot_state_mean0.020780021697882595
get_robot_state_median0.01972955693921205
get_robot_state_min0.01961848815282186
get_state_dump_max0.016835236549377443
get_state_dump_mean0.0165986072089424
get_state_dump_median0.01670581524071701
get_state_dump_min0.016147561804958122
get_ui_image_max0.0688907790184021
get_ui_image_mean0.06230524781269289
get_ui_image_median0.06116305793403949
get_ui_image_min0.05800409636429052
in-drivable-lane_max8.450000000000092
in-drivable-lane_mean6.15000000000004
in-drivable-lane_min2.9000000000000083
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2273503870839515, "get_ui_image": 0.05800409636429052, "step_physics": 0.13564742809277405, "survival_time": 10.450000000000014, "driven_lanedir": 1.3988483577382815, "get_state_dump": 0.016702897240670676, "sim_render-ego": 0.008366621282112085, "get_robot_state": 0.019828723378158643, "get_duckie_state": 2.938594544333134e-06, "in-drivable-lane": 6.40000000000002, "agent_compute-ego": 0.02467188994850268, "deviation-heading": 0.458214659888623, "complete-iteration": 0.3096181570628043, "set_robot_commands": 0.006600539650072892, "deviation-center-line": 0.2571751946668863, "driven_lanedir_consec": 1.3988483577382815, "sim_compute_sim_state": 0.0340430052086497, "sim_compute_performance-ego": 0.005564490003448924}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9947796503210984, "get_ui_image": 0.061688172123419545, "step_physics": 0.14247934149686622, "survival_time": 9.45, "driven_lanedir": 1.2880848499942006, "get_state_dump": 0.016147561804958122, "sim_render-ego": 0.008418727804113317, "get_robot_state": 0.019630390500265455, "get_duckie_state": 2.932926965138269e-06, "in-drivable-lane": 2.9000000000000083, "agent_compute-ego": 0.022957729914831734, "deviation-heading": 2.470265522274854, "complete-iteration": 0.31614649989617566, "set_robot_commands": 0.006246954044967732, "deviation-center-line": 0.6068538787377453, "driven_lanedir_consec": 1.2880848499942006, "sim_compute_sim_state": 0.03300988232647931, "sim_compute_performance-ego": 0.005387075363643586}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.9197832994566855, "get_ui_image": 0.0688907790184021, "step_physics": 0.16745935599009196, "survival_time": 14.950000000000076, "driven_lanedir": 1.7440237368235771, "get_state_dump": 0.016708733240763347, "sim_render-ego": 0.009032021363576254, "get_robot_state": 0.01961848815282186, "get_duckie_state": 2.9238065083821615e-06, "in-drivable-lane": 8.450000000000092, "agent_compute-ego": 0.02558786392211914, "deviation-heading": 1.1265105132965194, "complete-iteration": 0.35482191801071167, "set_robot_commands": 0.006318795680999756, "deviation-center-line": 0.23672124402581315, "driven_lanedir_consec": 1.7440237368235771, "sim_compute_sim_state": 0.03540988842646281, "sim_compute_performance-ego": 0.005613316694895426}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.773870028187255, "get_ui_image": 0.060637943744659424, "step_physics": 0.14938796281814576, "survival_time": 14.950000000000076, "driven_lanedir": 2.8130790644788, "get_state_dump": 0.016835236549377443, "sim_render-ego": 0.008444037437438965, "get_robot_state": 0.024042484760284425, "get_duckie_state": 2.9969215393066407e-06, "in-drivable-lane": 6.850000000000041, "agent_compute-ego": 0.04791096369425456, "deviation-heading": 1.5653569468553905, "complete-iteration": 0.3601857757568359, "set_robot_commands": 0.006774276892344157, "deviation-center-line": 0.46359377324901446, "driven_lanedir_consec": 1.9815324468169788, "sim_compute_sim_state": 0.04069029490152995, "sim_compute_performance-ego": 0.005273675918579102}}
set_robot_commands_max0.006774276892344157
set_robot_commands_mean0.006485141567096134
set_robot_commands_median0.0064596676655363245
set_robot_commands_min0.006246954044967732
sim_compute_performance-ego_max0.005613316694895426
sim_compute_performance-ego_mean0.00545963949514176
sim_compute_performance-ego_median0.0054757826835462545
sim_compute_performance-ego_min0.005273675918579102
sim_compute_sim_state_max0.04069029490152995
sim_compute_sim_state_mean0.03578826771578045
sim_compute_sim_state_median0.03472644681755625
sim_compute_sim_state_min0.03300988232647931
sim_render-ego_max0.009032021363576254
sim_render-ego_mean0.008565351971810155
sim_render-ego_median0.00843138262077614
sim_render-ego_min0.008366621282112085
simulation-passed1
step_physics_max0.16745935599009196
step_physics_mean0.1487435220994695
step_physics_median0.14593365215750598
step_physics_min0.13564742809277405
survival_time_max14.950000000000076
survival_time_mean12.450000000000042
survival_time_min9.45
No reset possible
3979810988Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:10:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3234648610606838
survival_time_median10.125000000000009
deviation-center-line_median0.2934579959436934
in-drivable-lane_median3.7000000000000206


other stats
agent_compute-ego_max0.07686023554711971
agent_compute-ego_mean0.07019899252683155
agent_compute-ego_median0.07205389982964347
agent_compute-ego_min0.059827934900919595
complete-iteration_max0.4003955712590193
complete-iteration_mean0.3683224969342243
complete-iteration_median0.3653267957729363
complete-iteration_min0.34224082493200536
deviation-center-line_max0.721580139507547
deviation-center-line_mean0.3512260049463576
deviation-center-line_min0.0964078883904967
deviation-heading_max2.399397279921579
deviation-heading_mean1.57296934866128
deviation-heading_median1.7423495372892457
deviation-heading_min0.4077810401450498
driven_any_max3.0101655952768622
driven_any_mean2.544317183196429
driven_any_median2.6118099892564883
driven_any_min1.9434831589958788
driven_lanedir_consec_max1.999704858301003
driven_lanedir_consec_mean1.3135828400007192
driven_lanedir_consec_min0.6076967795805063
driven_lanedir_max1.999704858301003
driven_lanedir_mean1.3135828400007192
driven_lanedir_median1.3234648610606838
driven_lanedir_min0.6076967795805063
get_duckie_state_max4.2421061818192645e-06
get_duckie_state_mean3.421216273682303e-06
get_duckie_state_median3.2179835457471935e-06
get_duckie_state_min3.0067918214155603e-06
get_robot_state_max0.02572805960973104
get_robot_state_mean0.023705434860145497
get_robot_state_median0.023861315740838995
get_robot_state_min0.02137104834917296
get_state_dump_max0.02002480347951253
get_state_dump_mean0.019099698194886564
get_state_dump_median0.018963605474313923
get_state_dump_min0.01844677835140588
get_ui_image_max0.06347900968759171
get_ui_image_mean0.05909697264974465
get_ui_image_median0.060283656075315654
get_ui_image_min0.05234156876075559
in-drivable-lane_max12.800000000000075
in-drivable-lane_mean5.612500000000028
in-drivable-lane_min2.2499999999999947
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3648946705529026, "get_ui_image": 0.05234156876075559, "step_physics": 0.12169967918861203, "survival_time": 8.199999999999982, "driven_lanedir": 1.5413786740498607, "get_state_dump": 0.01882880926132202, "sim_render-ego": 0.009570930062270746, "get_robot_state": 0.023385661404307295, "get_duckie_state": 4.2421061818192645e-06, "in-drivable-lane": 2.2499999999999947, "agent_compute-ego": 0.06949264974128909, "deviation-heading": 1.4057795480041322, "complete-iteration": 0.34224082493200536, "set_robot_commands": 0.008380437769540927, "deviation-center-line": 0.2798985754631256, "driven_lanedir_consec": 1.5413786740498607, "sim_compute_sim_state": 0.03217574735967124, "sim_compute_performance-ego": 0.006132444230521597}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0101655952768622, "get_ui_image": 0.0591819500023464, "step_physics": 0.1343463198193964, "survival_time": 10.600000000000016, "driven_lanedir": 1.999704858301003, "get_state_dump": 0.01844677835140588, "sim_render-ego": 0.009952816198456962, "get_robot_state": 0.024336970077370696, "get_duckie_state": 3.2276477453843604e-06, "in-drivable-lane": 2.60000000000003, "agent_compute-ego": 0.07686023554711971, "deviation-heading": 2.399397279921579, "complete-iteration": 0.3710251518015591, "set_robot_commands": 0.008054808625635112, "deviation-center-line": 0.721580139507547, "driven_lanedir_consec": 1.999704858301003, "sim_compute_sim_state": 0.03345183606417674, "sim_compute_performance-ego": 0.006191078222022866}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9434831589958788, "get_ui_image": 0.06138536214828491, "step_physics": 0.13509003400802613, "survival_time": 14.950000000000076, "driven_lanedir": 0.6076967795805063, "get_state_dump": 0.02002480347951253, "sim_render-ego": 0.009950533707936604, "get_robot_state": 0.02572805960973104, "get_duckie_state": 3.208319346110026e-06, "in-drivable-lane": 12.800000000000075, "agent_compute-ego": 0.059827934900919595, "deviation-heading": 0.4077810401450498, "complete-iteration": 0.3596284397443136, "set_robot_commands": 0.007331613699595133, "deviation-center-line": 0.0964078883904967, "driven_lanedir_consec": 0.6076967795805063, "sim_compute_sim_state": 0.032596128781636556, "sim_compute_performance-ego": 0.007492020924886067}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.858725307960074, "get_ui_image": 0.06347900968759171, "step_physics": 0.1586683302963336, "survival_time": 9.650000000000002, "driven_lanedir": 1.105551048071507, "get_state_dump": 0.019098401687305824, "sim_render-ego": 0.00932508429097388, "get_robot_state": 0.02137104834917296, "get_duckie_state": 3.0067918214155603e-06, "in-drivable-lane": 4.800000000000011, "agent_compute-ego": 0.07461514991799785, "deviation-heading": 2.078919526574359, "complete-iteration": 0.4003955712590193, "set_robot_commands": 0.006571198992160935, "deviation-center-line": 0.3070174164242612, "driven_lanedir_consec": 1.105551048071507, "sim_compute_sim_state": 0.040829333616661904, "sim_compute_performance-ego": 0.006242427183556433}}
set_robot_commands_max0.008380437769540927
set_robot_commands_mean0.007584514771733027
set_robot_commands_median0.007693211162615123
set_robot_commands_min0.006571198992160935
sim_compute_performance-ego_max0.007492020924886067
sim_compute_performance-ego_mean0.00651449264024674
sim_compute_performance-ego_median0.00621675270278965
sim_compute_performance-ego_min0.006132444230521597
sim_compute_sim_state_max0.040829333616661904
sim_compute_sim_state_mean0.03476326145553661
sim_compute_sim_state_median0.03302398242290665
sim_compute_sim_state_min0.03217574735967124
sim_render-ego_max0.009952816198456962
sim_render-ego_mean0.009699841064909547
sim_render-ego_median0.009760731885103676
sim_render-ego_min0.00932508429097388
simulation-passed1
step_physics_max0.1586683302963336
step_physics_mean0.13745109082809204
step_physics_median0.13471817691371127
step_physics_min0.12169967918861203
survival_time_max14.950000000000076
survival_time_mean10.85000000000002
survival_time_min8.199999999999982
No reset possible
3978810988Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:12:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3128137306593084
survival_time_median9.925000000000006
deviation-center-line_median0.2951704353301277
in-drivable-lane_median4.975000000000016


other stats
agent_compute-ego_max0.07684937119483948
agent_compute-ego_mean0.05279024020328346
agent_compute-ego_median0.05514869905354683
agent_compute-ego_min0.024014191511200697
complete-iteration_max0.40205818351946376
complete-iteration_mean0.37860373970518063
complete-iteration_median0.38638824880123135
complete-iteration_min0.33958027769879595
deviation-center-line_max0.5846387283923908
deviation-center-line_mean0.3179913772521772
deviation-center-line_min0.09698590995606238
deviation-heading_max2.0665954425689854
deviation-heading_mean1.327534532504382
deviation-heading_median1.4161056010221098
deviation-heading_min0.4113314854043223
driven_any_max2.891681815302174
driven_any_mean2.623101352886527
driven_any_median2.6437417225776603
driven_any_min2.3132401510886123
driven_lanedir_consec_max1.9636454037953663
driven_lanedir_consec_mean1.299082196390772
driven_lanedir_consec_min0.6070559204491044
driven_lanedir_max1.9636454037953663
driven_lanedir_mean1.299082196390772
driven_lanedir_median1.3128137306593084
driven_lanedir_min0.6070559204491044
get_duckie_state_max3.4905970096588135e-06
get_duckie_state_mean3.2590271783119908e-06
get_duckie_state_median3.2409164810670356e-06
get_duckie_state_min3.063678741455078e-06
get_robot_state_max0.026506677269935608
get_robot_state_mean0.024263893930089233
get_robot_state_median0.02498796220411334
get_robot_state_min0.020572974042194644
get_state_dump_max0.020494048794110615
get_state_dump_mean0.01881937361415197
get_state_dump_median0.01903569127383985
get_state_dump_min0.01671206311481755
get_ui_image_max0.07435174364792674
get_ui_image_mean0.0648597508733618
get_ui_image_median0.0646460720581737
get_ui_image_min0.05579511572917303
in-drivable-lane_max12.800000000000075
in-drivable-lane_mean6.300000000000032
in-drivable-lane_min2.450000000000017
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3132401510886123, "get_ui_image": 0.06312805268822647, "step_physics": 0.15412788042208045, "survival_time": 10.25000000000001, "driven_lanedir": 1.5144773520966006, "get_state_dump": 0.01671206311481755, "sim_render-ego": 0.009253629824010337, "get_robot_state": 0.020572974042194644, "get_duckie_state": 3.2983175138147866e-06, "in-drivable-lane": 5.150000000000021, "agent_compute-ego": 0.024014191511200697, "deviation-heading": 1.0029177154101132, "complete-iteration": 0.33958027769879595, "set_robot_commands": 0.0063787227723656635, "deviation-center-line": 0.2481018845292018, "driven_lanedir_consec": 1.5144773520966006, "sim_compute_sim_state": 0.03910505946089582, "sim_compute_performance-ego": 0.006105613708496094}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.891681815302174, "get_ui_image": 0.07435174364792674, "step_physics": 0.1663190339740954, "survival_time": 9.5, "driven_lanedir": 1.9636454037953663, "get_state_dump": 0.018610129858318128, "sim_render-ego": 0.009022730275204309, "get_robot_state": 0.024897390917727823, "get_duckie_state": 3.1835154483192846e-06, "in-drivable-lane": 2.450000000000017, "agent_compute-ego": 0.0545596348611932, "deviation-heading": 1.8292934866341064, "complete-iteration": 0.40205818351946376, "set_robot_commands": 0.006874459668209678, "deviation-center-line": 0.5846387283923908, "driven_lanedir_consec": 1.9636454037953663, "sim_compute_sim_state": 0.041655535446970086, "sim_compute_performance-ego": 0.005583246130692331}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.45304866052365, "get_ui_image": 0.06616409142812094, "step_physics": 0.16167389154434203, "survival_time": 14.950000000000076, "driven_lanedir": 0.6070559204491044, "get_state_dump": 0.019461252689361573, "sim_render-ego": 0.010156206289927165, "get_robot_state": 0.02507853349049886, "get_duckie_state": 3.063678741455078e-06, "in-drivable-lane": 12.800000000000075, "agent_compute-ego": 0.05573776324590047, "deviation-heading": 0.4113314854043223, "complete-iteration": 0.3881138793627421, "set_robot_commands": 0.006776227156321208, "deviation-center-line": 0.09698590995606238, "driven_lanedir_consec": 0.6070559204491044, "sim_compute_sim_state": 0.03627173980077108, "sim_compute_performance-ego": 0.006612892150878906}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.83443478463167, "get_ui_image": 0.05579511572917303, "step_physics": 0.13725184773405394, "survival_time": 9.6, "driven_lanedir": 1.1111501092220164, "get_state_dump": 0.020494048794110615, "sim_render-ego": 0.011481924603382746, "get_robot_state": 0.026506677269935608, "get_duckie_state": 3.4905970096588135e-06, "in-drivable-lane": 4.8000000000000105, "agent_compute-ego": 0.07684937119483948, "deviation-heading": 2.0665954425689854, "complete-iteration": 0.38466261823972064, "set_robot_commands": 0.008858731637398401, "deviation-center-line": 0.34223898613105364, "driven_lanedir_consec": 1.1111501092220164, "sim_compute_sim_state": 0.04108801359931628, "sim_compute_performance-ego": 0.0061390163997809095}}
set_robot_commands_max0.008858731637398401
set_robot_commands_mean0.007222035308573738
set_robot_commands_median0.006825343412265443
set_robot_commands_min0.0063787227723656635
sim_compute_performance-ego_max0.006612892150878906
sim_compute_performance-ego_mean0.0061101920974620605
sim_compute_performance-ego_median0.0061223150541385015
sim_compute_performance-ego_min0.005583246130692331
sim_compute_sim_state_max0.041655535446970086
sim_compute_sim_state_mean0.03953008707698832
sim_compute_sim_state_median0.04009653653010605
sim_compute_sim_state_min0.03627173980077108
sim_render-ego_max0.011481924603382746
sim_render-ego_mean0.009978622748131138
sim_render-ego_median0.00970491805696875
sim_render-ego_min0.009022730275204309
simulation-passed1
step_physics_max0.1663190339740954
step_physics_mean0.15484316341864296
step_physics_median0.15790088598321125
step_physics_min0.13725184773405394
survival_time_max14.950000000000076
survival_time_mean11.075000000000022
survival_time_min9.5
No reset possible
3977110994Mo Kleit 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simtimeoutnoreg05-221dc42400b8-10:11:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3975911008Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:12:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9416926457076067
survival_time_median14.950000000000076
deviation-center-line_median0.525706214826481
in-drivable-lane_median0.8750000000000124


other stats
agent_compute-ego_max0.07207251866658529
agent_compute-ego_mean0.05481429911127278
agent_compute-ego_median0.06185764114061991
agent_compute-ego_min0.023469395497265982
complete-iteration_max0.3811270022392273
complete-iteration_mean0.34951583885679055
complete-iteration_median0.35418503403663637
complete-iteration_min0.30856628511466233
deviation-center-line_max1.0032020614079884
deviation-center-line_mean0.5698028283060713
deviation-center-line_min0.224596822163335
deviation-heading_max3.1067689435817525
deviation-heading_mean2.2122296427188832
deviation-heading_median2.0242277827700876
deviation-heading_min1.6936940617536065
driven_any_max2.2562779639073325
driven_any_mean1.960065063604074
driven_any_median2.061284007746381
driven_any_min1.4614142750162007
driven_lanedir_consec_max2.1293535220149153
driven_lanedir_consec_mean1.82057656820198
driven_lanedir_consec_min1.269567459377792
driven_lanedir_max2.1293535220149153
driven_lanedir_mean1.82057656820198
driven_lanedir_median1.9416926457076067
driven_lanedir_min1.269567459377792
get_duckie_state_max3.400970907772289e-06
get_duckie_state_mean3.304761998793658e-06
get_duckie_state_median3.333886464436849e-06
get_duckie_state_min3.1503041585286457e-06
get_robot_state_max0.02273621718088786
get_robot_state_mean0.021503821739963454
get_robot_state_median0.021543319085065057
get_robot_state_min0.020192431608835857
get_state_dump_max0.019950474898020428
get_state_dump_mean0.01804253412228005
get_state_dump_median0.017748433211270502
get_state_dump_min0.016722795168558756
get_ui_image_max0.061272260348002115
get_ui_image_mean0.059431198145829
get_ui_image_median0.059720742702484134
get_ui_image_min0.0570110468303456
in-drivable-lane_max1.2500000000000178
in-drivable-lane_mean0.7875000000000112
in-drivable-lane_min0.15000000000000213
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4614142750162007, "get_ui_image": 0.0570110468303456, "step_physics": 0.1343915474181082, "survival_time": 10.20000000000001, "driven_lanedir": 1.269567459377792, "get_state_dump": 0.017463141796635648, "sim_render-ego": 0.009104656238181918, "get_robot_state": 0.02148961436514761, "get_duckie_state": 3.400970907772289e-06, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.023469395497265982, "deviation-heading": 1.9759064285390135, "complete-iteration": 0.30856628511466233, "set_robot_commands": 0.00669703296586579, "deviation-center-line": 0.224596822163335, "driven_lanedir_consec": 1.269567459377792, "sim_compute_sim_state": 0.0322417651905733, "sim_compute_performance-ego": 0.006504292581595627}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.1816904511892092, "get_ui_image": 0.05960778554280599, "step_physics": 0.13113866329193116, "survival_time": 14.950000000000076, "driven_lanedir": 2.1293535220149153, "get_state_dump": 0.018033724625905356, "sim_render-ego": 0.008929606278737385, "get_robot_state": 0.021597023804982504, "get_duckie_state": 3.2901763916015627e-06, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.05647034962972005, "deviation-heading": 2.072549137001162, "complete-iteration": 0.3402196796735128, "set_robot_commands": 0.0066679565111796065, "deviation-center-line": 0.5281173396456809, "driven_lanedir_consec": 2.1293535220149153, "sim_compute_sim_state": 0.03187814315160115, "sim_compute_performance-ego": 0.005701661904652914}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9408775643035532, "get_ui_image": 0.05983369986216227, "step_physics": 0.13645129998524982, "survival_time": 14.950000000000076, "driven_lanedir": 1.813700763935784, "get_state_dump": 0.019950474898020428, "sim_render-ego": 0.00964359680811564, "get_robot_state": 0.02273621718088786, "get_duckie_state": 3.3775965372721353e-06, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.07207251866658529, "deviation-heading": 3.1067689435817525, "complete-iteration": 0.36815038839975994, "set_robot_commands": 0.007508512338002523, "deviation-center-line": 1.0032020614079884, "driven_lanedir_consec": 1.813700763935784, "sim_compute_sim_state": 0.032792121569315595, "sim_compute_performance-ego": 0.00696267286936442}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.2562779639073325, "get_ui_image": 0.061272260348002115, "step_physics": 0.15318803310394288, "survival_time": 14.950000000000076, "driven_lanedir": 2.069684527479429, "get_state_dump": 0.016722795168558756, "sim_render-ego": 0.00877506415049235, "get_robot_state": 0.020192431608835857, "get_duckie_state": 3.1503041585286457e-06, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.06724493265151978, "deviation-heading": 1.6936940617536065, "complete-iteration": 0.3811270022392273, "set_robot_commands": 0.006830613613128662, "deviation-center-line": 0.5232950900072811, "driven_lanedir_consec": 2.069684527479429, "sim_compute_sim_state": 0.040942706267038984, "sim_compute_performance-ego": 0.005751618544260661}}
set_robot_commands_max0.007508512338002523
set_robot_commands_mean0.006926028857044146
set_robot_commands_median0.006763823289497225
set_robot_commands_min0.0066679565111796065
sim_compute_performance-ego_max0.00696267286936442
sim_compute_performance-ego_mean0.006230061474968405
sim_compute_performance-ego_median0.006127955562928144
sim_compute_performance-ego_min0.005701661904652914
sim_compute_sim_state_max0.040942706267038984
sim_compute_sim_state_mean0.034463684044632265
sim_compute_sim_state_median0.032516943379944444
sim_compute_sim_state_min0.03187814315160115
sim_render-ego_max0.00964359680811564
sim_render-ego_mean0.009113230868881824
sim_render-ego_median0.00901713125845965
sim_render-ego_min0.00877506415049235
simulation-passed1
step_physics_max0.15318803310394288
step_physics_mean0.13879238594980803
step_physics_median0.135421423701679
step_physics_min0.13113866329193116
survival_time_max14.950000000000076
survival_time_mean13.76250000000006
survival_time_min10.20000000000001
No reset possible
3975611010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednoreg05-221dc42400b8-10:01:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 236, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 45, in init
             ||     raise Exception(msg)
             || Exception: I need a GPU; bailing.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 45, in init
             || |     raise Exception(msg)
             || | Exception: I need a GPU; bailing.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3974111025Mo Kleit 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:12:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6540618092166106
survival_time_median14.950000000000076
deviation-center-line_median0.3831542146638197
in-drivable-lane_median8.97500000000009


other stats
agent_compute-ego_max0.09040757099787394
agent_compute-ego_mean0.06545947770277659
agent_compute-ego_median0.07333105127016704
agent_compute-ego_min0.024768237272898355
complete-iteration_max0.3756659205754598
complete-iteration_mean0.35738617261250816
complete-iteration_median0.3705967040856679
complete-iteration_min0.3126853617032369
deviation-center-line_max0.8125379439730982
deviation-center-line_mean0.4689334054480438
deviation-center-line_min0.29688724849143755
deviation-heading_max3.1966768171460553
deviation-heading_mean1.7155766842838804
deviation-heading_median1.301956376403982
deviation-heading_min1.061717167181503
driven_any_max2.710634407109105
driven_any_mean2.299994373423891
driven_any_median2.3648021892470794
driven_any_min1.7597387080922997
driven_lanedir_consec_max2.072701308979523
driven_lanedir_consec_mean1.6150731257653863
driven_lanedir_consec_min1.079467575648801
driven_lanedir_max2.072701308979523
driven_lanedir_mean1.6150731257653863
driven_lanedir_median1.6540618092166106
driven_lanedir_min1.079467575648801
get_duckie_state_max3.647009531656901e-06
get_duckie_state_mean3.358920415242513e-06
get_duckie_state_median3.348986307779948e-06
get_duckie_state_min3.090699513753255e-06
get_robot_state_max0.024001986185709635
get_robot_state_mean0.022379216949145
get_robot_state_median0.022435522079467772
get_robot_state_min0.020643837451934818
get_state_dump_max0.018994621435801187
get_state_dump_mean0.017793511748313902
get_state_dump_median0.017789735794067382
get_state_dump_min0.01659995396931966
get_ui_image_max0.06198224385579427
get_ui_image_mean0.058071991006533305
get_ui_image_median0.0574224849541982
get_ui_image_min0.05546075026194255
in-drivable-lane_max9.900000000000087
in-drivable-lane_mean8.612500000000082
in-drivable-lane_min6.600000000000059
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.0345858587136205, "get_ui_image": 0.0590950624148051, "step_physics": 0.13562994718551635, "survival_time": 14.950000000000076, "driven_lanedir": 1.313655149031647, "get_state_dump": 0.01659995396931966, "sim_render-ego": 0.008920198281606038, "get_robot_state": 0.020643837451934818, "get_duckie_state": 3.383159637451172e-06, "in-drivable-lane": 9.900000000000087, "agent_compute-ego": 0.024768237272898355, "deviation-heading": 1.2463054811819003, "complete-iteration": 0.3126853617032369, "set_robot_commands": 0.006561500231424967, "deviation-center-line": 0.3536920516961408, "driven_lanedir_consec": 1.313655149031647, "sim_compute_sim_state": 0.03454459190368652, "sim_compute_performance-ego": 0.005706446170806885}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.710634407109105, "get_ui_image": 0.05546075026194255, "step_physics": 0.12686928431193034, "survival_time": 14.950000000000076, "driven_lanedir": 2.072701308979523, "get_state_dump": 0.017791247367858885, "sim_render-ego": 0.0097157621383667, "get_robot_state": 0.022066722710927328, "get_duckie_state": 3.314812978108724e-06, "in-drivable-lane": 8.550000000000093, "agent_compute-ego": 0.09040757099787394, "deviation-heading": 1.3576072716260634, "complete-iteration": 0.368738222916921, "set_robot_commands": 0.006824300289154052, "deviation-center-line": 0.41261637763149855, "driven_lanedir_consec": 2.072701308979523, "sim_compute_sim_state": 0.03345022201538086, "sim_compute_performance-ego": 0.005927782853444417}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.7597387080922997, "get_ui_image": 0.06198224385579427, "step_physics": 0.14657944599787395, "survival_time": 14.950000000000076, "driven_lanedir": 1.079467575648801, "get_state_dump": 0.018994621435801187, "sim_render-ego": 0.008949448267618815, "get_robot_state": 0.024001986185709635, "get_duckie_state": 3.090699513753255e-06, "in-drivable-lane": 6.600000000000059, "agent_compute-ego": 0.06396540800730387, "deviation-heading": 3.1966768171460553, "complete-iteration": 0.3724551852544149, "set_robot_commands": 0.007608443101247152, "deviation-center-line": 0.8125379439730982, "driven_lanedir_consec": 1.079467575648801, "sim_compute_sim_state": 0.03378563563028971, "sim_compute_performance-ego": 0.006367092927296957}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.695018519780538, "get_ui_image": 0.05574990749359131, "step_physics": 0.13471981604894, "survival_time": 14.950000000000076, "driven_lanedir": 1.9944684694015744, "get_state_dump": 0.01778822422027588, "sim_render-ego": 0.009738831520080569, "get_robot_state": 0.02280432144800822, "get_duckie_state": 3.647009531656901e-06, "in-drivable-lane": 9.40000000000009, "agent_compute-ego": 0.08269669453303019, "deviation-heading": 1.061717167181503, "complete-iteration": 0.3756659205754598, "set_robot_commands": 0.006660447915395101, "deviation-center-line": 0.29688724849143755, "driven_lanedir_consec": 1.9944684694015744, "sim_compute_sim_state": 0.03934380213419597, "sim_compute_performance-ego": 0.005936001936594645}}
set_robot_commands_max0.007608443101247152
set_robot_commands_mean0.006913672884305318
set_robot_commands_median0.006742374102274577
set_robot_commands_min0.006561500231424967
sim_compute_performance-ego_max0.006367092927296957
sim_compute_performance-ego_mean0.005984330972035726
sim_compute_performance-ego_median0.005931892395019531
sim_compute_performance-ego_min0.005706446170806885
sim_compute_sim_state_max0.03934380213419597
sim_compute_sim_state_mean0.03528106292088826
sim_compute_sim_state_median0.034165113766988116
sim_compute_sim_state_min0.03345022201538086
sim_render-ego_max0.009738831520080569
sim_render-ego_mean0.00933106005191803
sim_render-ego_median0.009332605202992755
sim_render-ego_min0.008920198281606038
simulation-passed1
step_physics_max0.14657944599787395
step_physics_mean0.13594962338606517
step_physics_median0.13517488161722818
step_physics_min0.12686928431193034
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3973911026Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailednoreg05-221dc42400b8-10:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego" aborted:

error in ego |Exception while handling a message on topic "get_commands".
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
             ||     handle_message_node(parsed, receiver0, context0)
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
             ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 68, in on_received_get_commands
             ||     velocity, omega = self.compute_action(self.current_image)
             ||   File "solution.py", line 63, in compute_action
             ||     observation = self.preprocessor.toTensor(observation).to(self._device)
             ||   File "/workspace/wrappers.py", line 23, in toTensor
             ||     return self.compose_obs(obs)
             ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/transforms.py", line 67, in __call__
             ||     img = t(img)
             ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
             ||     result = self.forward(*input, **kwargs)
             ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/transforms.py", line 226, in forward
             ||     return F.normalize(tensor, self.mean, self.std, self.inplace)
             ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/functional.py", line 284, in normalize
             ||     tensor.sub_(mean).div_(std)
             || RuntimeError: The size of tensor a (120) must match the size of tensor b (3) at non-singleton dimension 0
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3972811036Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:09:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.197175557441985
survival_time_median14.875000000000076
deviation-center-line_median0.5060838848707623
in-drivable-lane_median6.875000000000092


other stats
agent_compute-ego_max0.02649661223093669
agent_compute-ego_mean0.024391848024752763
agent_compute-ego_median0.024711362773233707
agent_compute-ego_min0.021648054321606953
complete-iteration_max0.3242323080698649
complete-iteration_mean0.30494448508228267
complete-iteration_median0.2987717271925093
complete-iteration_min0.2980021778742472
deviation-center-line_max0.5184841489455766
deviation-center-line_mean0.4267753529167322
deviation-center-line_min0.17644949297982762
deviation-heading_max2.4510701378967528
deviation-heading_mean1.6165059156619352
deviation-heading_median1.5571338788045517
deviation-heading_min0.9006857671418838
driven_any_max2.8809917808461885
driven_any_mean2.005152137900345
driven_any_median2.3969036672172876
driven_any_min0.34580943632061717
driven_lanedir_consec_max2.0054708633252827
driven_lanedir_consec_mean1.1613809964124535
driven_lanedir_consec_min0.2457020074405616
driven_lanedir_max2.0054708633252827
driven_lanedir_mean1.1613809964124535
driven_lanedir_median1.197175557441985
driven_lanedir_min0.2457020074405616
get_duckie_state_max4.216829935709636e-06
get_duckie_state_mean3.764585063264177e-06
get_duckie_state_median3.6897369333215664e-06
get_duckie_state_min3.462036450703939e-06
get_robot_state_max0.02260197658796568
get_robot_state_mean0.02168780639633402
get_robot_state_median0.02203569730122884
get_robot_state_min0.02007785439491272
get_state_dump_max0.018612037499745687
get_state_dump_mean0.017595849268071288
get_state_dump_median0.017571323578422136
get_state_dump_min0.01662871241569519
get_ui_image_max0.058273337682088214
get_ui_image_mean0.05419434606357738
get_ui_image_median0.05370877582479168
get_ui_image_min0.05108649492263794
in-drivable-lane_max8.300000000000061
in-drivable-lane_mean5.62500000000006
in-drivable-lane_min0.4499999999999984
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.30574210537404, "get_ui_image": 0.05108649492263794, "step_physics": 0.12115609884262084, "survival_time": 14.950000000000076, "driven_lanedir": 1.4019379286361588, "get_state_dump": 0.018612037499745687, "sim_render-ego": 0.009433004061381022, "get_robot_state": 0.02257546106974284, "get_duckie_state": 4.216829935709636e-06, "in-drivable-lane": 7.550000000000096, "agent_compute-ego": 0.02649661223093669, "deviation-heading": 1.5552841839022802, "complete-iteration": 0.2980021778742472, "set_robot_commands": 0.009466087023417155, "deviation-center-line": 0.5097663847983492, "driven_lanedir_consec": 1.4019379286361588, "sim_compute_sim_state": 0.03270671129226685, "sim_compute_performance-ego": 0.006263358592987061}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.34580943632061717, "get_ui_image": 0.05580128729343414, "step_physics": 0.13613346219062805, "survival_time": 2.3999999999999995, "driven_lanedir": 0.2457020074405616, "get_state_dump": 0.01662871241569519, "sim_render-ego": 0.007904847462972006, "get_robot_state": 0.02007785439491272, "get_duckie_state": 3.462036450703939e-06, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.021648054321606953, "deviation-heading": 0.9006857671418838, "complete-iteration": 0.2980671723683675, "set_robot_commands": 0.006169060866038005, "deviation-center-line": 0.17644949297982762, "driven_lanedir_consec": 0.2457020074405616, "sim_compute_sim_state": 0.028009340167045593, "sim_compute_performance-ego": 0.005505844950675964}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.4880652290605347, "get_ui_image": 0.058273337682088214, "step_physics": 0.14563985268274943, "survival_time": 14.950000000000076, "driven_lanedir": 0.992413186247811, "get_state_dump": 0.017286367416381836, "sim_render-ego": 0.01294105847676595, "get_robot_state": 0.021495933532714843, "get_duckie_state": 3.712177276611328e-06, "in-drivable-lane": 8.300000000000061, "agent_compute-ego": 0.02471018473307292, "deviation-heading": 2.4510701378967528, "complete-iteration": 0.3242323080698649, "set_robot_commands": 0.006459076404571534, "deviation-center-line": 0.5024013849431754, "driven_lanedir_consec": 0.992413186247811, "sim_compute_sim_state": 0.03139794190724691, "sim_compute_performance-ego": 0.005816407998402913}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8809917808461885, "get_ui_image": 0.05161626435614921, "step_physics": 0.12293180017857938, "survival_time": 14.800000000000075, "driven_lanedir": 2.0054708633252827, "get_state_dump": 0.017856279740462434, "sim_render-ego": 0.009140360999751736, "get_robot_state": 0.02260197658796568, "get_duckie_state": 3.667296590031804e-06, "in-drivable-lane": 6.200000000000088, "agent_compute-ego": 0.024712540813394496, "deviation-heading": 1.5589835737068234, "complete-iteration": 0.29947628201665105, "set_robot_commands": 0.008512031387638402, "deviation-center-line": 0.5184841489455766, "driven_lanedir_consec": 2.0054708633252827, "sim_compute_sim_state": 0.03600489448856663, "sim_compute_performance-ego": 0.0058924161099098826}}
set_robot_commands_max0.009466087023417155
set_robot_commands_mean0.007651563920416275
set_robot_commands_median0.007485553896104968
set_robot_commands_min0.006169060866038005
sim_compute_performance-ego_max0.006263358592987061
sim_compute_performance-ego_mean0.005869506912993955
sim_compute_performance-ego_median0.005854412054156398
sim_compute_performance-ego_min0.005505844950675964
sim_compute_sim_state_max0.03600489448856663
sim_compute_sim_state_mean0.032029721963781496
sim_compute_sim_state_median0.032052326599756875
sim_compute_sim_state_min0.028009340167045593
sim_render-ego_max0.01294105847676595
sim_render-ego_mean0.009854817750217678
sim_render-ego_median0.009286682530566378
sim_render-ego_min0.007904847462972006
simulation-passed1
step_physics_max0.14563985268274943
step_physics_mean0.13146530347364443
step_physics_median0.12953263118460373
step_physics_min0.12115609884262084
survival_time_max14.950000000000076
survival_time_mean11.775000000000055
survival_time_min2.3999999999999995
No reset possible
3971511057Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:11:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8567345316383133
survival_time_median14.950000000000076
deviation-center-line_median0.32701360591478235
in-drivable-lane_median2.4750000000000267


other stats
agent_compute-ego_max0.07069163640340169
agent_compute-ego_mean0.04279904555051754
agent_compute-ego_median0.03824026743570963
agent_compute-ego_min0.024024010927249224
complete-iteration_max0.3742577012379964
complete-iteration_mean0.3324506672529074
complete-iteration_median0.3247421336174011
complete-iteration_min0.3060607005388309
deviation-center-line_max0.786385310607949
deviation-center-line_mean0.4214915909586937
deviation-center-line_min0.24555384139726105
deviation-heading_max3.1430576394198653
deviation-heading_mean1.8916723990742197
deviation-heading_median1.6417209754204802
deviation-heading_min1.1401900060360524
driven_any_max2.3914643414760173
driven_any_mean2.059228626822428
driven_any_median2.202436408083193
driven_any_min1.4405773496473095
driven_lanedir_consec_max2.016405725404197
driven_lanedir_consec_mean1.7464809048181935
driven_lanedir_consec_min1.2560488305919506
driven_lanedir_max2.016405725404197
driven_lanedir_mean1.7464809048181935
driven_lanedir_median1.8567345316383133
driven_lanedir_min1.2560488305919506
get_duckie_state_max4.434585571289063e-06
get_duckie_state_mean4.232357709835737e-06
get_duckie_state_median4.341266094109951e-06
get_duckie_state_min3.812313079833984e-06
get_robot_state_max0.02237020174662272
get_robot_state_mean0.021333242960465255
get_robot_state_median0.021269190922761576
get_robot_state_min0.02042438824971517
get_state_dump_max0.01983263889948527
get_state_dump_mean0.01791454050785456
get_state_dump_median0.01752168881587493
get_state_dump_min0.016782145500183105
get_ui_image_max0.058660655816396075
get_ui_image_mean0.05716985242489057
get_ui_image_median0.057404138186039066
get_ui_image_min0.055210477511088055
in-drivable-lane_max3.000000000000042
in-drivable-lane_mean2.212500000000027
in-drivable-lane_min0.9000000000000128
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4405773496473095, "get_ui_image": 0.05746578681163299, "step_physics": 0.13228917244153146, "survival_time": 9.750000000000004, "driven_lanedir": 1.2560488305919506, "get_state_dump": 0.017403131876236353, "sim_render-ego": 0.008690852385300856, "get_robot_state": 0.021484853059817583, "get_duckie_state": 4.248741345527845e-06, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.024024010927249224, "deviation-heading": 1.957562018145743, "complete-iteration": 0.3060607005388309, "set_robot_commands": 0.006663700250478891, "deviation-center-line": 0.24555384139726105, "driven_lanedir_consec": 1.2560488305919506, "sim_compute_sim_state": 0.0318446220495762, "sim_compute_performance-ego": 0.00597232305086576}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.3711383744351013, "get_ui_image": 0.058660655816396075, "step_physics": 0.14004037539164224, "survival_time": 14.950000000000076, "driven_lanedir": 2.0051200637381084, "get_state_dump": 0.016782145500183105, "sim_render-ego": 0.008906274636586508, "get_robot_state": 0.02042438824971517, "get_duckie_state": 4.434585571289063e-06, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.024663407802581788, "deviation-heading": 1.3258799326952178, "complete-iteration": 0.31318620840708417, "set_robot_commands": 0.0064732702573140465, "deviation-center-line": 0.3256286824166292, "driven_lanedir_consec": 2.0051200637381084, "sim_compute_sim_state": 0.03128138144810994, "sim_compute_performance-ego": 0.005738477706909179}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.033734441731285, "get_ui_image": 0.055210477511088055, "step_physics": 0.13422298034032185, "survival_time": 14.950000000000076, "driven_lanedir": 1.7083489995385182, "get_state_dump": 0.01983263889948527, "sim_render-ego": 0.009181305567423505, "get_robot_state": 0.02237020174662272, "get_duckie_state": 4.4337908426920575e-06, "in-drivable-lane": 2.300000000000016, "agent_compute-ego": 0.05181712706883748, "deviation-heading": 3.1430576394198653, "complete-iteration": 0.33629805882771807, "set_robot_commands": 0.006937127908070882, "deviation-center-line": 0.786385310607949, "driven_lanedir_consec": 1.7083489995385182, "sim_compute_sim_state": 0.03061234951019287, "sim_compute_performance-ego": 0.0058852187792460126}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.3914643414760173, "get_ui_image": 0.05734248956044515, "step_physics": 0.14715797980626424, "survival_time": 14.950000000000076, "driven_lanedir": 2.016405725404197, "get_state_dump": 0.017640245755513508, "sim_render-ego": 0.00872642437616984, "get_robot_state": 0.021053528785705565, "get_duckie_state": 3.812313079833984e-06, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.07069163640340169, "deviation-heading": 1.1401900060360524, "complete-iteration": 0.3742577012379964, "set_robot_commands": 0.006642987728118896, "deviation-center-line": 0.3283985294129355, "driven_lanedir_consec": 2.016405725404197, "sim_compute_sim_state": 0.0391905943552653, "sim_compute_performance-ego": 0.005593294302622477}}
set_robot_commands_max0.006937127908070882
set_robot_commands_mean0.006679271535995679
set_robot_commands_median0.006653343989298894
set_robot_commands_min0.0064732702573140465
sim_compute_performance-ego_max0.00597232305086576
sim_compute_performance-ego_mean0.005797328459910858
sim_compute_performance-ego_median0.005811848243077596
sim_compute_performance-ego_min0.005593294302622477
sim_compute_sim_state_max0.0391905943552653
sim_compute_sim_state_mean0.03323223684078608
sim_compute_sim_state_median0.03156300174884307
sim_compute_sim_state_min0.03061234951019287
sim_render-ego_max0.009181305567423505
sim_render-ego_mean0.008876214241370178
sim_render-ego_median0.008816349506378173
sim_render-ego_min0.008690852385300856
simulation-passed1
step_physics_max0.14715797980626424
step_physics_mean0.1384276269949399
step_physics_median0.13713167786598204
step_physics_min0.13228917244153146
survival_time_max14.950000000000076
survival_time_mean13.65000000000006
survival_time_min9.750000000000004
No reset possible
3970411056Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:12:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1584097330174266
survival_time_median14.950000000000076
deviation-center-line_median0.8983878609454237
in-drivable-lane_median1.6500000000000234


other stats
agent_compute-ego_max0.030309303601582845
agent_compute-ego_mean0.027070338527361553
agent_compute-ego_median0.02657280405362447
agent_compute-ego_min0.02482644240061442
complete-iteration_max0.3308395743370056
complete-iteration_mean0.31965993702411655
complete-iteration_median0.31912966251373287
complete-iteration_min0.3095408487319946
deviation-center-line_max0.9737268489546196
deviation-center-line_mean0.8230229859213678
deviation-center-line_min0.5215893728400044
deviation-heading_max3.585557265874825
deviation-heading_mean2.9122892123472144
deviation-heading_median2.8639593842602604
deviation-heading_min2.3356808149935113
driven_any_max2.3920242643990366
driven_any_mean2.299314062135071
driven_any_median2.3241992283556554
driven_any_min2.1568335274299364
driven_lanedir_consec_max2.172775387067622
driven_lanedir_consec_mean2.084480518849034
driven_lanedir_consec_min1.8483272222936615
driven_lanedir_max2.172775387067622
driven_lanedir_mean2.084480518849034
driven_lanedir_median2.1584097330174266
driven_lanedir_min1.8483272222936615
get_duckie_state_max3.857612609863281e-06
get_duckie_state_mean3.468791643778483e-06
get_duckie_state_median3.4618377685546874e-06
get_duckie_state_min3.093878428141276e-06
get_robot_state_max0.02309934933980306
get_robot_state_mean0.02181380112965902
get_robot_state_median0.0218069581190745
get_robot_state_min0.020541938940684
get_state_dump_max0.020301891167958577
get_state_dump_mean0.01848099152247111
get_state_dump_median0.01833100159962972
get_state_dump_min0.016960071722666423
get_ui_image_max0.06066859563191731
get_ui_image_mean0.05757168551286061
get_ui_image_median0.05729641358057658
get_ui_image_min0.05502531925837199
in-drivable-lane_max2.400000000000034
in-drivable-lane_mean1.5250000000000217
in-drivable-lane_min0.4000000000000057
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3623215960123836, "get_ui_image": 0.06066859563191731, "step_physics": 0.14297429958979288, "survival_time": 14.950000000000076, "driven_lanedir": 2.172775387067622, "get_state_dump": 0.017265872955322267, "sim_render-ego": 0.008996938864390056, "get_robot_state": 0.020541938940684, "get_duckie_state": 3.857612609863281e-06, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.030309303601582845, "deviation-heading": 2.3615245428938767, "complete-iteration": 0.3271749130884806, "set_robot_commands": 0.006492531299591065, "deviation-center-line": 0.9737268489546196, "driven_lanedir_consec": 2.172775387067622, "sim_compute_sim_state": 0.03382944345474243, "sim_compute_performance-ego": 0.005902414321899414}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.286076860698927, "get_ui_image": 0.05733226776123047, "step_physics": 0.13514134724934895, "survival_time": 14.950000000000076, "driven_lanedir": 2.148615427853928, "get_state_dump": 0.016960071722666423, "sim_render-ego": 0.01012245734532674, "get_robot_state": 0.02104668935139974, "get_duckie_state": 3.5309791564941407e-06, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.02482644240061442, "deviation-heading": 3.585557265874825, "complete-iteration": 0.3095408487319946, "set_robot_commands": 0.0067461514472961425, "deviation-center-line": 0.8969027095092283, "driven_lanedir_consec": 2.148615427853928, "sim_compute_sim_state": 0.031438087622324626, "sim_compute_performance-ego": 0.005735617478688558}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.1568335274299364, "get_ui_image": 0.05502531925837199, "step_physics": 0.1312299410502116, "survival_time": 14.950000000000076, "driven_lanedir": 1.8483272222936615, "get_state_dump": 0.020301891167958577, "sim_render-ego": 0.009216995239257812, "get_robot_state": 0.022567226886749267, "get_duckie_state": 3.3926963806152345e-06, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.027558002471923828, "deviation-heading": 3.366394225626644, "complete-iteration": 0.3110844119389852, "set_robot_commands": 0.007410864035288493, "deviation-center-line": 0.899873012381619, "driven_lanedir_consec": 1.8483272222936615, "sim_compute_sim_state": 0.03112659056981405, "sim_compute_performance-ego": 0.006444913546244303}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.3920242643990366, "get_ui_image": 0.05726055939992269, "step_physics": 0.14568424065907795, "survival_time": 14.950000000000076, "driven_lanedir": 2.1682040381809253, "get_state_dump": 0.019396130243937177, "sim_render-ego": 0.008744956652323405, "get_robot_state": 0.02309934933980306, "get_duckie_state": 3.093878428141276e-06, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.025587605635325115, "deviation-heading": 2.3356808149935113, "complete-iteration": 0.3308395743370056, "set_robot_commands": 0.007072092692057292, "deviation-center-line": 0.5215893728400044, "driven_lanedir_consec": 2.1682040381809253, "sim_compute_sim_state": 0.038359611829121905, "sim_compute_performance-ego": 0.005450119972229004}}
set_robot_commands_max0.007410864035288493
set_robot_commands_mean0.006930409868558248
set_robot_commands_median0.006909122069676718
set_robot_commands_min0.006492531299591065
sim_compute_performance-ego_max0.006444913546244303
sim_compute_performance-ego_mean0.005883266329765319
sim_compute_performance-ego_median0.0058190159002939855
sim_compute_performance-ego_min0.005450119972229004
sim_compute_sim_state_max0.038359611829121905
sim_compute_sim_state_mean0.03368843336900075
sim_compute_sim_state_median0.03263376553853353
sim_compute_sim_state_min0.03112659056981405
sim_render-ego_max0.01012245734532674
sim_render-ego_mean0.009270337025324505
sim_render-ego_median0.009106967051823936
sim_render-ego_min0.008744956652323405
simulation-passed1
step_physics_max0.14568424065907795
step_physics_mean0.13875745713710785
step_physics_median0.1390578234195709
step_physics_min0.1312299410502116
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3969411063Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:12:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9667827570058936
survival_time_median14.950000000000076
deviation-center-line_median0.6330346004280981
in-drivable-lane_median0.4000000000000057


other stats
agent_compute-ego_max0.06349932273228963
agent_compute-ego_mean0.03843393445014953
agent_compute-ego_median0.03289884050687154
agent_compute-ego_min0.02443873405456543
complete-iteration_max0.3609949556986491
complete-iteration_mean0.33603707790374754
complete-iteration_median0.3336881903807322
complete-iteration_min0.3157769751548767
deviation-center-line_max1.0013601949702535
deviation-center-line_mean0.7128566716027089
deviation-center-line_min0.5839972905843862
deviation-heading_max2.909859183849216
deviation-heading_mean2.1014835030937213
deviation-heading_median1.8498894276437636
deviation-heading_min1.7962959732381427
driven_any_max2.158384599999523
driven_any_mean2.019440484608768
driven_any_median2.0294655188717887
driven_any_min1.860446300691972
driven_lanedir_consec_max2.1176289192063664
driven_lanedir_consec_mean1.9122604039229432
driven_lanedir_consec_min1.5978471824736191
driven_lanedir_max2.1176289192063664
driven_lanedir_mean1.9122604039229432
driven_lanedir_median1.9667827570058936
driven_lanedir_min1.5978471824736191
get_duckie_state_max4.545052846272786e-06
get_duckie_state_mean4.157423973083496e-06
get_duckie_state_median4.0825208028157556e-06
get_duckie_state_min3.919601440429688e-06
get_robot_state_max0.021265409787495932
get_robot_state_mean0.02026939451694489
get_robot_state_median0.020074783166249593
get_robot_state_min0.019662601947784426
get_state_dump_max0.01783821980158488
get_state_dump_mean0.01690270046393077
get_state_dump_median0.01678238034248352
get_state_dump_min0.016207821369171142
get_ui_image_max0.06250685056050619
get_ui_image_mean0.05894668102264405
get_ui_image_median0.05924982150395711
get_ui_image_min0.05478023052215576
in-drivable-lane_max2.550000000000036
in-drivable-lane_mean0.8375000000000119
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.860446300691972, "get_ui_image": 0.06250685056050619, "step_physics": 0.15772709846496585, "survival_time": 14.950000000000076, "driven_lanedir": 1.5978471824736191, "get_state_dump": 0.016207821369171142, "sim_render-ego": 0.00860838254292806, "get_robot_state": 0.019881045818328856, "get_duckie_state": 4.143714904785156e-06, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.028582255840301513, "deviation-heading": 1.7962959732381427, "complete-iteration": 0.3415557106335958, "set_robot_commands": 0.006396236419677734, "deviation-center-line": 0.5839972905843862, "driven_lanedir_consec": 1.5978471824736191, "sim_compute_sim_state": 0.03595415751139323, "sim_compute_performance-ego": 0.005528509616851807}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.144938128772099, "get_ui_image": 0.06118079423904419, "step_physics": 0.149217156569163, "survival_time": 14.950000000000076, "driven_lanedir": 2.1176289192063664, "get_state_dump": 0.016886003812154136, "sim_render-ego": 0.008704784711201986, "get_robot_state": 0.02026852051417033, "get_duckie_state": 4.021326700846354e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02443873405456543, "deviation-heading": 1.874615751528116, "complete-iteration": 0.32582067012786864, "set_robot_commands": 0.006369112332661946, "deviation-center-line": 0.6536908673368775, "driven_lanedir_consec": 2.1176289192063664, "sim_compute_sim_state": 0.03311414162317912, "sim_compute_performance-ego": 0.0054721458752950035}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.913992908971479, "get_ui_image": 0.05478023052215576, "step_physics": 0.1302530797322591, "survival_time": 14.950000000000076, "driven_lanedir": 1.8636023621352824, "get_state_dump": 0.01783821980158488, "sim_render-ego": 0.010574636459350584, "get_robot_state": 0.021265409787495932, "get_duckie_state": 4.545052846272786e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03721542517344157, "deviation-heading": 2.909859183849216, "complete-iteration": 0.3157769751548767, "set_robot_commands": 0.0068790690104166665, "deviation-center-line": 1.0013601949702535, "driven_lanedir_consec": 1.8636023621352824, "sim_compute_sim_state": 0.030857760906219483, "sim_compute_performance-ego": 0.005928779443105062}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.158384599999523, "get_ui_image": 0.05731884876887003, "step_physics": 0.1463936750094096, "survival_time": 14.950000000000076, "driven_lanedir": 2.0699631518765056, "get_state_dump": 0.016678756872812908, "sim_render-ego": 0.00830373207728068, "get_robot_state": 0.019662601947784426, "get_duckie_state": 3.919601440429688e-06, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.06349932273228963, "deviation-heading": 1.8251631037594112, "complete-iteration": 0.3609949556986491, "set_robot_commands": 0.0062004590034484865, "deviation-center-line": 0.6123783335193187, "driven_lanedir_consec": 2.0699631518765056, "sim_compute_sim_state": 0.03745339711507161, "sim_compute_performance-ego": 0.005313591957092285}}
set_robot_commands_max0.0068790690104166665
set_robot_commands_mean0.006461219191551208
set_robot_commands_median0.00638267437616984
set_robot_commands_min0.0062004590034484865
sim_compute_performance-ego_max0.005928779443105062
sim_compute_performance-ego_mean0.005560756723086039
sim_compute_performance-ego_median0.0055003277460734055
sim_compute_performance-ego_min0.005313591957092285
sim_compute_sim_state_max0.03745339711507161
sim_compute_sim_state_mean0.03434486428896586
sim_compute_sim_state_median0.034534149567286176
sim_compute_sim_state_min0.030857760906219483
sim_render-ego_max0.010574636459350584
sim_render-ego_mean0.009047883947690329
sim_render-ego_median0.008656583627065024
sim_render-ego_min0.00830373207728068
simulation-passed1
step_physics_max0.15772709846496585
step_physics_mean0.14589775244394937
step_physics_median0.1478054157892863
step_physics_min0.1302530797322591
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3968111072Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:12:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0012624161029482
survival_time_median14.950000000000076
deviation-center-line_median0.43795984316428105
in-drivable-lane_median8.825000000000028


other stats
agent_compute-ego_max0.025047210852305095
agent_compute-ego_mean0.023933776418368025
agent_compute-ego_median0.023711764415105183
agent_compute-ego_min0.023264365990956624
complete-iteration_max0.3331831169128418
complete-iteration_mean0.31893522878487907
complete-iteration_median0.32118718544642133
complete-iteration_min0.3001834273338318
deviation-center-line_max0.6067104629592727
deviation-center-line_mean0.40178353862507393
deviation-center-line_min0.12450400521246088
deviation-heading_max1.9228428786908844
deviation-heading_mean1.5494872950237624
deviation-heading_median1.8112528268279504
deviation-heading_min0.652600647748264
driven_any_max3.0072392486492205
driven_any_mean2.79827335796322
driven_any_median2.812896105973004
driven_any_min2.560061971257651
driven_lanedir_consec_max1.3143794449275743
driven_lanedir_consec_mean0.91446372422966
driven_lanedir_consec_min0.34095061978516883
driven_lanedir_max1.3143794449275743
driven_lanedir_mean0.91446372422966
driven_lanedir_median1.0012624161029482
driven_lanedir_min0.34095061978516883
get_duckie_state_max3.2750765482584635e-06
get_duckie_state_mean3.110766410827637e-06
get_duckie_state_median3.090699513753255e-06
get_duckie_state_min2.986590067545573e-06
get_robot_state_max0.02089974403381348
get_robot_state_mean0.020153120160102844
get_robot_state_median0.01999859054883321
get_robot_state_min0.01971555550893148
get_state_dump_max0.021174906889597576
get_state_dump_mean0.01755572418371836
get_state_dump_median0.01648147463798523
get_state_dump_min0.01608504056930542
get_ui_image_max0.06094012180964152
get_ui_image_mean0.05837139010429382
get_ui_image_median0.05981507380803426
get_ui_image_min0.052915290991465254
in-drivable-lane_max12.850000000000076
in-drivable-lane_mean9.325000000000042
in-drivable-lane_min6.800000000000038
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.7936034833064483, "get_ui_image": 0.0601570987701416, "step_physics": 0.14633264462153117, "survival_time": 14.950000000000076, "driven_lanedir": 1.3143794449275743, "get_state_dump": 0.01608504056930542, "sim_render-ego": 0.008483986059824625, "get_robot_state": 0.01971555550893148, "get_duckie_state": 3.155072530110677e-06, "in-drivable-lane": 6.800000000000038, "agent_compute-ego": 0.02373250722885132, "deviation-heading": 1.896503684381684, "complete-iteration": 0.3196085405349731, "set_robot_commands": 0.006233978271484375, "deviation-center-line": 0.5132032885408639, "driven_lanedir_consec": 1.3143794449275743, "sim_compute_sim_state": 0.03315738280614217, "sim_compute_performance-ego": 0.00551809310913086}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8321887286395597, "get_ui_image": 0.06094012180964152, "step_physics": 0.14932971795399982, "survival_time": 14.950000000000076, "driven_lanedir": 1.200786034890564, "get_state_dump": 0.016179962158203123, "sim_render-ego": 0.008402893543243408, "get_robot_state": 0.0197900128364563, "get_duckie_state": 3.0263264973958333e-06, "in-drivable-lane": 7.550000000000013, "agent_compute-ego": 0.023264365990956624, "deviation-heading": 1.7260019692742177, "complete-iteration": 0.3227658303578695, "set_robot_commands": 0.006236613591512044, "deviation-center-line": 0.6067104629592727, "driven_lanedir_consec": 1.200786034890564, "sim_compute_sim_state": 0.033006229400634766, "sim_compute_performance-ego": 0.0054269949595133465}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.560061971257651, "get_ui_image": 0.052915290991465254, "step_physics": 0.12832889318466187, "survival_time": 14.950000000000076, "driven_lanedir": 0.34095061978516883, "get_state_dump": 0.021174906889597576, "sim_render-ego": 0.009282612005869549, "get_robot_state": 0.02089974403381348, "get_duckie_state": 3.2750765482584635e-06, "in-drivable-lane": 12.850000000000076, "agent_compute-ego": 0.025047210852305095, "deviation-heading": 0.652600647748264, "complete-iteration": 0.3001834273338318, "set_robot_commands": 0.006766269207000733, "deviation-center-line": 0.12450400521246088, "driven_lanedir_consec": 0.34095061978516883, "sim_compute_sim_state": 0.029882614612579347, "sim_compute_performance-ego": 0.005676109790802002}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0072392486492205, "get_ui_image": 0.05947304884592692, "step_physics": 0.15422418514887493, "survival_time": 14.950000000000076, "driven_lanedir": 0.8017387973153323, "get_state_dump": 0.016782987117767333, "sim_render-ego": 0.008502751986185709, "get_robot_state": 0.020207168261210124, "get_duckie_state": 2.986590067545573e-06, "in-drivable-lane": 10.100000000000044, "agent_compute-ego": 0.02369102160135905, "deviation-heading": 1.9228428786908844, "complete-iteration": 0.3331831169128418, "set_robot_commands": 0.006344951788584391, "deviation-center-line": 0.36271639778769815, "driven_lanedir_consec": 0.8017387973153323, "sim_compute_sim_state": 0.03827048063278198, "sim_compute_performance-ego": 0.005498363176981608}}
set_robot_commands_max0.006766269207000733
set_robot_commands_mean0.006395453214645386
set_robot_commands_median0.006290782690048218
set_robot_commands_min0.006233978271484375
sim_compute_performance-ego_max0.005676109790802002
sim_compute_performance-ego_mean0.005529890259106955
sim_compute_performance-ego_median0.005508228143056234
sim_compute_performance-ego_min0.0054269949595133465
sim_compute_sim_state_max0.03827048063278198
sim_compute_sim_state_mean0.03357917686303457
sim_compute_sim_state_median0.03308180610338847
sim_compute_sim_state_min0.029882614612579347
sim_render-ego_max0.009282612005869549
sim_render-ego_mean0.008668060898780822
sim_render-ego_median0.008493369023005168
sim_render-ego_min0.008402893543243408
simulation-passed1
step_physics_max0.15422418514887493
step_physics_mean0.14455386022726696
step_physics_median0.1478311812877655
step_physics_min0.12832889318466187
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3966811081Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:12:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.742024596442295
survival_time_median14.950000000000076
deviation-center-line_median0.4637591201033119
in-drivable-lane_median3.7000000000000526


other stats
agent_compute-ego_max0.06897965510686238
agent_compute-ego_mean0.06455612234541683
agent_compute-ego_median0.06558268308639527
agent_compute-ego_min0.05807946810201437
complete-iteration_max0.3803282602628072
complete-iteration_mean0.3620790783631034
complete-iteration_median0.3600535746549024
complete-iteration_min0.3478809038798014
deviation-center-line_max0.5959903159830556
deviation-center-line_mean0.468574477413752
deviation-center-line_min0.3507893534653284
deviation-heading_max3.439260784781438
deviation-heading_mean1.9718305179665752
deviation-heading_median1.5668958870809138
deviation-heading_min1.3142695129230344
driven_any_max2.4347370788622955
driven_any_mean2.1930826247409234
driven_any_median2.266880268342586
driven_any_min1.8038328834162256
driven_lanedir_consec_max2.148231281629573
driven_lanedir_consec_mean1.6083636193379394
driven_lanedir_consec_min0.8011740028375935
driven_lanedir_max2.148231281629573
driven_lanedir_mean1.6083636193379394
driven_lanedir_median1.742024596442295
driven_lanedir_min0.8011740028375935
get_duckie_state_max3.135504842806263e-06
get_duckie_state_mean3.0552105409424513e-06
get_duckie_state_median3.058513005574544e-06
get_duckie_state_min2.968311309814453e-06
get_robot_state_max0.022884228229522702
get_robot_state_mean0.02224225963030209
get_robot_state_median0.022383700211842855
get_robot_state_min0.021317409867999935
get_state_dump_max0.01881969928741455
get_state_dump_mean0.018019303687814237
get_state_dump_median0.017956365760968845
get_state_dump_min0.017344783941904703
get_ui_image_max0.06253428856531779
get_ui_image_mean0.05902653104283896
get_ui_image_median0.05880977007187381
get_ui_image_min0.05595229546229045
in-drivable-lane_max8.250000000000057
in-drivable-lane_mean4.412500000000048
in-drivable-lane_min2.0000000000000284
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.8038328834162256, "get_ui_image": 0.060533147900044416, "step_physics": 0.14117551450969792, "survival_time": 11.900000000000034, "driven_lanedir": 1.4402861047730633, "get_state_dump": 0.017834667398148225, "sim_render-ego": 0.0089144336075342, "get_robot_state": 0.021317409867999935, "get_duckie_state": 3.135504842806263e-06, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.05807946810201437, "deviation-heading": 1.3142695129230344, "complete-iteration": 0.35468628727087453, "set_robot_commands": 0.007057541558722488, "deviation-center-line": 0.3507893534653284, "driven_lanedir_consec": 1.4402861047730633, "sim_compute_sim_state": 0.03356693772708669, "sim_compute_performance-ego": 0.006031715569375944}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.320327595798904, "get_ui_image": 0.05595229546229045, "step_physics": 0.13266331672668458, "survival_time": 14.950000000000076, "driven_lanedir": 2.148231281629573, "get_state_dump": 0.017344783941904703, "sim_render-ego": 0.008657790025075277, "get_robot_state": 0.022611056168874103, "get_duckie_state": 3.1344095865885416e-06, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.06613564570744833, "deviation-heading": 1.8049545736492196, "complete-iteration": 0.3478809038798014, "set_robot_commands": 0.007107518513997396, "deviation-center-line": 0.5959903159830556, "driven_lanedir_consec": 2.148231281629573, "sim_compute_sim_state": 0.03134197473526001, "sim_compute_performance-ego": 0.005886338551839193}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.2134329408862676, "get_ui_image": 0.06253428856531779, "step_physics": 0.14744900782903037, "survival_time": 14.950000000000076, "driven_lanedir": 0.8011740028375935, "get_state_dump": 0.01881969928741455, "sim_render-ego": 0.009390967686971029, "get_robot_state": 0.022884228229522702, "get_duckie_state": 2.968311309814453e-06, "in-drivable-lane": 8.250000000000057, "agent_compute-ego": 0.06897965510686238, "deviation-heading": 3.439260784781438, "complete-iteration": 0.3803282602628072, "set_robot_commands": 0.007297300497690837, "deviation-center-line": 0.44481660106535903, "driven_lanedir_consec": 0.8011740028375935, "sim_compute_sim_state": 0.036613814036051434, "sim_compute_performance-ego": 0.00618277629216512}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.4347370788622955, "get_ui_image": 0.0570863922437032, "step_physics": 0.14054967085520426, "survival_time": 14.950000000000076, "driven_lanedir": 2.0437630881115267, "get_state_dump": 0.01807806412378947, "sim_render-ego": 0.008897700309753419, "get_robot_state": 0.022156344254811604, "get_duckie_state": 2.982616424560547e-06, "in-drivable-lane": 3.900000000000055, "agent_compute-ego": 0.06502972046534221, "deviation-heading": 1.328837200512608, "complete-iteration": 0.36542086203893026, "set_robot_commands": 0.00824737548828125, "deviation-center-line": 0.4827016391412648, "driven_lanedir_consec": 2.0437630881115267, "sim_compute_sim_state": 0.03898275852203369, "sim_compute_performance-ego": 0.006207945346832275}}
set_robot_commands_max0.00824737548828125
set_robot_commands_mean0.007427434014672993
set_robot_commands_median0.0072024095058441165
set_robot_commands_min0.007057541558722488
sim_compute_performance-ego_max0.006207945346832275
sim_compute_performance-ego_mean0.006077193940053132
sim_compute_performance-ego_median0.0061072459307705326
sim_compute_performance-ego_min0.005886338551839193
sim_compute_sim_state_max0.03898275852203369
sim_compute_sim_state_mean0.03512637125510796
sim_compute_sim_state_median0.03509037588156906
sim_compute_sim_state_min0.03134197473526001
sim_render-ego_max0.009390967686971029
sim_render-ego_mean0.008965222907333481
sim_render-ego_median0.008906066958643809
sim_render-ego_min0.008657790025075277
simulation-passed1
step_physics_max0.14744900782903037
step_physics_mean0.1404593774801543
step_physics_median0.1408625926824511
step_physics_min0.13266331672668458
survival_time_max14.950000000000076
survival_time_mean14.187500000000068
survival_time_min11.900000000000034
No reset possible
3965711091Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:11:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.934038039389581
survival_time_median14.550000000000072
deviation-center-line_median0.4010605764577468
in-drivable-lane_median7.975000000000033


other stats
agent_compute-ego_max0.025200692017873127
agent_compute-ego_mean0.02448264689570996
agent_compute-ego_median0.02477633906758716
agent_compute-ego_min0.02317721742979238
complete-iteration_max0.3265935703062675
complete-iteration_mean0.3233997144249128
complete-iteration_median0.32323731382687887
complete-iteration_min0.32053065973962575
deviation-center-line_max0.5472510530020952
deviation-center-line_mean0.37118351741059646
deviation-center-line_min0.13536186372479708
deviation-heading_max2.288290872482981
deviation-heading_mean1.79143832407548
deviation-heading_median2.1241014169063748
deviation-heading_min0.62925959000619
driven_any_max2.8748092479884817
driven_any_mean2.3604105913150364
driven_any_median2.598359065387254
driven_any_min1.3701149864971562
driven_lanedir_consec_max1.574955018867932
driven_lanedir_consec_mean0.9577617553916769
driven_lanedir_consec_min0.38801592391961304
driven_lanedir_max1.574955018867932
driven_lanedir_mean0.9577617553916769
driven_lanedir_median0.934038039389581
driven_lanedir_min0.38801592391961304
get_duckie_state_max4.259520621687279e-06
get_duckie_state_mean4.064695178423191e-06
get_duckie_state_median4.031484675519343e-06
get_duckie_state_min3.936290740966797e-06
get_robot_state_max0.02419716755549113
get_robot_state_mean0.021452406767691043
get_robot_state_median0.020720846898724367
get_robot_state_min0.0201707657178243
get_state_dump_max0.017682010332743327
get_state_dump_mean0.016964469978099746
get_state_dump_median0.016950143980053206
get_state_dump_min0.016275581619549246
get_ui_image_max0.06501433211313166
get_ui_image_mean0.05992152324485847
get_ui_image_median0.05906397365990179
get_ui_image_min0.056543813546498616
in-drivable-lane_max8.950000000000031
in-drivable-lane_mean7.375000000000023
in-drivable-lane_min4.599999999999993
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.6125809652315923, "get_ui_image": 0.05851491179988578, "step_physics": 0.1450817180606586, "survival_time": 14.150000000000066, "driven_lanedir": 0.94660205009636, "get_state_dump": 0.01704117855840353, "sim_render-ego": 0.008650992868645874, "get_robot_state": 0.02113500247995761, "get_duckie_state": 4.259520621687279e-06, "in-drivable-lane": 7.600000000000051, "agent_compute-ego": 0.02498857882334571, "deviation-heading": 2.288290872482981, "complete-iteration": 0.32053065973962575, "set_robot_commands": 0.006457333008729106, "deviation-center-line": 0.38861689904993985, "driven_lanedir_consec": 0.94660205009636, "sim_compute_sim_state": 0.032788393775481636, "sim_compute_performance-ego": 0.005665592928236028}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.584137165542916, "get_ui_image": 0.059613035519917805, "step_physics": 0.1462971019744873, "survival_time": 14.950000000000076, "driven_lanedir": 1.574955018867932, "get_state_dump": 0.01685910940170288, "sim_render-ego": 0.008616621494293214, "get_robot_state": 0.0201707657178243, "get_duckie_state": 4.120667775472006e-06, "in-drivable-lane": 4.599999999999993, "agent_compute-ego": 0.024564099311828617, "deviation-heading": 2.112626895567428, "complete-iteration": 0.3208286817868551, "set_robot_commands": 0.006375075181325277, "deviation-center-line": 0.5472510530020952, "driven_lanedir_consec": 1.574955018867932, "sim_compute_sim_state": 0.03244142452875773, "sim_compute_performance-ego": 0.005688827037811279}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.3701149864971562, "get_ui_image": 0.06501433211313166, "step_physics": 0.14932018938198896, "survival_time": 10.650000000000016, "driven_lanedir": 0.38801592391961304, "get_state_dump": 0.016275581619549246, "sim_render-ego": 0.008488778217297764, "get_robot_state": 0.02030669131749113, "get_duckie_state": 3.942301575566681e-06, "in-drivable-lane": 8.350000000000016, "agent_compute-ego": 0.02317721742979238, "deviation-heading": 0.62925959000619, "complete-iteration": 0.3265935703062675, "set_robot_commands": 0.00633273550042524, "deviation-center-line": 0.13536186372479708, "driven_lanedir_consec": 0.38801592391961304, "sim_compute_sim_state": 0.031893143631482906, "sim_compute_performance-ego": 0.00558199233292414}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8748092479884817, "get_ui_image": 0.056543813546498616, "step_physics": 0.13857855796813964, "survival_time": 14.950000000000076, "driven_lanedir": 0.9214740286828018, "get_state_dump": 0.017682010332743327, "sim_render-ego": 0.009212039311726887, "get_robot_state": 0.02419716755549113, "get_duckie_state": 3.936290740966797e-06, "in-drivable-lane": 8.950000000000031, "agent_compute-ego": 0.025200692017873127, "deviation-heading": 2.135575938245322, "complete-iteration": 0.32564594586690265, "set_robot_commands": 0.00997144063313802, "deviation-center-line": 0.4135042538655538, "driven_lanedir_consec": 0.9214740286828018, "sim_compute_sim_state": 0.03782320499420166, "sim_compute_performance-ego": 0.006224398612976074}}
set_robot_commands_max0.00997144063313802
set_robot_commands_mean0.00728414608090441
set_robot_commands_median0.006416204095027191
set_robot_commands_min0.00633273550042524
sim_compute_performance-ego_max0.006224398612976074
sim_compute_performance-ego_mean0.00579020272798688
sim_compute_performance-ego_median0.005677209983023653
sim_compute_performance-ego_min0.00558199233292414
sim_compute_sim_state_max0.03782320499420166
sim_compute_sim_state_mean0.03373654173248098
sim_compute_sim_state_median0.03261490915211968
sim_compute_sim_state_min0.031893143631482906
sim_render-ego_max0.009212039311726887
sim_render-ego_mean0.008742107972990935
sim_render-ego_median0.008633807181469545
sim_render-ego_min0.008488778217297764
simulation-passed1
step_physics_max0.14932018938198896
step_physics_mean0.14481939184631865
step_physics_median0.14568941001757296
step_physics_min0.13857855796813964
survival_time_max14.950000000000076
survival_time_mean13.675000000000058
survival_time_min10.650000000000016
No reset possible
3964211100Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-221dc42400b8-10:11:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.755616526972254
survival_time_median14.950000000000076
deviation-center-line_median0.28612736339498734
in-drivable-lane_median4.800000000000068


other stats
agent_compute-ego_max0.02473800818125407
agent_compute-ego_mean0.024010510110796017
agent_compute-ego_median0.023936722008269073
agent_compute-ego_min0.023430588245391844
complete-iteration_max0.33139691670735677
complete-iteration_mean0.31938923546151154
complete-iteration_median0.3194950880304145
complete-iteration_min0.3071698490778605
deviation-center-line_max0.3774868028253831
deviation-center-line_mean0.29470565337977567
deviation-center-line_min0.2290810839037449
deviation-heading_max1.0225465580445938
deviation-heading_mean0.8039786291997888
deviation-heading_median0.7908225298129814
deviation-heading_min0.6117228991285985
driven_any_max2.766706077841308
driven_any_mean2.562237729116083
driven_any_median2.5701047425607526
driven_any_min2.3420353535015193
driven_lanedir_consec_max2.104263206752691
driven_lanedir_consec_mean1.5573369003631998
driven_lanedir_consec_min0.613851340755599
driven_lanedir_max2.104263206752691
driven_lanedir_mean1.5573369003631998
driven_lanedir_median1.755616526972254
driven_lanedir_min0.613851340755599
get_duckie_state_max3.558552398114399e-06
get_duckie_state_mean3.386277987020462e-06
get_duckie_state_median3.3795833587646486e-06
get_duckie_state_min3.227392832438151e-06
get_robot_state_max0.020813188588309023
get_robot_state_mean0.02049384972346021
get_robot_state_median0.02052179495493571
get_robot_state_min0.0201186203956604
get_state_dump_max0.017094838131759247
get_state_dump_mean0.016779125210964103
get_state_dump_median0.01678752342859904
get_state_dump_min0.01644661585489909
get_ui_image_max0.06005037069320679
get_ui_image_mean0.05823924778931794
get_ui_image_median0.057873583218126634
get_ui_image_min0.05715945402781169
in-drivable-lane_max11.200000000000085
in-drivable-lane_mean6.175000000000069
in-drivable-lane_min3.900000000000055
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3420353535015193, "get_ui_image": 0.05736595547332196, "step_physics": 0.13807261388984313, "survival_time": 13.450000000000056, "driven_lanedir": 1.462095690706471, "get_state_dump": 0.017094838131759247, "sim_render-ego": 0.008796978174089056, "get_robot_state": 0.020813188588309023, "get_duckie_state": 3.558552398114399e-06, "in-drivable-lane": 5.450000000000077, "agent_compute-ego": 0.024147674496732236, "deviation-heading": 0.7099347989789898, "complete-iteration": 0.31208467040363297, "set_robot_commands": 0.0066591487941245605, "deviation-center-line": 0.3774868028253831, "driven_lanedir_consec": 1.462095690706471, "sim_compute_sim_state": 0.03315511334784412, "sim_compute_performance-ego": 0.005788889959399142}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.766706077841308, "get_ui_image": 0.05715945402781169, "step_physics": 0.1349118995666504, "survival_time": 14.950000000000076, "driven_lanedir": 2.104263206752691, "get_state_dump": 0.016988776524861655, "sim_render-ego": 0.00871503988901774, "get_robot_state": 0.020802854696909588, "get_duckie_state": 3.528594970703125e-06, "in-drivable-lane": 3.900000000000055, "agent_compute-ego": 0.023725769519805907, "deviation-heading": 1.0225465580445938, "complete-iteration": 0.3071698490778605, "set_robot_commands": 0.006447608470916748, "deviation-center-line": 0.26153170063813846, "driven_lanedir_consec": 2.104263206752691, "sim_compute_sim_state": 0.03247189998626709, "sim_compute_performance-ego": 0.00576119581858317}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.4422076981993, "get_ui_image": 0.058381210962931314, "step_physics": 0.15376997073491414, "survival_time": 14.950000000000076, "driven_lanedir": 0.613851340755599, "get_state_dump": 0.01644661585489909, "sim_render-ego": 0.00880885124206543, "get_robot_state": 0.02024073521296183, "get_duckie_state": 3.230571746826172e-06, "in-drivable-lane": 11.200000000000085, "agent_compute-ego": 0.02473800818125407, "deviation-heading": 0.6117228991285985, "complete-iteration": 0.32690550565719606, "set_robot_commands": 0.006358059247334799, "deviation-center-line": 0.2290810839037449, "driven_lanedir_consec": 0.613851340755599, "sim_compute_sim_state": 0.03252653042475383, "sim_compute_performance-ego": 0.0054509560267130535}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.6980017869222053, "get_ui_image": 0.06005037069320679, "step_physics": 0.1502882210413615, "survival_time": 14.950000000000076, "driven_lanedir": 2.0491373632380374, "get_state_dump": 0.016586270332336426, "sim_render-ego": 0.008915995756785075, "get_robot_state": 0.0201186203956604, "get_duckie_state": 3.227392832438151e-06, "in-drivable-lane": 4.150000000000059, "agent_compute-ego": 0.023430588245391844, "deviation-heading": 0.8717102606469729, "complete-iteration": 0.33139691670735677, "set_robot_commands": 0.00625645399093628, "deviation-center-line": 0.31072302615183617, "driven_lanedir_consec": 2.0491373632380374, "sim_compute_sim_state": 0.03978530883789062, "sim_compute_performance-ego": 0.005782889525095622}}
set_robot_commands_max0.0066591487941245605
set_robot_commands_mean0.006430317625828096
set_robot_commands_median0.006402833859125773
set_robot_commands_min0.00625645399093628
sim_compute_performance-ego_max0.005788889959399142
sim_compute_performance-ego_mean0.0056959828324477475
sim_compute_performance-ego_median0.005772042671839396
sim_compute_performance-ego_min0.0054509560267130535
sim_compute_sim_state_max0.03978530883789062
sim_compute_sim_state_mean0.03448471314918891
sim_compute_sim_state_median0.03284082188629897
sim_compute_sim_state_min0.03247189998626709
sim_render-ego_max0.008915995756785075
sim_render-ego_mean0.008809216265489325
sim_render-ego_median0.008802914708077243
sim_render-ego_min0.00871503988901774
simulation-passed1
step_physics_max0.15376997073491414
step_physics_mean0.1442606763081923
step_physics_median0.1441804174656023
step_physics_min0.1349118995666504
survival_time_max14.950000000000076
survival_time_mean14.57500000000007
survival_time_min13.450000000000056
No reset possible
3962811116Melisande Tengreal-exercise-1aido5-LF-sim-validationLFv-simerrornoreg05-221dc42400b8-11:00:47
Waited 3606 seconds [...]
Waited 3606 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3961811125Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoreg05-221dc42400b8-11:00:39
Waited 3601 seconds [...]
Waited 3601 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3960611131Melisande Tengreal-exercise-1aido5-LF-sim-validationLFv-simerrornoreg05-221dc42400b8-11:00:49
Waited 3607 seconds [...]
Waited 3607 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3960111135Bhavya Patwa 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simerrornoreg05-221dc42400b8-11:00:48
Waited 3609 seconds [...]
Waited 3609 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3959911137Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailednoreg05-221dc42400b8-10:01:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego" aborted:

error in ego |Exception while handling a message on topic "get_commands".
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
             ||     handle_message_node(parsed, receiver0, context0)
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
             ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 68, in on_received_get_commands
             ||     velocity, omega = self.compute_action(self.current_image)
             ||   File "solution.py", line 63, in compute_action
             ||     observation = self.preprocessor.toTensor(observation).to(self._device)
             ||   File "/workspace/wrappers.py", line 23, in toTensor
             ||     return self.compose_obs(obs)
             ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/transforms.py", line 67, in __call__
             ||     img = t(img)
             ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
             ||     result = self.forward(*input, **kwargs)
             ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/transforms.py", line 226, in forward
             ||     return F.normalize(tensor, self.mean, self.std, self.inplace)
             ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/functional.py", line 284, in normalize
             ||     tensor.sub_(mean).div_(std)
             || RuntimeError: The size of tensor a (120) must match the size of tensor b (3) at non-singleton dimension 0
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3959311141Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoreg05-221dc42400b8-11:00:50
Waited 3609 seconds [...]
Waited 3609 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3958711147Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoreg05-221dc42400b8-11:00:46
Waited 3605 seconds [...]
Waited 3605 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3958411148Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailednoreg05-221dc42400b8-10:01:05
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3957911153Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoreg05-221dc42400b8-11:00:43
Waited 3604 seconds [...]
Waited 3604 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3957411158Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simerrornoreg05-221dc42400b8-11:00:45
Waited 3602 seconds [...]
Waited 3602 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3956911163Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoreg05-221dc42400b8-11:00:40
Waited 3605 seconds [...]
Waited 3605 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3956411166Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoreg05-221dc42400b8-11:00:37
Waited 3603 seconds [...]
Waited 3603 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3955711220Étienne Boucher 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoreg05-221dc42400b8-11:00:52
Waited 3609 seconds [...]
Waited 3609 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3955611170Bea Baselines 🐤template-randomaido5-LFP-sim-validationLFP-simsuccessnoreg05-221dc42400b8-10:04:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.6999999999999984
in-drivable-lane_median0.9249999999999976
driven_lanedir_consec_median0.633002497331301
deviation-center-line_median0.09213058221920824


other stats
agent_compute-ego_max0.026389718055725098
agent_compute-ego_mean0.02579800361340246
agent_compute-ego_median0.025810204648365406
agent_compute-ego_min0.02518188710115394
complete-iteration_max0.3486139968949921
complete-iteration_mean0.3450278128772737
complete-iteration_median0.34500210285186766
complete-iteration_min0.3414930489103673
deviation-center-line_max0.1246386243322534
deviation-center-line_mean0.09583233851692276
deviation-center-line_min0.07442956529702113
deviation-heading_max0.3607605408913149
deviation-heading_mean0.3216188717006343
deviation-heading_median0.3276520637093626
deviation-heading_min0.27041081849249704
driven_any_max1.6489378628431075
driven_any_mean1.0690407244843498
driven_any_median1.061275442912217
driven_any_min0.5046741492698572
driven_lanedir_consec_max0.7814816389545539
driven_lanedir_consec_mean0.5885078415974594
driven_lanedir_consec_min0.306544732772682
driven_lanedir_max0.7814816389545539
driven_lanedir_mean0.5885078415974594
driven_lanedir_median0.633002497331301
driven_lanedir_min0.306544732772682
get_duckie_state_max0.052325287461280824
get_duckie_state_mean0.04981962722698999
get_duckie_state_median0.04953009311844703
get_duckie_state_min0.04789303520978507
get_robot_state_max0.02467576861381531
get_robot_state_mean0.022905296775024137
get_robot_state_median0.022814639791490628
get_robot_state_min0.021316138903299968
get_state_dump_max0.029243638959981628
get_state_dump_mean0.02817258179758187
get_state_dump_median0.02796256282702595
get_state_dump_min0.027521562576293943
get_ui_image_max0.05282898338473573
get_ui_image_mean0.05179368658752627
get_ui_image_median0.05184764675164627
get_ui_image_min0.050650469462076825
in-drivable-lane_max1.8999999999999932
in-drivable-lane_mean1.0374999999999972
in-drivable-lane_min0.4000000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.16193217979593, "get_ui_image": 0.05238355620432708, "step_physics": 0.1137734793000302, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.029243638959981628, "sim_render-ego": 0.008699667655815512, "get_robot_state": 0.02137385788610426, "get_duckie_state": 0.04789303520978507, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.025389933990219892, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.3414930489103673, "set_robot_commands": 0.0064327999696893205, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.030162976960004383, "sim_compute_performance-ego": 0.0059274455248299295}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.9606187060285049, "get_ui_image": 0.05282898338473573, "step_physics": 0.11426914954672054, "survival_time": 2.4499999999999993, "driven_lanedir": 0.6574168141939207, "get_state_dump": 0.028271733498086735, "sim_render-ego": 0.0099739493155966, "get_robot_state": 0.024255421696876993, "get_duckie_state": 0.05048897315044792, "in-drivable-lane": 0.6499999999999984, "agent_compute-ego": 0.02518188710115394, "deviation-heading": 0.34777506062597224, "complete-iteration": 0.3486139968949921, "set_robot_commands": 0.007393116853675064, "deviation-center-line": 0.10381279104728038, "driven_lanedir_consec": 0.6574168141939207, "sim_compute_sim_state": 0.029427611097997547, "sim_compute_performance-ego": 0.006292435587668906}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.6489378628431075, "get_ui_image": 0.05131173729896545, "step_physics": 0.1093115895986557, "survival_time": 3.999999999999994, "driven_lanedir": 0.7814816389545539, "get_state_dump": 0.027521562576293943, "sim_render-ego": 0.009869810938835145, "get_robot_state": 0.02467576861381531, "get_duckie_state": 0.052325287461280824, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.026230475306510924, "deviation-heading": 0.307529066792753, "complete-iteration": 0.3480676174163818, "set_robot_commands": 0.007472482323646545, "deviation-center-line": 0.08044837339113611, "driven_lanedir_consec": 0.7814816389545539, "sim_compute_sim_state": 0.03238455057144165, "sim_compute_performance-ego": 0.006728708744049072}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.5046741492698572, "get_ui_image": 0.050650469462076825, "step_physics": 0.10984975496927896, "survival_time": 1.5000000000000009, "driven_lanedir": 0.306544732772682, "get_state_dump": 0.02765339215596517, "sim_render-ego": 0.008550715446472169, "get_robot_state": 0.021316138903299968, "get_duckie_state": 0.04857121308644612, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.026389718055725098, "deviation-heading": 0.3607605408913149, "complete-iteration": 0.3419365882873535, "set_robot_commands": 0.006347831090291341, "deviation-center-line": 0.07442956529702113, "driven_lanedir_consec": 0.306544732772682, "sim_compute_sim_state": 0.036414368947347, "sim_compute_performance-ego": 0.005955966313680013}}
set_robot_commands_max0.007472482323646545
set_robot_commands_mean0.006911557559325568
set_robot_commands_median0.006912958411682192
set_robot_commands_min0.006347831090291341
sim_compute_performance-ego_max0.006728708744049072
sim_compute_performance-ego_mean0.00622613904255698
sim_compute_performance-ego_median0.006124200950674459
sim_compute_performance-ego_min0.0059274455248299295
sim_compute_sim_state_max0.036414368947347
sim_compute_sim_state_mean0.03209737689419765
sim_compute_sim_state_median0.031273763765723016
sim_compute_sim_state_min0.029427611097997547
sim_render-ego_max0.0099739493155966
sim_render-ego_mean0.009273535839179855
sim_render-ego_median0.009284739297325328
sim_render-ego_min0.008550715446472169
simulation-passed1
step_physics_max0.11426914954672054
step_physics_mean0.11180099335367136
step_physics_median0.1118116171346546
step_physics_min0.1093115895986557
survival_time_max3.999999999999994
survival_time_mean2.724999999999998
survival_time_min1.5000000000000009
No reset possible
3955511171Bea Baselines 🐤template-randomaido5-LF-sanity-sim-validationsanity-checksuccessnoreg05-221dc42400b8-10:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06871089847212986
survival_time_median0.49999999999999994
deviation-center-line_median0.008019844335283851
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.02758132327686657
agent_compute-ego_mean0.02758132327686657
agent_compute-ego_median0.02758132327686657
agent_compute-ego_min0.02758132327686657
complete-iteration_max0.32255604050376196
complete-iteration_mean0.32255604050376196
complete-iteration_median0.32255604050376196
complete-iteration_min0.32255604050376196
deviation-center-line_max0.008019844335283851
deviation-center-line_mean0.008019844335283851
deviation-center-line_min0.008019844335283851
deviation-heading_max0.05040343959962079
deviation-heading_mean0.05040343959962079
deviation-heading_median0.05040343959962079
deviation-heading_min0.05040343959962079
driven_any_max0.0689817689678746
driven_any_mean0.0689817689678746
driven_any_median0.0689817689678746
driven_any_min0.0689817689678746
driven_lanedir_consec_max0.06871089847212986
driven_lanedir_consec_mean0.06871089847212986
driven_lanedir_consec_min0.06871089847212986
driven_lanedir_max0.06871089847212986
driven_lanedir_mean0.06871089847212986
driven_lanedir_median0.06871089847212986
driven_lanedir_min0.06871089847212986
get_duckie_state_max0.0064580440521240234
get_duckie_state_mean0.0064580440521240234
get_duckie_state_median0.0064580440521240234
get_duckie_state_min0.0064580440521240234
get_robot_state_max0.02168228409507058
get_robot_state_mean0.02168228409507058
get_robot_state_median0.02168228409507058
get_robot_state_min0.02168228409507058
get_state_dump_max0.02300104227933017
get_state_dump_mean0.02300104227933017
get_state_dump_median0.02300104227933017
get_state_dump_min0.02300104227933017
get_ui_image_max0.05612486059015447
get_ui_image_mean0.05612486059015447
get_ui_image_median0.05612486059015447
get_ui_image_min0.05612486059015447
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.0689817689678746, "get_ui_image": 0.05612486059015447, "step_physics": 0.13230299949645996, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06871089847212986, "get_state_dump": 0.02300104227933017, "sim_render-ego": 0.009124950929121538, "get_robot_state": 0.02168228409507058, "get_duckie_state": 0.0064580440521240234, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02758132327686657, "deviation-heading": 0.05040343959962079, "complete-iteration": 0.32255604050376196, "set_robot_commands": 0.006361484527587891, "deviation-center-line": 0.008019844335283851, "driven_lanedir_consec": 0.06871089847212986, "sim_compute_sim_state": 0.032991214232011276, "sim_compute_performance-ego": 0.00669030709700151}}
set_robot_commands_max0.006361484527587891
set_robot_commands_mean0.006361484527587891
set_robot_commands_median0.006361484527587891
set_robot_commands_min0.006361484527587891
sim_compute_performance-ego_max0.00669030709700151
sim_compute_performance-ego_mean0.00669030709700151
sim_compute_performance-ego_median0.00669030709700151
sim_compute_performance-ego_min0.00669030709700151
sim_compute_sim_state_max0.032991214232011276
sim_compute_sim_state_mean0.032991214232011276
sim_compute_sim_state_median0.032991214232011276
sim_compute_sim_state_min0.032991214232011276
sim_render-ego_max0.009124950929121538
sim_render-ego_mean0.009124950929121538
sim_render-ego_median0.009124950929121538
sim_render-ego_min0.009124950929121538
simulation-passed1
step_physics_max0.13230299949645996
step_physics_mean0.13230299949645996
step_physics_median0.13230299949645996
step_physics_min0.13230299949645996
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
3954911176Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simerrornoreg05-221dc42400b8-11:00:43
Waited 3609 seconds [...]
Waited 3609 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3954611178Bea Baselines 🐤template-randomaido5-LFVI_multi-sim-validationLFVIv-simsuccessnoreg05-221dc42400b8-10:06:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5085880746760765
survival_time_median6.949999999999983
deviation-center-line_median0.14515763358018943
in-drivable-lane_median4.649999999999985


other stats
agent_compute-ego0_max0.025260439879602664
agent_compute-ego0_mean0.025260439879602664
agent_compute-ego0_median0.025260439879602664
agent_compute-ego0_min0.025260439879602664
agent_compute-ego1_max0.025465416393691688
agent_compute-ego1_mean0.02546541639369169
agent_compute-ego1_median0.025465416393691688
agent_compute-ego1_min0.025465416393691688
agent_compute-ego2_max0.025556279600953028
agent_compute-ego2_mean0.025556279600953028
agent_compute-ego2_median0.025556279600953028
agent_compute-ego2_min0.025556279600953028
complete-iteration_max1.1213485903019529
complete-iteration_mean1.1213485903019529
complete-iteration_median1.1213485903019529
complete-iteration_min1.1213485903019529
deviation-center-line_max0.1853857962616197
deviation-center-line_mean0.1581945298226464
deviation-center-line_min0.1440401596261301
deviation-heading_max1.6795484027963108
deviation-heading_mean0.9986971509229964
deviation-heading_median0.7649721039644373
deviation-heading_min0.5515709460082407
driven_any_max2.979128265608773
driven_any_mean1.6970680988084517
driven_any_median1.6540685154461832
driven_any_min0.45800751537039824
driven_lanedir_consec_max0.6419379600343871
driven_lanedir_consec_mean0.5358282889343965
driven_lanedir_consec_min0.456958832092726
driven_lanedir_max0.6467016616800385
driven_lanedir_mean0.537416189482947
driven_lanedir_median0.5085880746760765
driven_lanedir_min0.456958832092726
get_duckie_state_max4.552251143421201e-06
get_duckie_state_mean4.552251143421201e-06
get_duckie_state_median4.552251143421201e-06
get_duckie_state_min4.552251143421201e-06
get_robot_state_max0.11707636949827344
get_robot_state_mean0.11707636949827344
get_robot_state_median0.11707636949827344
get_robot_state_min0.11707636949827344
get_state_dump_max0.05125573041627733
get_state_dump_mean0.05125573041627733
get_state_dump_median0.05125573041627733
get_state_dump_min0.05125573041627733
get_ui_image_max0.1102217650241989
get_ui_image_mean0.1102217650241989
get_ui_image_median0.1102217650241989
get_ui_image_min0.1102217650241989
in-drivable-lane_max4.849999999999983
in-drivable-lane_mean3.166666666666656
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego0": {"driven_any": 1.6540685154461832, "get_ui_image": 0.1102217650241989, "step_physics": 0.5835607909470153, "survival_time": 6.949999999999983, "driven_lanedir": 0.6467016616800385, "get_state_dump": 0.05125573041627733, "get_robot_state": 0.11707636949827344, "sim_render-ego0": 0.011285680661098562, "sim_render-ego1": 0.01122633844828434, "sim_render-ego2": 0.010836141572581778, "get_duckie_state": 4.552251143421201e-06, "in-drivable-lane": 4.849999999999983, "deviation-heading": 0.7649721039644373, "agent_compute-ego0": 0.025260439879602664, "agent_compute-ego1": 0.025465416393691688, "agent_compute-ego2": 0.025556279600953028, "complete-iteration": 1.1213485903019529, "set_robot_commands": 0.008269635893458084, "deviation-center-line": 0.1440401596261301, "driven_lanedir_consec": 0.6419379600343871, "sim_compute_sim_state": 0.10240138520439752, "sim_compute_performance-ego0": 0.007259687931417561, "sim_compute_performance-ego1": 0.007126161520429652, "sim_compute_performance-ego2": 0.007638507609744724}, "udem1-sc0-0-ego1": {"driven_any": 0.45800751537039824, "get_ui_image": 0.1102217650241989, "step_physics": 0.5835607909470153, "survival_time": 6.949999999999983, "driven_lanedir": 0.456958832092726, "get_state_dump": 0.05125573041627733, "get_robot_state": 0.11707636949827344, "sim_render-ego0": 0.011285680661098562, "sim_render-ego1": 0.01122633844828434, "sim_render-ego2": 0.010836141572581778, "get_duckie_state": 4.552251143421201e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.5515709460082407, "agent_compute-ego0": 0.025260439879602664, "agent_compute-ego1": 0.025465416393691688, "agent_compute-ego2": 0.025556279600953028, "complete-iteration": 1.1213485903019529, "set_robot_commands": 0.008269635893458084, "deviation-center-line": 0.14515763358018943, "driven_lanedir_consec": 0.456958832092726, "sim_compute_sim_state": 0.10240138520439752, "sim_compute_performance-ego0": 0.007259687931417561, "sim_compute_performance-ego1": 0.007126161520429652, "sim_compute_performance-ego2": 0.007638507609744724}, "udem1-sc0-0-ego2": {"driven_any": 2.979128265608773, "get_ui_image": 0.1102217650241989, "step_physics": 0.5835607909470153, "survival_time": 6.949999999999983, "driven_lanedir": 0.5085880746760765, "get_state_dump": 0.05125573041627733, "get_robot_state": 0.11707636949827344, "sim_render-ego0": 0.011285680661098562, "sim_render-ego1": 0.01122633844828434, "sim_render-ego2": 0.010836141572581778, "get_duckie_state": 4.552251143421201e-06, "in-drivable-lane": 4.649999999999985, "deviation-heading": 1.6795484027963108, "agent_compute-ego0": 0.025260439879602664, "agent_compute-ego1": 0.025465416393691688, "agent_compute-ego2": 0.025556279600953028, "complete-iteration": 1.1213485903019529, "set_robot_commands": 0.008269635893458084, "deviation-center-line": 0.1853857962616197, "driven_lanedir_consec": 0.5085880746760765, "sim_compute_sim_state": 0.10240138520439752, "sim_compute_performance-ego0": 0.007259687931417561, "sim_compute_performance-ego1": 0.007126161520429652, "sim_compute_performance-ego2": 0.007638507609744724}}
set_robot_commands_max0.008269635893458084
set_robot_commands_mean0.008269635893458084
set_robot_commands_median0.008269635893458084
set_robot_commands_min0.008269635893458084
sim_compute_performance-ego0_max0.007259687931417561
sim_compute_performance-ego0_mean0.007259687931417561
sim_compute_performance-ego0_median0.007259687931417561
sim_compute_performance-ego0_min0.007259687931417561
sim_compute_performance-ego1_max0.007126161520429652
sim_compute_performance-ego1_mean0.007126161520429652
sim_compute_performance-ego1_median0.007126161520429652
sim_compute_performance-ego1_min0.007126161520429652
sim_compute_performance-ego2_max0.007638507609744724
sim_compute_performance-ego2_mean0.007638507609744724
sim_compute_performance-ego2_median0.007638507609744724
sim_compute_performance-ego2_min0.007638507609744724
sim_compute_sim_state_max0.10240138520439752
sim_compute_sim_state_mean0.10240138520439752
sim_compute_sim_state_median0.10240138520439752
sim_compute_sim_state_min0.10240138520439752
sim_render-ego0_max0.011285680661098562
sim_render-ego0_mean0.011285680661098562
sim_render-ego0_median0.011285680661098562
sim_render-ego0_min0.011285680661098562
sim_render-ego1_max0.01122633844828434
sim_render-ego1_mean0.01122633844828434
sim_render-ego1_median0.01122633844828434
sim_render-ego1_min0.01122633844828434
sim_render-ego2_max0.010836141572581778
sim_render-ego2_mean0.010836141572581776
sim_render-ego2_median0.010836141572581778
sim_render-ego2_min0.010836141572581778
simulation-passed1
step_physics_max0.5835607909470153
step_physics_mean0.5835607909470153
step_physics_median0.5835607909470153
step_physics_min0.5835607909470153
survival_time_max6.949999999999983
survival_time_mean6.949999999999984
survival_time_min6.949999999999983
No reset possible
3953911184Bea Baselines 🐤baseline-duckietownaido5-LFV-sim-testingLFVv-simerrornoreg05-221dc42400b8-11:00:39
Waited 3603 seconds [...]
Waited 3603 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3952611193Bea Baselines 🐤template-rosaido5-LFV-sim-validationLFVv-simerrornoreg05-221dc42400b8-11:00:39
Waited 3605 seconds [...]
Waited 3605 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3951911197Bea Baselines 🐤template-rosaido5-LFVI-sim-testingLFVIt-simerrornoreg05-221dc42400b8-11:00:52
Waited 3608 seconds [...]
Waited 3608 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3951611201Bea Baselines 🐤template-pytorchaido5-LF-sanity-sim-validationsanity-checkfailednoreg05-221dc42400b8-10:00:54
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3951311203Bea Baselines 🐤template-pytorchaido5-LFV-sim-validationLFVv-simfailednoreg05-221dc42400b8-10:00:51
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3950811205Bea Baselines 🐤template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simfailednoreg05-221dc42400b8-10:01:00
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3950611206Bea Baselines 🐤template-pytorchaido5-LFVI-sim-validationLFVIv-simfailednoreg05-221dc42400b8-10:00:51
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3950311206Bea Baselines 🐤template-pytorchaido5-LFVI-sim-validationLFVIv-simfailednoreg05-221dc42400b8-10:00:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3948810404Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simerrornoreg05-221dc42400b8-11:00:43
Waited 3606 seconds [...]
Waited 3606 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3948111209Bea Baselines 🐤template-tensorflowaido5-LF-sim-validationLFv-simfailednoreg05-221dc42400b8-10:01:26
The container "solut [...]
The container "solution" exited with code 139.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3947611208Bea Baselines 🐤template-pytorchaido5-LFVI_multi-sim-validationLFVIv-simhost-errornoreg05-221dc42400b8-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3947311211Bea Baselines 🐤template-tensorflowaido5-LF-sanity-sim-validationsanity-checkhost-errornoreg05-221dc42400b8-10:00:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3946811210Bea Baselines 🐤template-tensorflowaido5-LFP-sim-validationLFP-simhost-errornoreg05-221dc42400b8-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3946411211Bea Baselines 🐤template-tensorflowaido5-LF-sanity-sim-validationsanity-checkhost-errornoreg05-221dc42400b8-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3946011212Bea Baselines 🐤template-tensorflowaido5-LF-sim-testingLFt-simhost-errornoreg05-221dc42400b8-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3945611213Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simhost-errornoreg05-221dc42400b8-10:00:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3945211213Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simhost-errornoreg05-221dc42400b8-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3944411214Bea Baselines 🐤template-tensorflowaido5-LFV-sim-testingLFVv-simhost-errornoreg05-221dc42400b8-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3944011218Bea Baselines 🐤template-tensorflowaido5-LFVI_multi-sim-validationLFVIv-simhost-errornoreg05-221dc42400b8-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3943611218Bea Baselines 🐤template-tensorflowaido5-LFVI_multi-sim-validationLFVIv-simhost-errornoreg05-221dc42400b8-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3943111218Bea Baselines 🐤template-tensorflowaido5-LFVI_multi-sim-validationLFVIv-simhost-errornoreg05-221dc42400b8-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3942511218Bea Baselines 🐤template-tensorflowaido5-LFVI_multi-sim-validationLFVIv-simhost-errornoreg05-221dc42400b8-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3942011215Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simabortednoreg05-221dc42400b8-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3941411219Charlie Gauthier 🇨🇦Baseline solution using reinforcement learningaido5-LF-sim-validationLFv-simhost-errornoreg05-221dc42400b8-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3941111216Bea Baselines 🐤template-tensorflowaido5-LFVI-sim-validationLFVIv-simhost-errornoreg05-221dc42400b8-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3940711217Bea Baselines 🐤template-tensorflowaido5-LFVI-sim-testingLFVIt-simhost-errornoreg05-221dc42400b8-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible