Duckietown Challenges Home Challenges Submissions

Evaluator 1886

ID1886
evaluatorreg09-f5ca14bc80e2-1
ownerI don't have one 😀
machinearchimede
processreg09-f5ca14bc80e2-1
versiond-c:6.1.5;d-c-r:6.0.29
first heard
last heard
statusinactive
# evaluating
# success4 33460
# timeout
# failed
# error6 33529
# aborted
# host-error1 33648
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
336488839Bea Baselines 🐤baseline-duckietownaido5-LF-sim-validationLFv-simhost-errornoreg09-f5ca14bc80e2-10:13:19
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 673, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 1402, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 1650, in upload
    copy_to_cache(realfile, sha256hex)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 272, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 163, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 149, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission8839/LFv-sim-reg09-f5ca14bc80e2-1-job33648/docker-compose.original.yaml' -> '/tmp/duckietown/DT18/evaluator/cache/by-value/sha256hex/0b992ef02456c17f2cea0f8f35f51c7c514cda87a917c2bea31393f2314e2557'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336028423Bea Baselines 🐤baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg09-f5ca14bc80e2-10:25:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8379808017287846
survival_time_median14.950000000000076
deviation-center-line_median0.4323243442879397
in-drivable-lane_median8.050000000000079


other stats
agent_compute-ego_max0.027379985091350832
agent_compute-ego_mean0.025785831798533783
agent_compute-ego_median0.025502721468607582
agent_compute-ego_min0.025155619780222575
complete-iteration_max0.295793301264445
complete-iteration_mean0.28487333775340806
complete-iteration_median0.2890481348832448
complete-iteration_min0.2617583519605629
deviation-center-line_max0.5951037490957506
deviation-center-line_mean0.4215491918470832
deviation-center-line_min0.175711476469914
deviation-heading_max2.0774795477430796
deviation-heading_mean1.348993037392404
deviation-heading_median1.3064177736239682
deviation-heading_min1.0101304032791785
driven_any_max1.9399946209875076
driven_any_mean1.9034998775542948
driven_any_median1.939968639437901
driven_any_min1.7010054794962142
driven_lanedir_consec_max1.4989971773597095
driven_lanedir_consec_mean0.8669556880427972
driven_lanedir_consec_min0.563365087917483
driven_lanedir_max1.4989971773597095
driven_lanedir_mean0.8678741691347851
driven_lanedir_median0.8379808017287846
driven_lanedir_min0.5725498988373603
get_state_dump_max0.01818272550749688
get_state_dump_mean0.016192287180054873
get_state_dump_median0.01604421099026998
get_state_dump_min0.015465927124023438
get_ui_image_max0.05806638479232788
get_ui_image_mean0.05352473744644866
get_ui_image_median0.05327622890472413
get_ui_image_min0.04880767448773402
in-drivable-lane_max9.85000000000008
in-drivable-lane_mean7.560000000000082
in-drivable-lane_min2.900000000000041
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.9336816339934844, "get_ui_image": 0.05806638479232788, "step_physics": 0.13661900122960408, "survival_time": 14.950000000000076, "driven_lanedir": 1.4989971773597095, "get_state_dump": 0.015508687496185305, "sim_render-ego": 0.006791539986928304, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.025337522824605305, "deviation-heading": 2.0774795477430796, "complete-iteration": 0.295793301264445, "set_robot_commands": 0.006110060214996338, "deviation-center-line": 0.563237003654633, "driven_lanedir_consec": 1.4989971773597095, "sim_compute_sim_state": 0.022240997950236003, "sim_compute_performance-ego": 0.005665837128957112, "sim_compute_robot_state-ego": 0.009654804865519206, "sim_compute_robot_state-parked0": 0.009608219464619957}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.9399688364723628, "get_ui_image": 0.056819287141164146, "step_physics": 0.13289206822713215, "survival_time": 14.950000000000076, "driven_lanedir": 0.5725498988373603, "get_state_dump": 0.015465927124023438, "sim_render-ego": 0.006778464317321777, "in-drivable-lane": 9.85000000000008, "agent_compute-ego": 0.0257120680809021, "deviation-heading": 1.5399431782057271, "complete-iteration": 0.29063032229741415, "set_robot_commands": 0.006288848718007406, "deviation-center-line": 0.3508296581777571, "driven_lanedir_consec": 0.563365087917483, "sim_compute_sim_state": 0.021226325035095216, "sim_compute_performance-ego": 0.005658516089121501, "sim_compute_robot_state-ego": 0.00987104098002116, "sim_compute_robot_state-parked0": 0.00973196585973104}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.9399691020916543, "get_ui_image": 0.05645151217778524, "step_physics": 0.13718088308970133, "survival_time": 14.950000000000076, "driven_lanedir": 0.8247433681274499, "get_state_dump": 0.015583670139312744, "sim_render-ego": 0.006659586429595948, "in-drivable-lane": 8.300000000000093, "agent_compute-ego": 0.025427820682525634, "deviation-heading": 1.1081624695563996, "complete-iteration": 0.2927627603212992, "set_robot_commands": 0.006042418479919434, "deviation-center-line": 0.3792535905705782, "driven_lanedir_consec": 0.8247433681274499, "sim_compute_sim_state": 0.020219488938649496, "sim_compute_performance-ego": 0.005724916458129883, "sim_compute_robot_state-ego": 0.009781360626220705, "sim_compute_robot_state-parked0": 0.009508577982584636}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.939949463933342, "get_ui_image": 0.053557105859120685, "step_physics": 0.1382811180750529, "survival_time": 14.950000000000076, "driven_lanedir": 1.0032535378829854, "get_state_dump": 0.01610271692276001, "sim_render-ego": 0.00688115119934082, "in-drivable-lane": 6.750000000000092, "agent_compute-ego": 0.025175596078236898, "deviation-heading": 1.5552161444701318, "complete-iteration": 0.29151459217071535, "set_robot_commands": 0.006330969333648681, "deviation-center-line": 0.5951037490957506, "driven_lanedir_consec": 1.0032535378829854, "sim_compute_sim_state": 0.01935348192850749, "sim_compute_performance-ego": 0.005723265012105306, "sim_compute_robot_state-ego": 0.010045947233835856, "sim_compute_robot_state-parked0": 0.009877177874247233}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.8205023728877416, "get_ui_image": 0.051489840198666176, "step_physics": 0.11724094818495348, "survival_time": 14.050000000000065, "driven_lanedir": 0.6262730780917599, "get_state_dump": 0.016523927980470487, "sim_render-ego": 0.006976906515101097, "in-drivable-lane": 8.750000000000075, "agent_compute-ego": 0.02694374725911965, "deviation-heading": 1.0174916422274978, "complete-iteration": 0.2668903162470916, "set_robot_commands": 0.006629177684037287, "deviation-center-line": 0.175711476469914, "driven_lanedir_consec": 0.6262730780917599, "sim_compute_sim_state": 0.014222808579957358, "sim_compute_performance-ego": 0.0059469195871590715, "sim_compute_robot_state-ego": 0.010393279303011095, "sim_compute_robot_state-parked0": 0.010329972806774425}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.7010054794962142, "get_ui_image": 0.04880767448773402, "step_physics": 0.108124055789904, "survival_time": 13.150000000000052, "driven_lanedir": 0.6106762954118912, "get_state_dump": 0.01818272550749688, "sim_render-ego": 0.007547884386301947, "in-drivable-lane": 8.000000000000062, "agent_compute-ego": 0.027379985091350832, "deviation-heading": 1.0101304032791785, "complete-iteration": 0.2617583519605629, "set_robot_commands": 0.007104373250170806, "deviation-center-line": 0.20366038934752703, "driven_lanedir_consec": 0.6106762954118912, "sim_compute_sim_state": 0.015381623583601454, "sim_compute_performance-ego": 0.006462207765180348, "sim_compute_robot_state-ego": 0.011668376596254994, "sim_compute_robot_state-parked0": 0.010889285417564017}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.9399684424034391, "get_ui_image": 0.05299535195032755, "step_physics": 0.13876829067866006, "survival_time": 14.950000000000076, "driven_lanedir": 0.983598163308568, "get_state_dump": 0.015985705057779947, "sim_render-ego": 0.006902862389882406, "in-drivable-lane": 6.850000000000092, "agent_compute-ego": 0.025577622254689535, "deviation-heading": 1.521999783325427, "complete-iteration": 0.29109784921010334, "set_robot_commands": 0.006234334309895833, "deviation-center-line": 0.5190683604700652, "driven_lanedir_consec": 0.983598163308568, "sim_compute_sim_state": 0.01912957509358724, "sim_compute_performance-ego": 0.0055945396423339845, "sim_compute_robot_state-ego": 0.010068387190500894, "sim_compute_robot_state-parked0": 0.009658111731211344}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.9399779786614095, "get_ui_image": 0.05081296523412069, "step_physics": 0.13665747960408528, "survival_time": 14.950000000000076, "driven_lanedir": 0.8512182353301194, "get_state_dump": 0.016311912536621093, "sim_render-ego": 0.006766884326934814, "in-drivable-lane": 8.100000000000094, "agent_compute-ego": 0.025308024883270264, "deviation-heading": 1.0466716578686586, "complete-iteration": 0.28660741249720256, "set_robot_commands": 0.006178888479868571, "deviation-center-line": 0.4157179456393499, "driven_lanedir_consec": 0.8512182353301194, "sim_compute_sim_state": 0.019359800815582275, "sim_compute_performance-ego": 0.005575985908508301, "sim_compute_robot_state-ego": 0.00985058307647705, "sim_compute_robot_state-parked0": 0.009600520133972168}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.9399808446157891, "get_ui_image": 0.0524370265007019, "step_physics": 0.13256432056427003, "survival_time": 14.950000000000076, "driven_lanedir": 0.9671678663696004, "get_state_dump": 0.016407334804534913, "sim_render-ego": 0.0070380441347757975, "in-drivable-lane": 7.200000000000097, "agent_compute-ego": 0.02584031105041504, "deviation-heading": 1.3351416318915108, "complete-iteration": 0.28421252409617104, "set_robot_commands": 0.0063413087526957195, "deviation-center-line": 0.5639790021087282, "driven_lanedir_consec": 0.9671678663696004, "sim_compute_sim_state": 0.017560694217681885, "sim_compute_performance-ego": 0.005786774158477784, "sim_compute_robot_state-ego": 0.010237615903218589, "sim_compute_robot_state-parked0": 0.00980850617090861}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.9399946209875076, "get_ui_image": 0.053810226122538246, "step_physics": 0.13623553435007732, "survival_time": 14.950000000000076, "driven_lanedir": 0.7402640706284056, "get_state_dump": 0.01585026423136393, "sim_render-ego": 0.00676728089650472, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.025155619780222575, "deviation-heading": 1.2776939153564255, "complete-iteration": 0.2874659474690755, "set_robot_commands": 0.006086350282033285, "deviation-center-line": 0.44893074293652946, "driven_lanedir_consec": 0.7402640706284056, "sim_compute_sim_state": 0.018138508796691898, "sim_compute_performance-ego": 0.005646973450978597, "sim_compute_robot_state-ego": 0.010039538542429604, "sim_compute_robot_state-parked0": 0.009554015000661217}}
set_robot_commands_max0.007104373250170806
set_robot_commands_mean0.006334672950527337
set_robot_commands_median0.0062615915139516195
set_robot_commands_min0.006042418479919434
sim_compute_performance-ego_max0.006462207765180348
sim_compute_performance-ego_mean0.0057785935200951885
sim_compute_performance-ego_median0.005694551070531209
sim_compute_performance-ego_min0.005575985908508301
sim_compute_robot_state-ego_max0.011668376596254994
sim_compute_robot_state-ego_mean0.010161093431748916
sim_compute_robot_state-ego_median0.010042742888132733
sim_compute_robot_state-ego_min0.009654804865519206
sim_compute_robot_state-parked0_max0.010889285417564017
sim_compute_robot_state-parked0_mean0.009856635244227464
sim_compute_robot_state-parked0_median0.009695038795471192
sim_compute_robot_state-parked0_min0.009508577982584636
sim_compute_sim_state_max0.022240997950236003
sim_compute_sim_state_mean0.01868333049395903
sim_compute_sim_state_median0.019241528511047365
sim_compute_sim_state_min0.014222808579957358
sim_render-ego_max0.007547884386301947
sim_render-ego_mean0.0069110604582687625
sim_render-ego_median0.006836345593134562
sim_render-ego_min0.006659586429595948
simulation-passed1
step_physics_max0.13876829067866006
step_physics_mean0.13145636997934404
step_physics_median0.1364272677898407
step_physics_min0.108124055789904
survival_time_max14.950000000000076
survival_time_mean14.680000000000073
survival_time_min13.150000000000052
No reset possible
335998371Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg09-f5ca14bc80e2-10:01:02
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335958315Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg09-f5ca14bc80e2-10:01:11
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335928251Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg09-f5ca14bc80e2-10:01:03
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335446842Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg09-f5ca14bc80e2-10:25:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4474480956509654
survival_time_median14.950000000000076
deviation-center-line_median0.7812190559823705
in-drivable-lane_median3.975000000000057


other stats
agent_compute-ego_max0.027633500893910725
agent_compute-ego_mean0.027134450833002727
agent_compute-ego_median0.02718633770942688
agent_compute-ego_min0.02651387850443522
complete-iteration_max0.28826690832773844
complete-iteration_mean0.2812335597674052
complete-iteration_median0.28286655267079674
complete-iteration_min0.2715794547398885
deviation-center-line_max1.3426902645302867
deviation-center-line_mean0.77707396915906
deviation-center-line_min0.4187080627566552
deviation-heading_max2.8582096888582686
deviation-heading_mean2.314924657349917
deviation-heading_median2.271022039548609
deviation-heading_min1.2970834587767974
driven_any_max2.0421037080268984
driven_any_mean2.0414356014719965
driven_any_median2.0421017388925904
driven_any_min2.0354536924554405
driven_lanedir_consec_max2.002554917813749
driven_lanedir_consec_mean1.4002949921639902
driven_lanedir_consec_min0.6559917527097715
driven_lanedir_max2.002554917813749
driven_lanedir_mean1.4002949921639902
driven_lanedir_median1.4474480956509654
driven_lanedir_min0.6559917527097715
get_state_dump_max0.018546263376871742
get_state_dump_mean0.01769419741630554
get_state_dump_median0.017564895550409954
get_state_dump_min0.017045259475708008
get_ui_image_max0.0506670880317688
get_ui_image_mean0.0494648470878601
get_ui_image_median0.049369460741678875
get_ui_image_min0.04866466522216797
in-drivable-lane_max9.00000000000009
in-drivable-lane_mean4.085000000000041
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 2.0354536924554405, "get_ui_image": 0.04923608541488647, "step_physics": 0.1247084895769755, "survival_time": 14.950000000000076, "driven_lanedir": 0.8347494309044227, "get_state_dump": 0.017521438598632814, "sim_render-ego": 0.007448775768280029, "in-drivable-lane": 7.65000000000006, "agent_compute-ego": 0.027476712067921957, "deviation-heading": 2.8334008461587548, "complete-iteration": 0.2831755606333415, "set_robot_commands": 0.007127319176991781, "deviation-center-line": 0.5785393010496003, "driven_lanedir_consec": 0.8347494309044227, "sim_compute_sim_state": 0.021067125797271727, "sim_compute_performance-ego": 0.006216226418813069, "sim_compute_robot_state-ego": 0.01122859239578247, "sim_compute_robot_state-parked0": 0.010935784180959066}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.0420957201546552, "get_ui_image": 0.050138570467631025, "step_physics": 0.12892784436543783, "survival_time": 14.950000000000076, "driven_lanedir": 1.1575564430625631, "get_state_dump": 0.017274888356526692, "sim_render-ego": 0.00721459150314331, "in-drivable-lane": 5.650000000000019, "agent_compute-ego": 0.027120354970296225, "deviation-heading": 2.8582096888582686, "complete-iteration": 0.2856730492909749, "set_robot_commands": 0.00685410737991333, "deviation-center-line": 0.9298544054062488, "driven_lanedir_consec": 1.1575564430625631, "sim_compute_sim_state": 0.020415978431701665, "sim_compute_performance-ego": 0.006084146499633789, "sim_compute_robot_state-ego": 0.010957297484079996, "sim_compute_robot_state-parked0": 0.010483660697937013}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 2.0421037080268984, "get_ui_image": 0.04950283606847127, "step_physics": 0.1215318512916565, "survival_time": 14.950000000000076, "driven_lanedir": 1.614546524359839, "get_state_dump": 0.017608352502187095, "sim_render-ego": 0.007207224369049072, "in-drivable-lane": 2.600000000000037, "agent_compute-ego": 0.02651387850443522, "deviation-heading": 2.727031698663408, "complete-iteration": 0.27675527890523277, "set_robot_commands": 0.006974401473999023, "deviation-center-line": 1.035971441080864, "driven_lanedir_consec": 1.614546524359839, "sim_compute_sim_state": 0.019436442852020265, "sim_compute_performance-ego": 0.006014637152353923, "sim_compute_robot_state-ego": 0.011024942398071289, "sim_compute_robot_state-parked0": 0.010733809471130371}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 2.042103400017607, "get_ui_image": 0.04885801235834757, "step_physics": 0.12446052074432372, "survival_time": 14.950000000000076, "driven_lanedir": 1.9876796290497225, "get_state_dump": 0.017435601552327474, "sim_render-ego": 0.007184693018595378, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02685332298278809, "deviation-heading": 2.1330197264740764, "complete-iteration": 0.2783806610107422, "set_robot_commands": 0.006963120301564534, "deviation-center-line": 0.8474371067318099, "driven_lanedir_consec": 1.9876796290497225, "sim_compute_sim_state": 0.019106477896372476, "sim_compute_performance-ego": 0.006061483224232992, "sim_compute_robot_state-ego": 0.010815083185831706, "sim_compute_robot_state-parked0": 0.010438770453135172}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.042095729678452, "get_ui_image": 0.049986465771993, "step_physics": 0.12269843657811484, "survival_time": 14.950000000000076, "driven_lanedir": 0.7109777861039153, "get_state_dump": 0.01732189178466797, "sim_render-ego": 0.00729093869527181, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.027252320448557535, "deviation-heading": 2.405574138477725, "complete-iteration": 0.2755653977394104, "set_robot_commands": 0.006918528079986572, "deviation-center-line": 0.4730429431568075, "driven_lanedir_consec": 0.7109777861039153, "sim_compute_sim_state": 0.016141102313995362, "sim_compute_performance-ego": 0.00607785701751709, "sim_compute_robot_state-ego": 0.010979034105936689, "sim_compute_robot_state-parked0": 0.010693883101145428}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.0420948940863317, "get_ui_image": 0.0506670880317688, "step_physics": 0.1313747811317444, "survival_time": 14.950000000000076, "driven_lanedir": 0.6559917527097715, "get_state_dump": 0.017045259475708008, "sim_render-ego": 0.007231327692667643, "in-drivable-lane": 9.00000000000009, "agent_compute-ego": 0.027540218830108643, "deviation-heading": 2.6004489119546816, "complete-iteration": 0.2838535666465759, "set_robot_commands": 0.006710782845815022, "deviation-center-line": 0.4187080627566552, "driven_lanedir_consec": 0.6559917527097715, "sim_compute_sim_state": 0.01564413865407308, "sim_compute_performance-ego": 0.006122268835703532, "sim_compute_robot_state-ego": 0.010763673782348632, "sim_compute_robot_state-parked0": 0.01054673671722412}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.042101235039431, "get_ui_image": 0.04917982419331869, "step_physics": 0.12676645119984944, "survival_time": 14.950000000000076, "driven_lanedir": 2.002554917813749, "get_state_dump": 0.01775420347849528, "sim_render-ego": 0.007387856642405192, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026852296988169353, "deviation-heading": 2.0583781094180114, "complete-iteration": 0.28255754470825195, "set_robot_commands": 0.006891317367553711, "deviation-center-line": 0.7150010052329311, "driven_lanedir_consec": 2.002554917813749, "sim_compute_sim_state": 0.019320194721221925, "sim_compute_performance-ego": 0.006295679410298665, "sim_compute_robot_state-ego": 0.011378594239552816, "sim_compute_robot_state-parked0": 0.010521100362141928}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.042102242745749, "get_ui_image": 0.0486650562286377, "step_physics": 0.12765238920847574, "survival_time": 14.950000000000076, "driven_lanedir": 1.8298276377844271, "get_state_dump": 0.01847311019897461, "sim_render-ego": 0.007613835334777832, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.027633500893910725, "deviation-heading": 2.099630054097956, "complete-iteration": 0.28652817567189537, "set_robot_commands": 0.007268722057342529, "deviation-center-line": 0.8515660716546715, "driven_lanedir_consec": 1.8298276377844271, "sim_compute_sim_state": 0.01990854422251383, "sim_compute_performance-ego": 0.006490116914113363, "sim_compute_robot_state-ego": 0.01156474749247233, "sim_compute_robot_state-parked0": 0.011042763392130532}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 2.042102891310446, "get_ui_image": 0.04866466522216797, "step_physics": 0.11340858777364096, "survival_time": 14.950000000000076, "driven_lanedir": 1.280349666942092, "get_state_dump": 0.018546263376871742, "sim_render-ego": 0.007571031252543131, "in-drivable-lane": 5.350000000000076, "agent_compute-ego": 0.027436216672261555, "deviation-heading": 1.2970834587767974, "complete-iteration": 0.2715794547398885, "set_robot_commands": 0.007290747165679932, "deviation-center-line": 0.5779290899907247, "driven_lanedir_consec": 1.280349666942092, "sim_compute_sim_state": 0.01860982656478882, "sim_compute_performance-ego": 0.006488794485727946, "sim_compute_robot_state-ego": 0.012072408199310302, "sim_compute_robot_state-parked0": 0.01127785285313924}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 2.042102501204954, "get_ui_image": 0.049749867121378584, "step_physics": 0.13329453309377037, "survival_time": 14.950000000000076, "driven_lanedir": 1.9287161329094025, "get_state_dump": 0.01796096483866374, "sim_render-ego": 0.007349764506022136, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.02666568597157796, "deviation-heading": 2.136469940619493, "complete-iteration": 0.28826690832773844, "set_robot_commands": 0.006949816544850667, "deviation-center-line": 1.3426902645302867, "driven_lanedir_consec": 1.9287161329094025, "sim_compute_sim_state": 0.018078223069508872, "sim_compute_performance-ego": 0.006149057547251383, "sim_compute_robot_state-ego": 0.011169302463531492, "sim_compute_robot_state-parked0": 0.010691200097401935}}
set_robot_commands_max0.007290747165679932
set_robot_commands_mean0.006994886239369709
set_robot_commands_median0.006956468423207601
set_robot_commands_min0.006710782845815022
sim_compute_performance-ego_max0.006490116914113363
sim_compute_performance-ego_mean0.006200026750564575
sim_compute_performance-ego_median0.0061356631914774576
sim_compute_performance-ego_min0.006014637152353923
sim_compute_robot_state-ego_max0.012072408199310302
sim_compute_robot_state-ego_mean0.011195367574691773
sim_compute_robot_state-ego_median0.011097122430801392
sim_compute_robot_state-ego_min0.010763673782348632
sim_compute_robot_state-parked0_max0.01127785285313924
sim_compute_robot_state-parked0_mean0.01073655613263448
sim_compute_robot_state-parked0_median0.010692541599273684
sim_compute_robot_state-parked0_min0.010438770453135172
sim_compute_sim_state_max0.021067125797271727
sim_compute_sim_state_mean0.0187728054523468
sim_compute_sim_state_median0.0192133363087972
sim_compute_sim_state_min0.01564413865407308
sim_render-ego_max0.007613835334777832
sim_render-ego_mean0.007350003878275553
sim_render-ego_median0.007320351600646972
sim_render-ego_min0.007184693018595378
simulation-passed1
step_physics_max0.13329453309377037
step_physics_mean0.12548238849639892
step_physics_median0.1257374703884125
step_physics_min0.11340858777364096
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
335407751Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simerrornoreg09-f5ca14bc80e2-10:00:48
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335357763Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg09-f5ca14bc80e2-10:01:05
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335297691Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg09-f5ca14bc80e2-10:01:23
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
334877215Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simsuccessnoreg09-f5ca14bc80e2-10:27:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1165017655687546
survival_time_median14.950000000000076
deviation-center-line_median0.5456136952861728
in-drivable-lane_median5.750000000000082


other stats
agent_compute-ego_max0.057000470161437986
agent_compute-ego_mean0.05093956398963928
agent_compute-ego_median0.053495121796925865
agent_compute-ego_min0.02788774331410726
complete-iteration_max0.32068041880925496
complete-iteration_mean0.306652075980839
complete-iteration_median0.306104983886083
complete-iteration_min0.2884009544054667
deviation-center-line_max1.1164348235148172
deviation-center-line_mean0.5560714872051994
deviation-center-line_min0.16297329040699948
deviation-heading_max2.4947230619517775
deviation-heading_mean1.5890255716282238
deviation-heading_median1.4617723673580163
deviation-heading_min1.02157985870919
driven_any_max1.9399991935992864
driven_any_mean1.930053407028124
driven_any_median1.9399629037766148
driven_any_min1.84705725254612
driven_lanedir_consec_max1.5962851098168196
driven_lanedir_consec_mean1.1004666035990571
driven_lanedir_consec_min0.6155329170214546
driven_lanedir_max1.5962851098168196
driven_lanedir_mean1.1053930574281292
driven_lanedir_median1.1411340347141143
driven_lanedir_min0.6155329170214546
get_state_dump_max0.018187145392100017
get_state_dump_mean0.017397310365710343
get_state_dump_median0.01725264549255371
get_state_dump_min0.017007036209106444
get_ui_image_max0.05194203694661458
get_ui_image_mean0.05101852491445709
get_ui_image_median0.05101066643731636
get_ui_image_min0.050364135106404626
in-drivable-lane_max9.500000000000089
in-drivable-lane_mean5.9250000000000735
in-drivable-lane_min2.300000000000031
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.9336815927038535, "get_ui_image": 0.05037220637003581, "step_physics": 0.12622684160868328, "survival_time": 14.950000000000076, "driven_lanedir": 1.5081640490318335, "get_state_dump": 0.01802632490793864, "sim_render-ego": 0.007743012110392252, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.02788774331410726, "deviation-heading": 2.4947230619517775, "complete-iteration": 0.2884009544054667, "set_robot_commands": 0.007077124118804932, "deviation-center-line": 0.68686531234156, "driven_lanedir_consec": 1.5081640490318335, "sim_compute_sim_state": 0.021736395359039307, "sim_compute_performance-ego": 0.006592103640238444, "sim_compute_robot_state-ego": 0.011543453534444172, "sim_compute_robot_state-parked0": 0.010967915058135986}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.939963056218175, "get_ui_image": 0.0504882272084554, "step_physics": 0.1246639879544576, "survival_time": 14.950000000000076, "driven_lanedir": 1.5962851098168196, "get_state_dump": 0.017031315167744955, "sim_render-ego": 0.0071613693237304685, "in-drivable-lane": 2.300000000000031, "agent_compute-ego": 0.048959693908691405, "deviation-heading": 2.125654874136686, "complete-iteration": 0.30313838720321656, "set_robot_commands": 0.006558430989583333, "deviation-center-line": 1.1164348235148172, "driven_lanedir_consec": 1.5962851098168196, "sim_compute_sim_state": 0.021209716002146405, "sim_compute_performance-ego": 0.006114093462626139, "sim_compute_robot_state-ego": 0.01067453145980835, "sim_compute_robot_state-parked0": 0.010044930775960286}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.9399627513350544, "get_ui_image": 0.05172051111857096, "step_physics": 0.1228819719950358, "survival_time": 14.950000000000076, "driven_lanedir": 1.2384840510457384, "get_state_dump": 0.017007036209106444, "sim_render-ego": 0.007318696180979411, "in-drivable-lane": 5.200000000000074, "agent_compute-ego": 0.05337269147237142, "deviation-heading": 1.196305577185468, "complete-iteration": 0.3065470242500305, "set_robot_commands": 0.006477076212565104, "deviation-center-line": 0.5275753060228251, "driven_lanedir_consec": 1.2384840510457384, "sim_compute_sim_state": 0.020142632325490316, "sim_compute_performance-ego": 0.006180043220520019, "sim_compute_robot_state-ego": 0.010942572752634685, "sim_compute_robot_state-parked0": 0.01028475046157837}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.93995017287401, "get_ui_image": 0.050364135106404626, "step_physics": 0.12371119658152262, "survival_time": 14.950000000000076, "driven_lanedir": 1.0707667766981142, "get_state_dump": 0.01746853272120158, "sim_render-ego": 0.007223249276479085, "in-drivable-lane": 6.200000000000088, "agent_compute-ego": 0.05392092148462931, "deviation-heading": 1.8196825214335617, "complete-iteration": 0.3056629435221354, "set_robot_commands": 0.006455183823903402, "deviation-center-line": 0.5636520845495203, "driven_lanedir_consec": 1.0601677208129243, "sim_compute_sim_state": 0.019191137154897057, "sim_compute_performance-ego": 0.006131343841552735, "sim_compute_robot_state-ego": 0.010857783158620198, "sim_compute_robot_state-parked0": 0.010119317372639974}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.84705725254612, "get_ui_image": 0.050892708594338934, "step_physics": 0.12153257989046866, "survival_time": 14.250000000000068, "driven_lanedir": 0.6155329170214546, "get_state_dump": 0.01714395472877904, "sim_render-ego": 0.0070624493716055885, "in-drivable-lane": 9.05000000000008, "agent_compute-ego": 0.05193052291870117, "deviation-heading": 1.02157985870919, "complete-iteration": 0.29680248394347075, "set_robot_commands": 0.0064654082582707995, "deviation-center-line": 0.19448724783517732, "driven_lanedir_consec": 0.6155329170214546, "sim_compute_sim_state": 0.014480266236422354, "sim_compute_performance-ego": 0.006125953741240919, "sim_compute_robot_state-ego": 0.010920132252207974, "sim_compute_robot_state-parked0": 0.010028668453818874}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.9399991935992864, "get_ui_image": 0.05126554568608602, "step_physics": 0.1239951237042745, "survival_time": 14.950000000000076, "driven_lanedir": 0.6391592411182686, "get_state_dump": 0.017411466439565024, "sim_render-ego": 0.007423756917317708, "in-drivable-lane": 9.500000000000089, "agent_compute-ego": 0.05533695379892985, "deviation-heading": 1.0667169377218475, "complete-iteration": 0.3050050926208496, "set_robot_commands": 0.006617817083994547, "deviation-center-line": 0.16297329040699948, "driven_lanedir_consec": 0.6391592411182686, "sim_compute_sim_state": 0.014855987230936686, "sim_compute_performance-ego": 0.006307085355122884, "sim_compute_robot_state-ego": 0.011419235865275063, "sim_compute_robot_state-parked0": 0.010146275361378987}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.939950045449089, "get_ui_image": 0.05130375305811564, "step_physics": 0.13835858106613158, "survival_time": 14.950000000000076, "driven_lanedir": 1.2115012927301143, "get_state_dump": 0.017206977208455404, "sim_render-ego": 0.007147251764933268, "in-drivable-lane": 4.95000000000007, "agent_compute-ego": 0.053617552121480304, "deviation-heading": 1.9367631903640272, "complete-iteration": 0.3206480312347412, "set_robot_commands": 0.0063477166493733726, "deviation-center-line": 0.5879359853102126, "driven_lanedir_consec": 1.1728358103245846, "sim_compute_sim_state": 0.019474508762359614, "sim_compute_performance-ego": 0.006120429833730062, "sim_compute_robot_state-ego": 0.010794743696848552, "sim_compute_robot_state-parked0": 0.010037080446879069}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.939976859866839, "get_ui_image": 0.05194203694661458, "step_physics": 0.13627125104268392, "survival_time": 14.950000000000076, "driven_lanedir": 1.0178267743257028, "get_state_dump": 0.017192037105560304, "sim_render-ego": 0.00748929500579834, "in-drivable-lane": 6.600000000000094, "agent_compute-ego": 0.054015077749888105, "deviation-heading": 1.476373585154859, "complete-iteration": 0.32068041880925496, "set_robot_commands": 0.0065409318606058755, "deviation-center-line": 0.5085700307714618, "driven_lanedir_consec": 1.0178267743257028, "sim_compute_sim_state": 0.019504772027333576, "sim_compute_performance-ego": 0.006230513254801433, "sim_compute_robot_state-ego": 0.010981170336405437, "sim_compute_robot_state-parked0": 0.010293644269307454}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.9399982590893747, "get_ui_image": 0.051128624280293786, "step_physics": 0.13042295058568318, "survival_time": 14.950000000000076, "driven_lanedir": 1.2211884381003597, "get_state_dump": 0.01729831377665202, "sim_render-ego": 0.007407722473144532, "in-drivable-lane": 5.300000000000075, "agent_compute-ego": 0.05335401296615601, "deviation-heading": 1.447171149561174, "complete-iteration": 0.31183372894922895, "set_robot_commands": 0.006286651293436686, "deviation-center-line": 0.6987319444030895, "driven_lanedir_consec": 1.2211884381003597, "sim_compute_sim_state": 0.018400301933288576, "sim_compute_performance-ego": 0.00624892791112264, "sim_compute_robot_state-ego": 0.010906066099802651, "sim_compute_robot_state-parked0": 0.01016053835550944}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.939994886599441, "get_ui_image": 0.05070750077565511, "step_physics": 0.12085548877716064, "survival_time": 14.950000000000076, "driven_lanedir": 0.935021924392887, "get_state_dump": 0.018187145392100017, "sim_render-ego": 0.007697982788085938, "in-drivable-lane": 7.450000000000096, "agent_compute-ego": 0.057000470161437986, "deviation-heading": 1.305284960063648, "complete-iteration": 0.3078016948699951, "set_robot_commands": 0.006639775435129802, "deviation-center-line": 0.5134888468963301, "driven_lanedir_consec": 0.935021924392887, "sim_compute_sim_state": 0.01810553232828776, "sim_compute_performance-ego": 0.0064693681399027505, "sim_compute_robot_state-ego": 0.011423900922139484, "sim_compute_robot_state-parked0": 0.010488811333974205}}
set_robot_commands_max0.007077124118804932
set_robot_commands_mean0.006546611572566785
set_robot_commands_median0.00650900403658549
set_robot_commands_min0.006286651293436686
sim_compute_performance-ego_max0.006592103640238444
sim_compute_performance-ego_mean0.006251986240085802
sim_compute_performance-ego_median0.006205278237660726
sim_compute_performance-ego_min0.006114093462626139
sim_compute_robot_state-ego_max0.011543453534444172
sim_compute_robot_state-ego_mean0.011046359007818658
sim_compute_robot_state-ego_median0.010931352502421329
sim_compute_robot_state-ego_min0.01067453145980835
sim_compute_robot_state-parked0_max0.010967915058135986
sim_compute_robot_state-parked0_mean0.010257193188918264
sim_compute_robot_state-parked0_median0.010153406858444214
sim_compute_robot_state-parked0_min0.010028668453818874
sim_compute_sim_state_max0.021736395359039307
sim_compute_sim_state_mean0.01871012493602017
sim_compute_sim_state_median0.019332822958628336
sim_compute_sim_state_min0.014480266236422354
sim_render-ego_max0.007743012110392252
sim_render-ego_mean0.007367478521246659
sim_render-ego_median0.007363209327061971
sim_render-ego_min0.0070624493716055885
simulation-passed1
step_physics_max0.13835858106613158
step_physics_mean0.12689199732061018
step_physics_median0.12432955582936606
step_physics_min0.12085548877716064
survival_time_max14.950000000000076
survival_time_mean14.880000000000075
survival_time_min14.250000000000068
No reset possible
334606847Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg09-f5ca14bc80e2-10:27:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7396255650378107
survival_time_median14.950000000000076
deviation-center-line_median0.5239471187261395
in-drivable-lane_median5.150000000000048


other stats
agent_compute-ego_max0.027966509660085043
agent_compute-ego_mean0.02696705540096534
agent_compute-ego_median0.026867563973712386
agent_compute-ego_min0.02645925760269165
complete-iteration_max0.31405658801396685
complete-iteration_mean0.30497363619148316
complete-iteration_median0.30535285416295976
complete-iteration_min0.2795095944404602
deviation-center-line_max1.0828650893158678
deviation-center-line_mean0.5856450835963887
deviation-center-line_min0.19120975149436728
deviation-heading_max3.1817650581224837
deviation-heading_mean1.9610531855838176
deviation-heading_median2.002051999946006
deviation-heading_min1.029304161296733
driven_any_max1.93999754457649
driven_any_mean1.9187403796062437
driven_any_median1.93989687041327
driven_any_min1.760753648373821
driven_lanedir_consec_max1.4701524323495043
driven_lanedir_consec_mean0.8922148589659317
driven_lanedir_consec_min0.621168985742875
driven_lanedir_max1.5379077842418432
driven_lanedir_mean1.1102586122224771
driven_lanedir_median1.2161547210543189
driven_lanedir_min0.621168985742875
get_state_dump_max0.018760757446289064
get_state_dump_mean0.01795467316852768
get_state_dump_median0.0179458483060201
get_state_dump_min0.017366191546122234
get_ui_image_max0.05111035091035506
get_ui_image_mean0.049952305956729115
get_ui_image_median0.049888521938000696
get_ui_image_min0.04916523694992066
in-drivable-lane_max9.00000000000009
in-drivable-lane_mean5.655000000000053
in-drivable-lane_min2.3999999999999995
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.933681647602279, "get_ui_image": 0.0501970386505127, "step_physics": 0.14715912501017253, "survival_time": 14.950000000000076, "driven_lanedir": 1.4701524323495043, "get_state_dump": 0.017896047433217366, "sim_render-ego": 0.007549897034962972, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.027966509660085043, "deviation-heading": 1.7520257314640808, "complete-iteration": 0.30736531972885134, "set_robot_commands": 0.00669457753499349, "deviation-center-line": 0.45457715093255224, "driven_lanedir_consec": 1.4701524323495043, "sim_compute_sim_state": 0.02166987895965576, "sim_compute_performance-ego": 0.006334519386291504, "sim_compute_robot_state-ego": 0.011174462636311848, "sim_compute_robot_state-parked0": 0.01050841252009074}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.9399491629335532, "get_ui_image": 0.04977054834365845, "step_physics": 0.1474451994895935, "survival_time": 14.950000000000076, "driven_lanedir": 1.410824023378837, "get_state_dump": 0.017995649178822834, "sim_render-ego": 0.007395671208699544, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.02645925760269165, "deviation-heading": 2.4751620246759356, "complete-iteration": 0.30477606773376464, "set_robot_commands": 0.006622442404429118, "deviation-center-line": 0.7519697025977313, "driven_lanedir_consec": 1.410824023378837, "sim_compute_sim_state": 0.02132546265920003, "sim_compute_performance-ego": 0.006264497439066569, "sim_compute_robot_state-ego": 0.011231530507405598, "sim_compute_robot_state-parked0": 0.010057863394419352}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.939954831179272, "get_ui_image": 0.04925157149632771, "step_physics": 0.15646082321802776, "survival_time": 14.950000000000076, "driven_lanedir": 0.7630162392796875, "get_state_dump": 0.018585922718048094, "sim_render-ego": 0.007508273124694824, "in-drivable-lane": 8.750000000000092, "agent_compute-ego": 0.027119483947753903, "deviation-heading": 1.1773720859372747, "complete-iteration": 0.31255845705668134, "set_robot_commands": 0.006466384728749593, "deviation-center-line": 0.36738313770302167, "driven_lanedir_consec": 0.7630162392796875, "sim_compute_sim_state": 0.01947413365046183, "sim_compute_performance-ego": 0.006243765354156494, "sim_compute_robot_state-ego": 0.011355389753977456, "sim_compute_robot_state-parked0": 0.009885603586832685}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.9398709378998225, "get_ui_image": 0.049968183040618896, "step_physics": 0.15906432469685872, "survival_time": 14.950000000000076, "driven_lanedir": 1.5379077842418432, "get_state_dump": 0.018760757446289064, "sim_render-ego": 0.007478097279866537, "in-drivable-lane": 2.3999999999999995, "agent_compute-ego": 0.02658062775929769, "deviation-heading": 3.1817650581224837, "complete-iteration": 0.31405658801396685, "set_robot_commands": 0.006333478291829427, "deviation-center-line": 0.682710400127366, "driven_lanedir_consec": 0.7481626348491397, "sim_compute_sim_state": 0.0180437437693278, "sim_compute_performance-ego": 0.006315927505493164, "sim_compute_robot_state-ego": 0.011359991232554118, "sim_compute_robot_state-parked0": 0.009939640363057455}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.9134314893164663, "get_ui_image": 0.04987012248928264, "step_physics": 0.15346186848010046, "survival_time": 14.750000000000076, "driven_lanedir": 0.6593779517523723, "get_state_dump": 0.01847262301687467, "sim_render-ego": 0.007423769417455641, "in-drivable-lane": 8.150000000000091, "agent_compute-ego": 0.026789313655788616, "deviation-heading": 2.6883377726485245, "complete-iteration": 0.30523140794139797, "set_robot_commands": 0.0064986123877056575, "deviation-center-line": 0.2572562647102928, "driven_lanedir_consec": 0.6455466856440142, "sim_compute_sim_state": 0.014755565837278203, "sim_compute_performance-ego": 0.006300235198715986, "sim_compute_robot_state-ego": 0.01133730775218899, "sim_compute_robot_state-parked0": 0.010110971483133608}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.760753648373821, "get_ui_image": 0.05111035091035506, "step_physics": 0.15157494124244242, "survival_time": 13.600000000000058, "driven_lanedir": 0.621168985742875, "get_state_dump": 0.018080468563472524, "sim_render-ego": 0.007332873695036944, "in-drivable-lane": 8.350000000000069, "agent_compute-ego": 0.02673053215531742, "deviation-heading": 1.029304161296733, "complete-iteration": 0.3024468842674704, "set_robot_commands": 0.00617053491227767, "deviation-center-line": 0.19120975149436728, "driven_lanedir_consec": 0.621168985742875, "sim_compute_sim_state": 0.01427090255653157, "sim_compute_performance-ego": 0.006164934705285465, "sim_compute_robot_state-ego": 0.010981198619393742, "sim_compute_robot_state-parked0": 0.009821974179323982}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.939970793354193, "get_ui_image": 0.04916523694992066, "step_physics": 0.15945340474446615, "survival_time": 14.950000000000076, "driven_lanedir": 0.7310884952264818, "get_state_dump": 0.01752473513285319, "sim_render-ego": 0.007440970738728841, "in-drivable-lane": 9.00000000000009, "agent_compute-ego": 0.02724136193593343, "deviation-heading": 1.050968334476473, "complete-iteration": 0.3139846173922221, "set_robot_commands": 0.006374459266662597, "deviation-center-line": 0.4032908063661165, "driven_lanedir_consec": 0.7310884952264818, "sim_compute_sim_state": 0.019180936018625895, "sim_compute_performance-ego": 0.0061812241872151695, "sim_compute_robot_state-ego": 0.011152675151824953, "sim_compute_robot_state-parked0": 0.010059519608815511}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.93999754457649, "get_ui_image": 0.04967633326848348, "step_physics": 0.1517366115252177, "survival_time": 14.950000000000076, "driven_lanedir": 1.2097506871027774, "get_state_dump": 0.017397061983744303, "sim_render-ego": 0.007181211312611898, "in-drivable-lane": 5.400000000000077, "agent_compute-ego": 0.0267021902402242, "deviation-heading": 1.1408634938253055, "complete-iteration": 0.3054743003845215, "set_robot_commands": 0.006360849539438883, "deviation-center-line": 0.5933170865197269, "driven_lanedir_consec": 1.2097506871027774, "sim_compute_sim_state": 0.019373315970102944, "sim_compute_performance-ego": 0.005992124875386556, "sim_compute_robot_state-ego": 0.011002710660298664, "sim_compute_robot_state-parked0": 0.009846598307291666}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.9399087685621417, "get_ui_image": 0.05060675303141276, "step_physics": 0.1517571798960368, "survival_time": 14.950000000000076, "driven_lanedir": 1.22255875500586, "get_state_dump": 0.01746727466583252, "sim_render-ego": 0.007232287724812826, "in-drivable-lane": 4.900000000000021, "agent_compute-ego": 0.026945814291636148, "deviation-heading": 2.2520782684279297, "complete-iteration": 0.3043331249554952, "set_robot_commands": 0.00647236426671346, "deviation-center-line": 1.0828650893158678, "driven_lanedir_consec": 0.6412246656067642, "sim_compute_sim_state": 0.016615243752797444, "sim_compute_performance-ego": 0.006119991143544515, "sim_compute_robot_state-ego": 0.011079182624816894, "sim_compute_robot_state-parked0": 0.009826968510945638}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.9398849722643985, "get_ui_image": 0.04990692138671875, "step_physics": 0.12463056008021035, "survival_time": 14.950000000000076, "driven_lanedir": 1.4767407681445328, "get_state_dump": 0.017366191546122234, "sim_render-ego": 0.007481950124104818, "in-drivable-lane": 2.8999999999999986, "agent_compute-ego": 0.027135462760925298, "deviation-heading": 2.862654924963439, "complete-iteration": 0.2795095944404602, "set_robot_commands": 0.007193640073140462, "deviation-center-line": 1.0718714461968446, "driven_lanedir_consec": 0.6812137404792353, "sim_compute_sim_state": 0.017221771081288657, "sim_compute_performance-ego": 0.0063944578170776365, "sim_compute_robot_state-ego": 0.011193103790283205, "sim_compute_robot_state-parked0": 0.010768058300018313}}
set_robot_commands_max0.007193640073140462
set_robot_commands_mean0.006518734340594036
set_robot_commands_median0.006469374497731526
set_robot_commands_min0.00617053491227767
sim_compute_performance-ego_max0.0063944578170776365
sim_compute_performance-ego_mean0.006231167761223306
sim_compute_performance-ego_median0.006254131396611531
sim_compute_performance-ego_min0.005992124875386556
sim_compute_robot_state-ego_max0.011359991232554118
sim_compute_robot_state-ego_mean0.011186755272905548
sim_compute_robot_state-ego_median0.011183783213297525
sim_compute_robot_state-ego_min0.010981198619393742
sim_compute_robot_state-parked0_max0.010768058300018313
sim_compute_robot_state-parked0_mean0.010082561025392896
sim_compute_robot_state-parked0_median0.009998751878738403
sim_compute_robot_state-parked0_min0.009821974179323982
sim_compute_sim_state_max0.02166987895965576
sim_compute_sim_state_mean0.018193095425527016
sim_compute_sim_state_median0.01861233989397685
sim_compute_sim_state_min0.01427090255653157
sim_render-ego_max0.007549897034962972
sim_render-ego_mean0.007402500166097484
sim_render-ego_median0.007432370078092241
sim_render-ego_min0.007181211312611898
simulation-passed1
step_physics_max0.15945340474446615
step_physics_mean0.15027440383831264
step_physics_median0.15174689571062724
step_physics_min0.12463056008021035
survival_time_max14.950000000000076
survival_time_mean14.795000000000076
survival_time_min13.600000000000058
No reset possible