Duckietown Challenges Home Challenges Submissions

Evaluator 1888

ID1888
evaluatorreg08-0c12c4a883f4-1
ownerI don't have one 😀
machinearchimede
processreg08-0c12c4a883f4-1
versiond-c:6.1.5;d-c-r:6.0.29
first heard
last heard
statusinactive
# evaluating
# success5 33463
# timeout
# failed
# error17 33479
# aborted
# host-error1 33660
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
336609007Bea Baselines 🐤baseline-duckietownaido5-LF-sim-validationLFv-simhost-errornoreg08-0c12c4a883f4-10:07:08
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 673, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 1402, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner.py", line 1650, in upload
    copy_to_cache(realfile, sha256hex)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.29-py3.8.egg/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 272, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 163, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 149, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9007/LFv-sim-reg08-0c12c4a883f4-1-job33660/docker-compose.original.yaml' -> '/tmp/duckietown/DT18/evaluator/cache/by-value/sha256hex/ea043265d53ab78e09c842b5992eadd0bef78a3123ccec786b95a58cc7b02a45'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336538955Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:00:59
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336276840Daniil Lisusexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg08-0c12c4a883f4-10:15:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5366741860328554
survival_time_median5.249999999999989
deviation-center-line_median0.3044473804175064
in-drivable-lane_median1.5499999999999945


other stats
agent_compute-ego_max0.050105820683872
agent_compute-ego_mean0.03317734689755866
agent_compute-ego_median0.02526094357172648
agent_compute-ego_min0.02330978952272974
complete-iteration_max0.3211181844983782
complete-iteration_mean0.3003910337783051
complete-iteration_median0.29337600859728724
complete-iteration_min0.28463699600913306
deviation-center-line_max0.6869559943152134
deviation-center-line_mean0.3733315274841106
deviation-center-line_min0.24616927148137
deviation-heading_max0.946964265510139
deviation-heading_mean0.7744878557401882
deviation-heading_median0.772012620442649
deviation-heading_min0.6245558757414794
driven_any_max2.0421046117142105
driven_any_mean1.0484275819036872
driven_any_median0.6864089378987714
driven_any_min0.42784875112504733
driven_lanedir_consec_max0.9397573843831812
driven_lanedir_consec_mean0.5615511340025507
driven_lanedir_consec_min0.28893466733421347
driven_lanedir_max0.9397573843831812
driven_lanedir_mean0.5615511340025507
driven_lanedir_median0.5366741860328554
driven_lanedir_min0.28893466733421347
get_state_dump_max0.01651946586721084
get_state_dump_mean0.01491832914503575
get_state_dump_median0.014683586331040646
get_state_dump_min0.01445124125239825
get_ui_image_max0.061635982195536294
get_ui_image_mean0.05930112098050042
get_ui_image_median0.05958841722243562
get_ui_image_min0.053660178885740394
in-drivable-lane_max10.150000000000087
in-drivable-lane_mean3.395000000000022
in-drivable-lane_min0.8999999999999968
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.4414646389762482, "get_ui_image": 0.05957762771677748, "step_physics": 0.13435165904392707, "survival_time": 10.700000000000015, "driven_lanedir": 0.9397573843831812, "get_state_dump": 0.015171772965760989, "sim_render-ego": 0.006252862582696933, "in-drivable-lane": 3.5500000000000345, "agent_compute-ego": 0.02502018491798472, "deviation-heading": 0.7747214366547285, "complete-iteration": 0.29124604652975206, "set_robot_commands": 0.006160652526071139, "deviation-center-line": 0.6869559943152134, "driven_lanedir_consec": 0.9397573843831812, "sim_compute_sim_state": 0.02079065157988361, "sim_compute_performance-ego": 0.005301368570773401, "sim_compute_robot_state-ego": 0.009256911054949897, "sim_compute_robot_state-parked0": 0.009196598953175768}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.441126550084641, "get_ui_image": 0.058874196289850515, "step_physics": 0.13614310680980413, "survival_time": 10.650000000000016, "driven_lanedir": 0.9394217616470544, "get_state_dump": 0.014766021513603103, "sim_render-ego": 0.006196371266539668, "in-drivable-lane": 3.5500000000000336, "agent_compute-ego": 0.024459809764450145, "deviation-heading": 0.7693038042305695, "complete-iteration": 0.2905567755721544, "set_robot_commands": 0.005854341345773616, "deviation-center-line": 0.6858364881924462, "driven_lanedir_consec": 0.9394217616470544, "sim_compute_sim_state": 0.02084759255530129, "sim_compute_performance-ego": 0.005241813793988295, "sim_compute_robot_state-ego": 0.009018885697557332, "sim_compute_robot_state-parked0": 0.008994866984550941}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.6444808610745287, "get_ui_image": 0.05941828332766138, "step_physics": 0.1315309784629128, "survival_time": 4.94999999999999, "driven_lanedir": 0.4146278967393662, "get_state_dump": 0.015378383675006903, "sim_render-ego": 0.006200217237376204, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.023807896508110896, "deviation-heading": 0.8473509256010923, "complete-iteration": 0.28463699600913306, "set_robot_commands": 0.0060562581726999, "deviation-center-line": 0.3044473804175064, "driven_lanedir_consec": 0.4146278967393662, "sim_compute_sim_state": 0.018195662835631708, "sim_compute_performance-ego": 0.005212559844508316, "sim_compute_robot_state-ego": 0.009391134435480291, "sim_compute_robot_state-parked0": 0.009273362882209549}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.6444808610745287, "get_ui_image": 0.06011735068427192, "step_physics": 0.14424163885790892, "survival_time": 4.94999999999999, "driven_lanedir": 0.4146278967393662, "get_state_dump": 0.01445124125239825, "sim_render-ego": 0.005807238395767983, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.02330978952272974, "deviation-heading": 0.8473509256010923, "complete-iteration": 0.29445591117396497, "set_robot_commands": 0.00575066576100359, "deviation-center-line": 0.3044473804175064, "driven_lanedir_consec": 0.4146278967393662, "sim_compute_sim_state": 0.018290669027000966, "sim_compute_performance-ego": 0.004883944386183613, "sim_compute_robot_state-ego": 0.008636344562877308, "sim_compute_robot_state-parked0": 0.008807916833896829}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.0421046117142105, "get_ui_image": 0.05885517517725627, "step_physics": 0.13751943985621137, "survival_time": 14.950000000000076, "driven_lanedir": 0.6047065778804177, "get_state_dump": 0.014769209225972494, "sim_render-ego": 0.006222391923268636, "in-drivable-lane": 10.150000000000087, "agent_compute-ego": 0.025287142594655355, "deviation-heading": 0.9376822172594184, "complete-iteration": 0.2863426041603088, "set_robot_commands": 0.005840174357096354, "deviation-center-line": 0.2713427764788975, "driven_lanedir_consec": 0.6047065778804177, "sim_compute_sim_state": 0.013833303451538086, "sim_compute_performance-ego": 0.00503142515818278, "sim_compute_robot_state-ego": 0.01003131628036499, "sim_compute_robot_state-parked0": 0.008786887327829996}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.0421029180650776, "get_ui_image": 0.061635982195536294, "step_physics": 0.14112979332606, "survival_time": 14.950000000000076, "driven_lanedir": 0.6511521159019842, "get_state_dump": 0.014478617509206137, "sim_render-ego": 0.006184495290120442, "in-drivable-lane": 9.800000000000088, "agent_compute-ego": 0.025234744548797608, "deviation-heading": 0.946964265510139, "complete-iteration": 0.2922961060206095, "set_robot_commands": 0.0057656462987264, "deviation-center-line": 0.2708815036187307, "driven_lanedir_consec": 0.6511521159019842, "sim_compute_sim_state": 0.014754817485809328, "sim_compute_performance-ego": 0.005107653141021728, "sim_compute_robot_state-ego": 0.008856321175893148, "sim_compute_robot_state-parked0": 0.008988307317097982}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 0.6864089378987714, "get_ui_image": 0.06133987335931687, "step_physics": 0.15280241512116932, "survival_time": 5.249999999999989, "driven_lanedir": 0.5366741860328554, "get_state_dump": 0.014549219040643602, "sim_render-ego": 0.005858748299734933, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.0399809133438837, "deviation-heading": 0.6245558757414794, "complete-iteration": 0.3211181844983782, "set_robot_commands": 0.005477630524408249, "deviation-center-line": 0.35853260421903244, "driven_lanedir_consec": 0.5366741860328554, "sim_compute_sim_state": 0.017818444115774972, "sim_compute_performance-ego": 0.005030656996227446, "sim_compute_robot_state-ego": 0.00930815197172619, "sim_compute_robot_state-parked0": 0.0087898436046782}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 0.6864089378987714, "get_ui_image": 0.05993333544049944, "step_physics": 0.14354769388834634, "survival_time": 5.249999999999989, "driven_lanedir": 0.5366741860328554, "get_state_dump": 0.01460115114847819, "sim_render-ego": 0.006054826009841192, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.0479035286676316, "deviation-heading": 0.6245558757414794, "complete-iteration": 0.3184549876621791, "set_robot_commands": 0.00555782091049921, "deviation-center-line": 0.35853260421903244, "driven_lanedir_consec": 0.5366741860328554, "sim_compute_sim_state": 0.01765041805448986, "sim_compute_performance-ego": 0.004934651511056083, "sim_compute_robot_state-ego": 0.00923789342244466, "sim_compute_robot_state-parked0": 0.008865928649902344}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.42784875112504733, "get_ui_image": 0.053660178885740394, "step_physics": 0.138690149082857, "survival_time": 3.399999999999996, "driven_lanedir": 0.28893466733421347, "get_state_dump": 0.01651946586721084, "sim_render-ego": 0.006623734446132884, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.050105820683872, "deviation-heading": 0.6861966155309414, "complete-iteration": 0.31362233442418713, "set_robot_commands": 0.006223345504087561, "deviation-center-line": 0.24616927148137, "driven_lanedir_consec": 0.28893466733421347, "sim_compute_sim_state": 0.016299265272477093, "sim_compute_performance-ego": 0.005728115053737865, "sim_compute_robot_state-ego": 0.00997628183925853, "sim_compute_robot_state-parked0": 0.009596540647394515}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.42784875112504733, "get_ui_image": 0.05959920672809377, "step_physics": 0.14175848399891572, "survival_time": 3.399999999999996, "driven_lanedir": 0.28893466733421347, "get_state_dump": 0.014498209252076993, "sim_render-ego": 0.005753685446346507, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.04666363842347089, "deviation-heading": 0.6861966155309414, "complete-iteration": 0.31118039173238415, "set_robot_commands": 0.0056312434813555546, "deviation-center-line": 0.24616927148137, "driven_lanedir_consec": 0.28893466733421347, "sim_compute_sim_state": 0.014302926905014937, "sim_compute_performance-ego": 0.005120687624987434, "sim_compute_robot_state-ego": 0.008774098228005803, "sim_compute_robot_state-parked0": 0.008762219372917624}}
set_robot_commands_max0.006223345504087561
set_robot_commands_mean0.005831777888172157
set_robot_commands_median0.0058029103279113765
set_robot_commands_min0.005477630524408249
sim_compute_performance-ego_max0.005728115053737865
sim_compute_performance-ego_mean0.005159287608066697
sim_compute_performance-ego_median0.005114170383004581
sim_compute_performance-ego_min0.004883944386183613
sim_compute_robot_state-ego_max0.01003131628036499
sim_compute_robot_state-ego_mean0.009248733866855817
sim_compute_robot_state-ego_median0.00924740223869728
sim_compute_robot_state-ego_min0.008636344562877308
sim_compute_robot_state-parked0_max0.009596540647394515
sim_compute_robot_state-parked0_mean0.009006247257365374
sim_compute_robot_state-parked0_median0.008927117983500163
sim_compute_robot_state-parked0_min0.008762219372917624
sim_compute_sim_state_max0.02084759255530129
sim_compute_sim_state_mean0.017278375128292188
sim_compute_sim_state_median0.017734431085132417
sim_compute_sim_state_min0.013833303451538086
sim_render-ego_max0.006623734446132884
sim_render-ego_mean0.0061154570897825385
sim_render-ego_median0.006190433278330056
sim_render-ego_min0.005753685446346507
simulation-passed1
step_physics_max0.15280241512116932
step_physics_mean0.14017153584481123
step_physics_median0.1399099712044585
step_physics_min0.1315309784629128
survival_time_max14.950000000000076
survival_time_mean7.845000000000013
survival_time_min3.399999999999996
No reset possible
336198627Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:01:10
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336168571Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:01:20
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336148579Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:01:01
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
336118531Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:01:02
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335788127Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simsuccessnoreg08-0c12c4a883f4-10:18:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6430501145491379
survival_time_median10.90000000000002
deviation-center-line_median0.3525330450206732
in-drivable-lane_median2.225000000000011


other stats
agent_compute-ego_max0.024074729283650717
agent_compute-ego_mean0.022796193081456497
agent_compute-ego_median0.022699575821558633
agent_compute-ego_min0.02181112766265869
complete-iteration_max0.3004433894425296
complete-iteration_mean0.2894845925730244
complete-iteration_median0.28836787922709595
complete-iteration_min0.2797145220366391
deviation-center-line_max0.9632944711251068
deviation-center-line_mean0.4630340322034023
deviation-center-line_min0.14192664544797587
deviation-heading_max2.098533601853976
deviation-heading_mean0.9754792675440108
deviation-heading_median0.7342551245090743
deviation-heading_min0.585297346117501
driven_any_max2.420991347968776
driven_any_mean1.6207752930494792
driven_any_median1.7473878924063322
driven_any_min0.6646238014128742
driven_lanedir_consec_max2.0163429659604093
driven_lanedir_consec_mean0.9238482055775374
driven_lanedir_consec_min0.4265885495638271
driven_lanedir_max2.0163429659604093
driven_lanedir_mean0.9238482055775374
driven_lanedir_median0.6430501145491379
driven_lanedir_min0.4265885495638271
get_state_dump_max0.01778704073370957
get_state_dump_mean0.016657855941195725
get_state_dump_median0.01640467334880942
get_state_dump_min0.015700340270996094
get_ui_image_max0.056605165654962715
get_ui_image_mean0.05370746103576115
get_ui_image_median0.054013886331172475
get_ui_image_min0.051077402219539735
in-drivable-lane_max10.500000000000083
in-drivable-lane_mean4.055000000000026
in-drivable-lane_min1.3499999999999952
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.2994563656887796, "get_ui_image": 0.051077402219539735, "step_physics": 0.1285194492921597, "survival_time": 8.199999999999982, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.01778704073370957, "sim_render-ego": 0.0074052694367199405, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.023634065942066473, "deviation-heading": 0.656882474004175, "complete-iteration": 0.2860717409994544, "set_robot_commands": 0.006882309913635254, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.021833339842354377, "sim_compute_performance-ego": 0.006309124027810446, "sim_compute_robot_state-ego": 0.011297397497223643, "sim_compute_robot_state-parked0": 0.011108815670013428}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.1953194191238845, "get_ui_image": 0.05131295761641334, "step_physics": 0.12498593242729412, "survival_time": 13.600000000000058, "driven_lanedir": 1.1856250938826185, "get_state_dump": 0.017189103890867793, "sim_render-ego": 0.007301247295211344, "in-drivable-lane": 6.050000000000077, "agent_compute-ego": 0.023796141147613525, "deviation-heading": 0.6506184484994173, "complete-iteration": 0.28224052488803864, "set_robot_commands": 0.006877945626483244, "deviation-center-line": 0.7153797678025385, "driven_lanedir_consec": 1.1856250938826185, "sim_compute_sim_state": 0.02222983100835015, "sim_compute_performance-ego": 0.006280799998956568, "sim_compute_robot_state-ego": 0.011168828781913309, "sim_compute_robot_state-parked0": 0.010879226467188668}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.7783468901478676, "get_ui_image": 0.05629920725728951, "step_physics": 0.13428641300575406, "survival_time": 5.09999999999999, "driven_lanedir": 0.4870179525099734, "get_state_dump": 0.016361671335556927, "sim_render-ego": 0.006766337974398744, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.022231008492264098, "deviation-heading": 0.7371537164253312, "complete-iteration": 0.28762397812862023, "set_robot_commands": 0.006305916636597877, "deviation-center-line": 0.31383033576316843, "driven_lanedir_consec": 0.4870179525099734, "sim_compute_sim_state": 0.018778609294517367, "sim_compute_performance-ego": 0.005898251253015855, "sim_compute_robot_state-ego": 0.010435744827868892, "sim_compute_robot_state-parked0": 0.010056023504219804}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.678601870577068, "get_ui_image": 0.054301216361228, "step_physics": 0.1486721976419513, "survival_time": 4.449999999999992, "driven_lanedir": 0.4265885495638271, "get_state_dump": 0.016447675362061917, "sim_render-ego": 0.0071090205331866664, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.022014545590690018, "deviation-heading": 0.7313565325928172, "complete-iteration": 0.3004433894425296, "set_robot_commands": 0.006369162141607048, "deviation-center-line": 0.2683902859812928, "driven_lanedir_consec": 0.4265885495638271, "sim_compute_sim_state": 0.018785878513636212, "sim_compute_performance-ego": 0.00584546099887805, "sim_compute_robot_state-ego": 0.010308729128891162, "sim_compute_robot_state-parked0": 0.010381862018885238}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.420991347968776, "get_ui_image": 0.054506079355875654, "step_physics": 0.13663264036178588, "survival_time": 14.950000000000076, "driven_lanedir": 0.6446180995854834, "get_state_dump": 0.01769321839014689, "sim_render-ego": 0.007233634789784749, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.024074729283650717, "deviation-heading": 0.8468082391327437, "complete-iteration": 0.2891117803255717, "set_robot_commands": 0.0065484126408894856, "deviation-center-line": 0.14192664544797587, "driven_lanedir_consec": 0.6446180995854834, "sim_compute_sim_state": 0.015320719877878823, "sim_compute_performance-ego": 0.005981527964274089, "sim_compute_robot_state-ego": 0.010601246356964113, "sim_compute_robot_state-parked0": 0.01031112829844157}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.4072325102045298, "get_ui_image": 0.053726556301116946, "step_physics": 0.1390138856569926, "survival_time": 14.950000000000076, "driven_lanedir": 0.6414821295127923, "get_state_dump": 0.01611677328745524, "sim_render-ego": 0.0068815461794535316, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.022911940415700275, "deviation-heading": 0.8474318367616545, "complete-iteration": 0.28507004896799726, "set_robot_commands": 0.006470007101694743, "deviation-center-line": 0.14728565348872835, "driven_lanedir_consec": 0.6414821295127923, "sim_compute_sim_state": 0.014334526856740316, "sim_compute_performance-ego": 0.005590362548828125, "sim_compute_robot_state-ego": 0.00992916504542033, "sim_compute_robot_state-parked0": 0.009897143840789794}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.411956006437587, "get_ui_image": 0.05244992017745972, "step_physics": 0.14527663071950278, "survival_time": 14.950000000000076, "driven_lanedir": 2.0163429659604093, "get_state_dump": 0.016047765413920084, "sim_render-ego": 0.007059057553609212, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.02248721122741699, "deviation-heading": 2.098533601853976, "complete-iteration": 0.29580715894699094, "set_robot_commands": 0.0064140113194783525, "deviation-center-line": 0.8309439677931447, "driven_lanedir_consec": 2.0163429659604093, "sim_compute_sim_state": 0.020231870810190837, "sim_compute_performance-ego": 0.005661230087280273, "sim_compute_robot_state-ego": 0.0100885009765625, "sim_compute_robot_state-parked0": 0.00989302396774292}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.410019798332097, "get_ui_image": 0.052251645723978675, "step_physics": 0.14153059800465903, "survival_time": 14.950000000000076, "driven_lanedir": 2.008955624758421, "get_state_dump": 0.01708914041519165, "sim_render-ego": 0.006996189753214518, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.023149329821268716, "deviation-heading": 2.0093607750461997, "complete-iteration": 0.29491865158081054, "set_robot_commands": 0.0064942653973897296, "deviation-center-line": 0.9632944711251068, "driven_lanedir_consec": 2.008955624758421, "sim_compute_sim_state": 0.020661974747975667, "sim_compute_performance-ego": 0.005973169803619385, "sim_compute_robot_state-ego": 0.010501391887664796, "sim_compute_robot_state-parked0": 0.01006582498550415}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.6646238014128742, "get_ui_image": 0.0545444596897472, "step_physics": 0.13330527327277444, "survival_time": 4.399999999999992, "driven_lanedir": 0.4333735891477426, "get_state_dump": 0.015700340270996094, "sim_render-ego": 0.006608003919774836, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.02181112766265869, "deviation-heading": 0.5913497050062915, "complete-iteration": 0.2797145220366391, "set_robot_commands": 0.006231028925288807, "deviation-center-line": 0.31869876800675323, "driven_lanedir_consec": 0.4333735891477426, "sim_compute_sim_state": 0.016046090559525925, "sim_compute_performance-ego": 0.005529344081878662, "sim_compute_robot_state-ego": 0.009808724576776678, "sim_compute_robot_state-parked0": 0.009933458133177324}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.9412049206013268, "get_ui_image": 0.056605165654962715, "step_physics": 0.14289094002778863, "survival_time": 6.0499999999999865, "driven_lanedir": 0.5069617153220096, "get_state_dump": 0.016145830312051065, "sim_render-ego": 0.006912369373416112, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.02185183123123547, "deviation-heading": 0.585297346117501, "complete-iteration": 0.29384413041359136, "set_robot_commands": 0.006334188555882982, "deviation-center-line": 0.3863673220345931, "driven_lanedir_consec": 0.5069617153220096, "sim_compute_sim_state": 0.017434967450859134, "sim_compute_performance-ego": 0.005549263363042153, "sim_compute_robot_state-ego": 0.010094717514416403, "sim_compute_robot_state-parked0": 0.0098204671843978}}
set_robot_commands_max0.006882309913635254
set_robot_commands_mean0.006492724825894752
set_robot_commands_median0.006442009210586548
set_robot_commands_min0.006231028925288807
sim_compute_performance-ego_max0.006309124027810446
sim_compute_performance-ego_mean0.005861853412758361
sim_compute_performance-ego_median0.0058718561259469525
sim_compute_performance-ego_min0.005529344081878662
sim_compute_robot_state-ego_max0.011297397497223643
sim_compute_robot_state-ego_mean0.010423444659370182
sim_compute_robot_state-ego_median0.010372236978380026
sim_compute_robot_state-ego_min0.009808724576776678
sim_compute_robot_state-parked0_max0.011108815670013428
sim_compute_robot_state-parked0_mean0.010234697407036067
sim_compute_robot_state-parked0_median0.010060924244861977
sim_compute_robot_state-parked0_min0.0098204671843978
sim_compute_sim_state_max0.02222983100835015
sim_compute_sim_state_mean0.01856578089620288
sim_compute_sim_state_median0.01878224390407679
sim_compute_sim_state_min0.014334526856740316
sim_render-ego_max0.0074052694367199405
sim_render-ego_mean0.007027267680876967
sim_render-ego_median0.007027623653411865
sim_render-ego_min0.006608003919774836
simulation-passed1
step_physics_max0.1486721976419513
step_physics_mean0.13751139604106624
step_physics_median0.13782326300938924
step_physics_min0.12498593242729412
survival_time_max14.950000000000076
survival_time_mean10.16000000000003
survival_time_min4.399999999999992
No reset possible
335758147Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:01:11
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335728131Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:00:59
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335698079Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simerrornoreg08-0c12c4a883f4-10:00:45
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335567919Bea Baselines 🐤template-tensorflowaido5-LF-sim-validationLFv-simsuccessnoreg08-0c12c4a883f4-10:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.34358148799532495
survival_time_median1.5000000000000009
deviation-center-line_median0.0738721782441113
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.029097378253936768
agent_compute-ego_mean0.026665109667149217
agent_compute-ego_median0.026324442454746792
agent_compute-ego_min0.02420940569468907
complete-iteration_max0.3118027448654175
complete-iteration_mean0.28383582151842207
complete-iteration_median0.28030061579885934
complete-iteration_min0.26674778802054266
deviation-center-line_max0.1911993797844865
deviation-center-line_mean0.10259265564404332
deviation-center-line_min0.06712610445639677
deviation-heading_max1.891614500864065
deviation-heading_mean0.5761918323793362
deviation-heading_median0.26884758890396276
deviation-heading_min0.18398192734307303
driven_any_max6.504104425582215
driven_any_mean1.7430324812537736
driven_any_median0.5763439846503241
driven_any_min0.41369019702748255
driven_lanedir_consec_max0.42815490675335166
driven_lanedir_consec_mean0.35684870262171964
driven_lanedir_consec_min0.2819036062922664
driven_lanedir_max0.42815490675335166
driven_lanedir_mean0.35684870262171964
driven_lanedir_median0.34358148799532495
driven_lanedir_min0.2819036062922664
get_state_dump_max0.01899968832731247
get_state_dump_mean0.017278387023743257
get_state_dump_median0.017283843419490717
get_state_dump_min0.015659302473068237
get_ui_image_max0.053231000900268555
get_ui_image_mean0.050548837767961693
get_ui_image_median0.05084028659722744
get_ui_image_min0.048220135271549225
in-drivable-lane_max12.70000000000007
in-drivable-lane_mean2.8650000000000144
in-drivable-lane_min0.2500000000000001
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 0.6229757344591812, "get_ui_image": 0.048220135271549225, "step_physics": 0.12375911325216292, "survival_time": 1.6000000000000008, "driven_lanedir": 0.35802829580409257, "get_state_dump": 0.01899968832731247, "sim_render-ego": 0.008082970976829529, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.028146743774414062, "deviation-heading": 0.2643031818147866, "complete-iteration": 0.28464483469724655, "set_robot_commands": 0.006951756775379181, "deviation-center-line": 0.07600540254443897, "driven_lanedir_consec": 0.35802829580409257, "sim_compute_sim_state": 0.020903415977954865, "sim_compute_performance-ego": 0.00653114914894104, "sim_compute_robot_state-ego": 0.011273428797721865, "sim_compute_robot_state-parked0": 0.011541567742824554}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.4681553785553464, "get_ui_image": 0.05086146868192232, "step_physics": 0.1185774986560528, "survival_time": 1.3000000000000005, "driven_lanedir": 0.32913468018655734, "get_state_dump": 0.017290986501253568, "sim_render-ego": 0.007277800486637996, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.025673095996563252, "deviation-heading": 0.2733919959931389, "complete-iteration": 0.27229615358205944, "set_robot_commands": 0.006639948258033166, "deviation-center-line": 0.07085848443084042, "driven_lanedir_consec": 0.32913468018655734, "sim_compute_sim_state": 0.01983017187852126, "sim_compute_performance-ego": 0.005751747351426344, "sim_compute_robot_state-ego": 0.00991514095893273, "sim_compute_robot_state-parked0": 0.010251962221585788}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.529712234841467, "get_ui_image": 0.0498357926096235, "step_physics": 0.12927610533578054, "survival_time": 1.4000000000000006, "driven_lanedir": 0.31755451740259844, "get_state_dump": 0.01747981139591762, "sim_render-ego": 0.006899586745670864, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.02420940569468907, "deviation-heading": 0.3011466445961558, "complete-iteration": 0.2807893923350743, "set_robot_commands": 0.006396915231432233, "deviation-center-line": 0.06712610445639677, "driven_lanedir_consec": 0.31755451740259844, "sim_compute_sim_state": 0.020070791244506836, "sim_compute_performance-ego": 0.005965914045061384, "sim_compute_robot_state-ego": 0.01007366180419922, "sim_compute_robot_state-parked0": 0.010355489594595773}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.529712234841467, "get_ui_image": 0.05158613409314837, "step_physics": 0.12812949929918563, "survival_time": 1.4000000000000006, "driven_lanedir": 0.31755451740259844, "get_state_dump": 0.017146944999694824, "sim_render-ego": 0.006829338414328439, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.025381880147116526, "deviation-heading": 0.3011466445961558, "complete-iteration": 0.2794629420552935, "set_robot_commands": 0.007027498313358852, "deviation-center-line": 0.06712610445639677, "driven_lanedir_consec": 0.31755451740259844, "sim_compute_sim_state": 0.017601898738316128, "sim_compute_performance-ego": 0.005841544696262905, "sim_compute_robot_state-ego": 0.009584341730390276, "sim_compute_robot_state-parked0": 0.010112455912998744}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 6.504104425582215, "get_ui_image": 0.05118229786554973, "step_physics": 0.13485788742701213, "survival_time": 14.950000000000076, "driven_lanedir": 0.42815490675335166, "get_state_dump": 0.017276700337727866, "sim_render-ego": 0.007427230676015218, "in-drivable-lane": 12.70000000000007, "agent_compute-ego": 0.028219177722930908, "deviation-heading": 1.891614500864065, "complete-iteration": 0.29173909187316893, "set_robot_commands": 0.006796674728393555, "deviation-center-line": 0.1911993797844865, "driven_lanedir_consec": 0.42815490675335166, "sim_compute_sim_state": 0.01807309071222941, "sim_compute_performance-ego": 0.0062520178159077965, "sim_compute_robot_state-ego": 0.01079883893330892, "sim_compute_robot_state-parked0": 0.010622918605804443}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 6.504104425582215, "get_ui_image": 0.050819104512532555, "step_physics": 0.13721556266148885, "survival_time": 14.950000000000076, "driven_lanedir": 0.42815490675335166, "get_state_dump": 0.017092690467834473, "sim_render-ego": 0.007228505611419677, "in-drivable-lane": 12.70000000000007, "agent_compute-ego": 0.02757105032602946, "deviation-heading": 1.891614500864065, "complete-iteration": 0.29225943962732953, "set_robot_commands": 0.006662312348683675, "deviation-center-line": 0.1911993797844865, "driven_lanedir_consec": 0.42815490675335166, "sim_compute_sim_state": 0.017537723382314047, "sim_compute_performance-ego": 0.006046448548634847, "sim_compute_robot_state-ego": 0.010771509011586506, "sim_compute_robot_state-parked0": 0.011091954708099363}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 0.41369019702748255, "get_ui_image": 0.053231000900268555, "step_physics": 0.15503198901812237, "survival_time": 1.2000000000000004, "driven_lanedir": 0.2819036062922664, "get_state_dump": 0.015659302473068237, "sim_render-ego": 0.006551613410313924, "in-drivable-lane": 0.2500000000000001, "agent_compute-ego": 0.029097378253936768, "deviation-heading": 0.18398192734307303, "complete-iteration": 0.3118027448654175, "set_robot_commands": 0.006200482447942098, "deviation-center-line": 0.07173895394378364, "driven_lanedir_consec": 0.2819036062922664, "sim_compute_sim_state": 0.02091933290163676, "sim_compute_performance-ego": 0.005647430817286174, "sim_compute_robot_state-ego": 0.00970946749051412, "sim_compute_robot_state-parked0": 0.009538501501083374}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 0.41369019702748255, "get_ui_image": 0.04841432968775431, "step_physics": 0.13122150301933289, "survival_time": 1.2000000000000004, "driven_lanedir": 0.2819036062922664, "get_state_dump": 0.016862571239471436, "sim_render-ego": 0.007226039965947469, "in-drivable-lane": 0.2500000000000001, "agent_compute-ego": 0.02570347984631856, "deviation-heading": 0.18398192734307303, "complete-iteration": 0.27981183926264447, "set_robot_commands": 0.0061208705107371015, "deviation-center-line": 0.07173895394378364, "driven_lanedir_consec": 0.2819036062922664, "sim_compute_sim_state": 0.01844056447347005, "sim_compute_performance-ego": 0.005598117907842, "sim_compute_robot_state-ego": 0.009760886430740356, "sim_compute_robot_state-parked0": 0.01023957133293152}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.7220899923104419, "get_ui_image": 0.05143907410757882, "step_physics": 0.12709126472473145, "survival_time": 1.7500000000000009, "driven_lanedir": 0.4130489946650569, "get_state_dump": 0.017609242030552457, "sim_render-ego": 0.006882585797991072, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.02584531647818429, "deviation-heading": 0.23536850018942407, "complete-iteration": 0.27880398886544366, "set_robot_commands": 0.006618690490722656, "deviation-center-line": 0.10946689654790992, "driven_lanedir_consec": 0.4130489946650569, "sim_compute_sim_state": 0.01609060423714774, "sim_compute_performance-ego": 0.005842747007097517, "sim_compute_robot_state-ego": 0.01093198231288365, "sim_compute_robot_state-parked0": 0.010232721056256977}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.7220899923104419, "get_ui_image": 0.04989903994968959, "step_physics": 0.11175032343183244, "survival_time": 1.7500000000000009, "driven_lanedir": 0.4130489946650569, "get_state_dump": 0.01736593246459961, "sim_render-ego": 0.007403394154139927, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.02680356843130929, "deviation-heading": 0.23536850018942407, "complete-iteration": 0.26674778802054266, "set_robot_commands": 0.007049117769513812, "deviation-center-line": 0.10946689654790992, "driven_lanedir_consec": 0.4130489946650569, "sim_compute_sim_state": 0.017115156991141182, "sim_compute_performance-ego": 0.0062798704419817246, "sim_compute_robot_state-ego": 0.011501761845179969, "sim_compute_robot_state-parked0": 0.011318016052246091}}
set_robot_commands_max0.007049117769513812
set_robot_commands_mean0.006646426687419632
set_robot_commands_median0.00665113030335842
set_robot_commands_min0.0061208705107371015
sim_compute_performance-ego_max0.00653114914894104
sim_compute_performance-ego_mean0.005975698778044173
sim_compute_performance-ego_median0.00590433052607945
sim_compute_performance-ego_min0.005598117907842
sim_compute_robot_state-ego_max0.011501761845179969
sim_compute_robot_state-ego_mean0.01043210193154576
sim_compute_robot_state-ego_median0.010422585407892863
sim_compute_robot_state-ego_min0.009584341730390276
sim_compute_robot_state-parked0_max0.011541567742824554
sim_compute_robot_state-parked0_mean0.010530515872842662
sim_compute_robot_state-parked0_median0.01030372590809078
sim_compute_robot_state-parked0_min0.009538501501083374
sim_compute_sim_state_max0.02091933290163676
sim_compute_sim_state_mean0.018658275053723833
sim_compute_sim_state_median0.01825682759284973
sim_compute_sim_state_min0.01609060423714774
sim_render-ego_max0.008082970976829529
sim_render-ego_mean0.0071809066239294115
sim_render-ego_median0.007227272788683573
sim_render-ego_min0.006551613410313924
simulation-passed1
step_physics_max0.15503198901812237
step_physics_mean0.1296910746825702
step_physics_median0.1287028023174831
step_physics_min0.11175032343183244
survival_time_max14.950000000000076
survival_time_mean4.1500000000000155
survival_time_min1.2000000000000004
No reset possible
335547883Bea Baselines 🐤template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:01:06
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335527867Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:01:03
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335497852Bea Baselines 🐤template-pytorchaido5-LF-sim-validationLFv-simerrornoreg08-0c12c4a883f4-10:00:44
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335467808Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simerrornoreg08-0c12c4a883f4-10:00:43
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335437739Bea Baselines 🐤template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:01:38
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335367763Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:01:00
The container "solut [...]
The container "solution-ego0" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335327711Bea Baselines 🐤template-randomaido5-LF-sim-validationLFv-simerrornoreg08-0c12c4a883f4-10:00:52
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
335277691Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:01:22
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
334907175Bea Baselines 🐤template-pytorchaido5-LF-sim-validationLFv-simsuccessnoreg08-0c12c4a883f4-10:26:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0798415690948733
survival_time_median14.950000000000076
deviation-center-line_median0.5305030485016144
in-drivable-lane_median5.825000000000083


other stats
agent_compute-ego_max0.055813450813293454
agent_compute-ego_mean0.051062855835546525
agent_compute-ego_median0.05317994117736816
agent_compute-ego_min0.026937589645385743
complete-iteration_max0.31834953784942627
complete-iteration_mean0.3066599177322292
complete-iteration_median0.3065236341534999
complete-iteration_min0.2858156228065491
deviation-center-line_max0.8365983281233738
deviation-center-line_mean0.52026469739831
deviation-center-line_min0.18765470386389504
deviation-heading_max2.1279307009076853
deviation-heading_mean1.5956041704545263
deviation-heading_median1.5620032366672234
deviation-heading_min1.0533137137161972
driven_any_max1.9399973978582667
driven_any_mean1.9174344845152915
driven_any_median1.939964147092628
driven_any_min1.8138633604863588
driven_lanedir_consec_max1.474344765016432
driven_lanedir_consec_mean1.0224625544891073
driven_lanedir_consec_min0.5772748771744065
driven_lanedir_max1.474344765016432
driven_lanedir_mean1.1076278551557606
driven_lanedir_median1.1427918044424836
driven_lanedir_min0.6252592253076726
get_state_dump_max0.01787164847056071
get_state_dump_mean0.016952468783335575
get_state_dump_median0.016840389314151945
get_state_dump_min0.0163514518737793
get_ui_image_max0.051376463685716904
get_ui_image_mean0.050518123119397275
get_ui_image_median0.05057461937268575
get_ui_image_min0.049751477241516115
in-drivable-lane_max8.950000000000077
in-drivable-lane_mean5.800000000000066
in-drivable-lane_min3.100000000000044
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.9336793163780683, "get_ui_image": 0.05066583792368571, "step_physics": 0.12609246492385864, "survival_time": 14.950000000000076, "driven_lanedir": 1.474344765016432, "get_state_dump": 0.01787164847056071, "sim_render-ego": 0.007481652895609538, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.026937589645385743, "deviation-heading": 1.9115412008197803, "complete-iteration": 0.2858156228065491, "set_robot_commands": 0.006991039117177328, "deviation-center-line": 0.5099803424298535, "driven_lanedir_consec": 1.474344765016432, "sim_compute_sim_state": 0.021283219655354815, "sim_compute_performance-ego": 0.0063662099838256835, "sim_compute_robot_state-ego": 0.011276883284250897, "sim_compute_robot_state-parked0": 0.010641795794169108}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.9399973978582667, "get_ui_image": 0.049751477241516115, "step_physics": 0.12250081777572631, "survival_time": 14.950000000000076, "driven_lanedir": 1.4586237422154114, "get_state_dump": 0.017301193078358968, "sim_render-ego": 0.007211254437764485, "in-drivable-lane": 3.3500000000000476, "agent_compute-ego": 0.05308962027231852, "deviation-heading": 2.020894881881779, "complete-iteration": 0.3037153704961141, "set_robot_commands": 0.0063069351514180505, "deviation-center-line": 0.677234040138397, "driven_lanedir_consec": 1.4586237422154114, "sim_compute_sim_state": 0.02080585718154907, "sim_compute_performance-ego": 0.006069440841674805, "sim_compute_robot_state-ego": 0.010499128500620524, "sim_compute_robot_state-parked0": 0.009982889493306476}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.9398865452198264, "get_ui_image": 0.050537322362264, "step_physics": 0.1277036674817403, "survival_time": 14.950000000000076, "driven_lanedir": 1.4056198028977789, "get_state_dump": 0.01669538180033366, "sim_render-ego": 0.007059396902720134, "in-drivable-lane": 3.649999999999994, "agent_compute-ego": 0.055813450813293454, "deviation-heading": 2.1279307009076853, "complete-iteration": 0.3088305656115214, "set_robot_commands": 0.006392226219177246, "deviation-center-line": 0.8365983281233738, "driven_lanedir_consec": 0.5772748771744065, "sim_compute_sim_state": 0.01790438413619995, "sim_compute_performance-ego": 0.005901422500610352, "sim_compute_robot_state-ego": 0.01049453576405843, "sim_compute_robot_state-parked0": 0.0101296599706014}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.9399599215954408, "get_ui_image": 0.050548248291015625, "step_physics": 0.12853139400482178, "survival_time": 14.950000000000076, "driven_lanedir": 1.16015304698528, "get_state_dump": 0.016501005490620932, "sim_render-ego": 0.007026522954305013, "in-drivable-lane": 5.400000000000077, "agent_compute-ego": 0.05327026208241781, "deviation-heading": 1.927115268125866, "complete-iteration": 0.30747642914454143, "set_robot_commands": 0.006370232105255127, "deviation-center-line": 0.5375506107430714, "driven_lanedir_consec": 1.1368449660421205, "sim_compute_sim_state": 0.018823554515838625, "sim_compute_performance-ego": 0.005784744421641032, "sim_compute_robot_state-ego": 0.010594526926676432, "sim_compute_robot_state-parked0": 0.009820942878723144}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.8138633604863588, "get_ui_image": 0.051376463685716904, "step_physics": 0.1292545463357653, "survival_time": 14.000000000000064, "driven_lanedir": 0.6313443328970111, "get_state_dump": 0.016985396827970234, "sim_render-ego": 0.007095848662512643, "in-drivable-lane": 8.650000000000075, "agent_compute-ego": 0.05291479229927063, "deviation-heading": 1.056127707589585, "complete-iteration": 0.3045365674155099, "set_robot_commands": 0.006308928557804652, "deviation-center-line": 0.19274785627522076, "driven_lanedir_consec": 0.6313443328970111, "sim_compute_sim_state": 0.014185634681156705, "sim_compute_performance-ego": 0.005864042895180838, "sim_compute_robot_state-ego": 0.01051627142088754, "sim_compute_robot_state-parked0": 0.009831603084291733}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.8470572812253403, "get_ui_image": 0.05087012408072488, "step_physics": 0.1267595081998591, "survival_time": 14.250000000000068, "driven_lanedir": 0.6252592253076726, "get_state_dump": 0.01719038528308534, "sim_render-ego": 0.007326867287619072, "in-drivable-lane": 8.950000000000077, "agent_compute-ego": 0.05455915049502724, "deviation-heading": 1.0533137137161972, "complete-iteration": 0.3055708391624585, "set_robot_commands": 0.006479886540195398, "deviation-center-line": 0.18765470386389504, "driven_lanedir_consec": 0.6252592253076726, "sim_compute_sim_state": 0.014751582396657845, "sim_compute_performance-ego": 0.006058151680126525, "sim_compute_robot_state-ego": 0.011084221120466264, "sim_compute_robot_state-parked0": 0.010283583925481428}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.939968372589816, "get_ui_image": 0.04995766957600911, "step_physics": 0.1399186126391093, "survival_time": 14.950000000000076, "driven_lanedir": 1.0342525762900592, "get_state_dump": 0.01647464116414388, "sim_render-ego": 0.007175854841868083, "in-drivable-lane": 6.400000000000091, "agent_compute-ego": 0.05209963957468668, "deviation-heading": 1.6506409061884264, "complete-iteration": 0.3170384097099304, "set_robot_commands": 0.006122992038726806, "deviation-center-line": 0.5234554862601574, "driven_lanedir_consec": 1.0342525762900592, "sim_compute_sim_state": 0.019042909145355225, "sim_compute_performance-ego": 0.00592365026473999, "sim_compute_robot_state-ego": 0.010350107351938883, "sim_compute_robot_state-parked0": 0.00977336327234904}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.939973746935096, "get_ui_image": 0.05060099045435588, "step_physics": 0.13860702196757, "survival_time": 14.950000000000076, "driven_lanedir": 0.9845436997968388, "get_state_dump": 0.0163514518737793, "sim_render-ego": 0.007076194286346435, "in-drivable-lane": 6.850000000000093, "agent_compute-ego": 0.0540263835589091, "deviation-heading": 1.4733655671460204, "complete-iteration": 0.31834953784942627, "set_robot_commands": 0.0062358474731445315, "deviation-center-line": 0.5031293885528102, "driven_lanedir_consec": 0.9845436997968388, "sim_compute_sim_state": 0.019043874740600587, "sim_compute_performance-ego": 0.00595356543858846, "sim_compute_robot_state-ego": 0.010367565155029295, "sim_compute_robot_state-parked0": 0.009885846773783366}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.9399726041339116, "get_ui_image": 0.05065669933954875, "step_physics": 0.13525102853775026, "survival_time": 14.950000000000076, "driven_lanedir": 1.176706798251434, "get_state_dump": 0.016537376244862876, "sim_render-ego": 0.007070345083872477, "in-drivable-lane": 5.65000000000008, "agent_compute-ego": 0.05265947659810384, "deviation-heading": 1.321332478857757, "complete-iteration": 0.31224992434183757, "set_robot_commands": 0.006304058233896891, "deviation-center-line": 0.6240669826847808, "driven_lanedir_consec": 1.176706798251434, "sim_compute_sim_state": 0.017337387402852376, "sim_compute_performance-ego": 0.006031060218811035, "sim_compute_robot_state-ego": 0.010400034586588542, "sim_compute_robot_state-parked0": 0.009800810019175212}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.9399862987307952, "get_ui_image": 0.05021639823913574, "step_physics": 0.11935979207356771, "survival_time": 14.950000000000076, "driven_lanedir": 1.1254305618996874, "get_state_dump": 0.01761620759963989, "sim_render-ego": 0.00751277764638265, "in-drivable-lane": 6.000000000000085, "agent_compute-ego": 0.05525819301605225, "deviation-heading": 1.4137792793121693, "complete-iteration": 0.3030159107844035, "set_robot_commands": 0.006804571151733398, "deviation-center-line": 0.6102292349115399, "driven_lanedir_consec": 1.1254305618996874, "sim_compute_sim_state": 0.01779990275700887, "sim_compute_performance-ego": 0.00629417896270752, "sim_compute_robot_state-ego": 0.011187477111816406, "sim_compute_robot_state-parked0": 0.010753835042317708}}
set_robot_commands_max0.006991039117177328
set_robot_commands_mean0.006431671658852943
set_robot_commands_median0.0063395803315298895
set_robot_commands_min0.006122992038726806
sim_compute_performance-ego_max0.0063662099838256835
sim_compute_performance-ego_mean0.006024646720790625
sim_compute_performance-ego_median0.005992312828699747
sim_compute_performance-ego_min0.005784744421641032
sim_compute_robot_state-ego_max0.011276883284250897
sim_compute_robot_state-ego_mean0.010677075122233322
sim_compute_robot_state-ego_median0.01050769996075403
sim_compute_robot_state-ego_min0.010350107351938883
sim_compute_robot_state-parked0_max0.010753835042317708
sim_compute_robot_state-parked0_mean0.01009043302541986
sim_compute_robot_state-parked0_median0.00993436813354492
sim_compute_robot_state-parked0_min0.00977336327234904
sim_compute_sim_state_max0.021283219655354815
sim_compute_sim_state_mean0.018097830661257405
sim_compute_sim_state_median0.01836396932601929
sim_compute_sim_state_min0.014185634681156705
sim_render-ego_max0.00751277764638265
sim_render-ego_mean0.007203671499900054
sim_render-ego_median0.007135851752190362
sim_render-ego_min0.007026522954305013
simulation-passed1
step_physics_max0.1399186126391093
step_physics_mean0.12939788539397684
step_physics_median0.12811753074328103
step_physics_min0.11935979207356771
survival_time_max14.950000000000076
survival_time_mean14.785000000000077
survival_time_min14.000000000000064
No reset possible
334797219Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg08-0c12c4a883f4-10:01:11
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 158, in main
    check_compatibility_between_agent_and_sim(robot_ci, sim_ci)
  File "experiment_manager.py", line 531, in check_compatibility_between_agent_and_sim
    raise ZException(msg, r=r)
zuper_commons.types.exceptions.ZException: Observations mismatch
│ r: CanBeUsed
│    │ result: False
│    │ why:
│    │ |Type <class 'aido_schemas.schemas.Duckiebot1ObservationsPlusState'>
│    │ | requires field "your_name"
│    │ |  of type <class 'str'>
│    │ |  but <class 'aido_schemas.schemas.Duckiebot1Observations'> does not have it.
│    │ M: Matches()
│    │ matches: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
334636851Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg08-0c12c4a883f4-10:25:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2805576014299973
survival_time_median14.950000000000076
deviation-center-line_median0.5741073218364986
in-drivable-lane_median1.75000000000002


other stats
agent_compute-ego_max0.027997487386067707
agent_compute-ego_mean0.02707249560930869
agent_compute-ego_median0.027027430792788527
agent_compute-ego_min0.0261267352104187
complete-iteration_max0.31990715602169867
complete-iteration_mean0.2949995419148014
complete-iteration_median0.29542270938555404
complete-iteration_min0.2795306499799093
deviation-center-line_max1.1768012976659978
deviation-center-line_mean0.6270203259652609
deviation-center-line_min0.15041671378350877
deviation-heading_max4.271196011764727
deviation-heading_mean2.277786548015373
deviation-heading_median2.2792645684741273
deviation-heading_min0.9000138565324585
driven_any_max3.0631239977019624
driven_any_mean2.871248068463379
driven_any_median3.0256654078315695
driven_any_min1.7010068150937905
driven_lanedir_consec_max2.6960771008827313
driven_lanedir_consec_mean1.9434666128520433
driven_lanedir_consec_min0.649286504165351
driven_lanedir_max2.6960771008827313
driven_lanedir_mean1.9440820438097013
driven_lanedir_median2.2805576014299973
driven_lanedir_min0.649286504165351
get_state_dump_max0.018677372137705484
get_state_dump_mean0.017833040442805936
get_state_dump_median0.017884335180987483
get_state_dump_min0.01727021376291911
get_ui_image_max0.050744306782017586
get_ui_image_mean0.049673000787200466
get_ui_image_median0.049847485582867425
get_ui_image_min0.04858285903930664
in-drivable-lane_max11.200000000000085
in-drivable-lane_mean4.035000000000041
in-drivable-lane_min1.350000000000012
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.7010068150937905, "get_ui_image": 0.050744306782017586, "step_physics": 0.1577590613261513, "survival_time": 9.199999999999996, "driven_lanedir": 1.3479509544247694, "get_state_dump": 0.01787770442340685, "sim_render-ego": 0.007849545582481052, "in-drivable-lane": 1.7000000000000144, "agent_compute-ego": 0.027897106564563255, "deviation-heading": 1.9445548715019456, "complete-iteration": 0.31990715602169867, "set_robot_commands": 0.00716979866442473, "deviation-center-line": 0.48011197123285926, "driven_lanedir_consec": 1.3479509544247694, "sim_compute_sim_state": 0.021564494008603306, "sim_compute_performance-ego": 0.006513221108395121, "sim_compute_robot_state-ego": 0.011266206917555435, "sim_compute_robot_state-parked0": 0.011038346135098}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 3.0421371692696253, "get_ui_image": 0.048934375445048015, "step_physics": 0.13754934072494507, "survival_time": 14.950000000000076, "driven_lanedir": 2.577929241423282, "get_state_dump": 0.01790203889211019, "sim_render-ego": 0.0076241405804951985, "in-drivable-lane": 1.350000000000012, "agent_compute-ego": 0.027271412213643393, "deviation-heading": 4.271196011764727, "complete-iteration": 0.29553465763727826, "set_robot_commands": 0.006818679173787435, "deviation-center-line": 1.1768012976659978, "driven_lanedir_consec": 2.577929241423282, "sim_compute_sim_state": 0.02124776840209961, "sim_compute_performance-ego": 0.006370901266733805, "sim_compute_robot_state-ego": 0.01124017318089803, "sim_compute_robot_state-parked0": 0.010359211762746175}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 3.021137781270545, "get_ui_image": 0.04858285903930664, "step_physics": 0.13913957913716635, "survival_time": 14.950000000000076, "driven_lanedir": 2.1419399334076794, "get_state_dump": 0.01840048313140869, "sim_render-ego": 0.007391568819681804, "in-drivable-lane": 3.7500000000000537, "agent_compute-ego": 0.02682802438735962, "deviation-heading": 2.38252171365169, "complete-iteration": 0.2955931822458903, "set_robot_commands": 0.006747268040974935, "deviation-center-line": 0.44201997988705183, "driven_lanedir_consec": 2.1419399334076794, "sim_compute_sim_state": 0.020504476229349772, "sim_compute_performance-ego": 0.0062713686625162765, "sim_compute_robot_state-ego": 0.011359456380208334, "sim_compute_robot_state-parked0": 0.010146767298380531}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 3.0631239977019624, "get_ui_image": 0.04922399838765462, "step_physics": 0.1385403609275818, "survival_time": 14.950000000000076, "driven_lanedir": 2.5933306900234374, "get_state_dump": 0.018165204524993896, "sim_render-ego": 0.00734543244043986, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.02692348082860311, "deviation-heading": 2.873084515468186, "complete-iteration": 0.2948521327972412, "set_robot_commands": 0.006489399274190267, "deviation-center-line": 0.9211022542537776, "driven_lanedir_consec": 2.5933306900234374, "sim_compute_sim_state": 0.020543716748555502, "sim_compute_performance-ego": 0.006240220864613851, "sim_compute_robot_state-ego": 0.011203416188557944, "sim_compute_robot_state-parked0": 0.009957935810089111}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.853488165824747, "get_ui_image": 0.050498932286312706, "step_physics": 0.13982220783568264, "survival_time": 14.250000000000068, "driven_lanedir": 0.6915720268133536, "get_state_dump": 0.017426706615247225, "sim_render-ego": 0.007307874947263484, "in-drivable-lane": 9.600000000000076, "agent_compute-ego": 0.027472726922286184, "deviation-heading": 2.1760074232965647, "complete-iteration": 0.2925077522010134, "set_robot_commands": 0.0068392778697766755, "deviation-center-line": 0.17733695451008624, "driven_lanedir_consec": 0.685417717236771, "sim_compute_sim_state": 0.01492861362925747, "sim_compute_performance-ego": 0.0061890008156759695, "sim_compute_robot_state-ego": 0.01122810213189376, "sim_compute_robot_state-parked0": 0.0105703169839424}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.969288273434112, "get_ui_image": 0.050461808840433754, "step_physics": 0.1421085993448893, "survival_time": 14.950000000000076, "driven_lanedir": 0.649286504165351, "get_state_dump": 0.017890965938568114, "sim_render-ego": 0.007424960931142172, "in-drivable-lane": 11.200000000000085, "agent_compute-ego": 0.02712874174118042, "deviation-heading": 0.9000138565324585, "complete-iteration": 0.2955816014607747, "set_robot_commands": 0.0066942405700683594, "deviation-center-line": 0.15041671378350877, "driven_lanedir_consec": 0.649286504165351, "sim_compute_sim_state": 0.016445196469624838, "sim_compute_performance-ego": 0.006255498727162679, "sim_compute_robot_state-ego": 0.010790547529856365, "sim_compute_robot_state-parked0": 0.01016793648401896}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.90586867215393, "get_ui_image": 0.04983210396933389, "step_physics": 0.14228210249147216, "survival_time": 14.300000000000068, "driven_lanedir": 2.4191752694523156, "get_state_dump": 0.017336962106344583, "sim_render-ego": 0.007286427737949612, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.02692611984439663, "deviation-heading": 3.4058796297165954, "complete-iteration": 0.29793736234411494, "set_robot_commands": 0.006659362699602034, "deviation-center-line": 0.9017385279830278, "driven_lanedir_consec": 2.4191752694523156, "sim_compute_sim_state": 0.020237863480627952, "sim_compute_performance-ego": 0.006052774982852536, "sim_compute_robot_state-ego": 0.01094791855845418, "sim_compute_robot_state-parked0": 0.010163216324119302}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 3.0631161450239244, "get_ui_image": 0.04993450005849202, "step_physics": 0.14032092173894248, "survival_time": 14.950000000000076, "driven_lanedir": 2.6960771008827313, "get_state_dump": 0.01727021376291911, "sim_render-ego": 0.007171127796173096, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.0261267352104187, "deviation-heading": 1.4155827658404792, "complete-iteration": 0.29531076113382976, "set_robot_commands": 0.006632961432139079, "deviation-center-line": 0.6681026724401379, "driven_lanedir_consec": 2.6960771008827313, "sim_compute_sim_state": 0.020637745062510173, "sim_compute_performance-ego": 0.006054232120513916, "sim_compute_robot_state-ego": 0.010585886637369792, "sim_compute_robot_state-parked0": 0.010362711747487386}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 3.030193034392594, "get_ui_image": 0.04986286719640096, "step_physics": 0.12935507774353028, "survival_time": 14.950000000000076, "driven_lanedir": 2.638389758497211, "get_state_dump": 0.017382752895355225, "sim_render-ego": 0.007231641610463461, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.02615312099456787, "deviation-heading": 2.4842924767538648, "complete-iteration": 0.28324016332626345, "set_robot_commands": 0.006780187288920085, "deviation-center-line": 0.8740320417353779, "driven_lanedir_consec": 2.638389758497211, "sim_compute_sim_state": 0.019046185811360677, "sim_compute_performance-ego": 0.006042985916137695, "sim_compute_robot_state-ego": 0.010784486929575602, "sim_compute_robot_state-parked0": 0.010384645462036131}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 3.0631206304685605, "get_ui_image": 0.04865425586700439, "step_physics": 0.12067523320515952, "survival_time": 14.950000000000076, "driven_lanedir": 1.6851689590068837, "get_state_dump": 0.018677372137705484, "sim_render-ego": 0.007847325801849365, "in-drivable-lane": 6.500000000000092, "agent_compute-ego": 0.027997487386067707, "deviation-heading": 0.9247322156272196, "complete-iteration": 0.2795306499799093, "set_robot_commands": 0.007087988058725993, "deviation-center-line": 0.478540846160785, "driven_lanedir_consec": 1.6851689590068837, "sim_compute_sim_state": 0.019196647802988687, "sim_compute_performance-ego": 0.006523331801096598, "sim_compute_robot_state-ego": 0.011854578653971354, "sim_compute_robot_state-parked0": 0.010788665612538656}}
set_robot_commands_max0.00716979866442473
set_robot_commands_mean0.006791916307260959
set_robot_commands_median0.00676372766494751
set_robot_commands_min0.006489399274190267
sim_compute_performance-ego_max0.006523331801096598
sim_compute_performance-ego_mean0.006251353626569844
sim_compute_performance-ego_median0.006247859795888265
sim_compute_performance-ego_min0.006042985916137695
sim_compute_robot_state-ego_max0.011854578653971354
sim_compute_robot_state-ego_mean0.01112607731083408
sim_compute_robot_state-ego_median0.011215759160225852
sim_compute_robot_state-ego_min0.010585886637369792
sim_compute_robot_state-parked0_max0.011038346135098
sim_compute_robot_state-parked0_mean0.010393975362045667
sim_compute_robot_state-parked0_median0.01036096175511678
sim_compute_robot_state-parked0_min0.009957935810089111
sim_compute_sim_state_max0.021564494008603306
sim_compute_sim_state_mean0.019435270764497796
sim_compute_sim_state_median0.020371169854988862
sim_compute_sim_state_min0.01492861362925747
sim_render-ego_max0.007849545582481052
sim_render-ego_mean0.00744800462479391
sim_render-ego_median0.007368500630060832
sim_render-ego_min0.007171127796173096
simulation-passed1
step_physics_max0.1577590613261513
step_physics_mean0.1387552484475521
step_physics_median0.1394808934864245
step_physics_min0.12067523320515952
survival_time_max14.950000000000076
survival_time_mean14.240000000000066
survival_time_min9.199999999999996
No reset possible