Duckietown Challenges Home Challenges Submissions

Evaluator 917

ID917
evaluatorip-172-31-42-167-7357
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7357
versiond-c:4.0.25;d-c-r:4.0.32;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success9 21783
# timeout
# failed
# error
# aborted
# host-error5 21706
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
218983344Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LFV-sim-validationstep1-simulationhost-errornoip-172-31-42-167-73570:25:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission3344/step1-simulation-ip-172-31-42-167-7357-job21898/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
218933340Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LF-sim-testingstep1-simulationhost-errornoip-172-31-42-167-73570:26:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3340/step1-simulation-ip-172-31-42-167-7357-job21893/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
218893337Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-73570:13:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.463053342997995
survival_time_median14.950000000000076
deviation-center-line_median1.0013334966525722
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05518840710322062
agent_compute-ego_mean0.05361751824240026
agent_compute-ego_median0.05351878634670325
agent_compute-ego_min0.05235296090443929
deviation-center-line_max1.4879893048980954
deviation-center-line_mean1.0161567756196346
deviation-center-line_min0.5977143051883849
deviation-heading_max3.027409425578353
deviation-heading_mean2.2380081291955656
deviation-heading_median2.382713358518008
deviation-heading_min0.537066860753243
driven_any_max2.653975593751821
driven_any_mean2.285754027257833
driven_any_median2.5269281308340545
driven_any_min1.0961316087651318
driven_lanedir_consec_max2.596186656367132
driven_lanedir_consec_mean2.188388222396365
driven_lanedir_consec_min1.0885869704941074
driven_lanedir_max2.596186656367132
driven_lanedir_mean2.188388222396365
driven_lanedir_median2.463053342997995
driven_lanedir_min1.0885869704941074
in-drivable-lane_max1.8000000000000256
in-drivable-lane_mean0.3600000000000051
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5269281308340545, "sim_physics": 0.05730903704961141, "survival_time": 14.950000000000076, "driven_lanedir": 2.247707568803523, "sim_render-ego": 0.03676682233810425, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.05518840710322062, "deviation-heading": 2.380068027159751, "set_robot_commands": 0.06784003178278605, "deviation-center-line": 1.0013334966525722, "driven_lanedir_consec": 2.247707568803523, "sim_compute_sim_state": 0.024229698181152344, "sim_compute_performance-ego": 0.04426513036092122, "sim_compute_robot_state-ego": 0.04172751188278198}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.626580343254864, "sim_physics": 0.05956535816192627, "survival_time": 14.950000000000076, "driven_lanedir": 2.5464065733190684, "sim_render-ego": 0.036099466482798256, "in-drivable-lane": 0, "agent_compute-ego": 0.05235296090443929, "deviation-heading": 3.027409425578353, "set_robot_commands": 0.06739028851191203, "deviation-center-line": 1.4879893048980954, "driven_lanedir_consec": 2.5464065733190684, "sim_compute_sim_state": 0.0242920978864034, "sim_compute_performance-ego": 0.03988339026769002, "sim_compute_robot_state-ego": 0.04223714351654053}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0961316087651318, "sim_physics": 0.058640538091244906, "survival_time": 5.749999999999988, "driven_lanedir": 1.0885869704941074, "sim_render-ego": 0.036995956172113834, "in-drivable-lane": 0, "agent_compute-ego": 0.05368379509967306, "deviation-heading": 0.537066860753243, "set_robot_commands": 0.06771355504574983, "deviation-center-line": 0.5977143051883849, "driven_lanedir_consec": 1.0885869704941074, "sim_compute_sim_state": 0.024224525949229365, "sim_compute_performance-ego": 0.04003098529318105, "sim_compute_robot_state-ego": 0.04234822107397992}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.5251544596832955, "sim_physics": 0.06064602032042386, "survival_time": 14.250000000000068, "driven_lanedir": 2.463053342997995, "sim_render-ego": 0.03660855209618284, "in-drivable-lane": 0, "agent_compute-ego": 0.05351878634670325, "deviation-heading": 2.862782973968473, "set_robot_commands": 0.07226332865263287, "deviation-center-line": 1.0172651025027, "driven_lanedir_consec": 2.463053342997995, "sim_compute_sim_state": 0.02414834373875668, "sim_compute_performance-ego": 0.039997045617354544, "sim_compute_robot_state-ego": 0.04177699507328502}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.653975593751821, "sim_physics": 0.060050490697224936, "survival_time": 14.950000000000076, "driven_lanedir": 2.596186656367132, "sim_render-ego": 0.03653240362803141, "in-drivable-lane": 0, "agent_compute-ego": 0.05334364175796509, "deviation-heading": 2.382713358518008, "set_robot_commands": 0.06906816641489665, "deviation-center-line": 0.9764816688564208, "driven_lanedir_consec": 2.596186656367132, "sim_compute_sim_state": 0.02434592326482137, "sim_compute_performance-ego": 0.03976624409357707, "sim_compute_robot_state-ego": 0.0421513819694519}}
set_robot_commands_max0.07226332865263287
set_robot_commands_mean0.0688550740815955
set_robot_commands_median0.06784003178278605
set_robot_commands_min0.06739028851191203
sim_compute_performance-ego_max0.04426513036092122
sim_compute_performance-ego_mean0.040788559126544784
sim_compute_performance-ego_median0.039997045617354544
sim_compute_performance-ego_min0.03976624409357707
sim_compute_robot_state-ego_max0.04234822107397992
sim_compute_robot_state-ego_mean0.04204825070320787
sim_compute_robot_state-ego_median0.0421513819694519
sim_compute_robot_state-ego_min0.04172751188278198
sim_compute_sim_state_max0.02434592326482137
sim_compute_sim_state_mean0.02424811780407263
sim_compute_sim_state_median0.024229698181152344
sim_compute_sim_state_min0.02414834373875668
sim_physics_max0.06064602032042386
sim_physics_mean0.05924228886408628
sim_physics_median0.05956535816192627
sim_physics_min0.05730903704961141
sim_render-ego_max0.036995956172113834
sim_render-ego_mean0.03660064014344612
sim_render-ego_median0.03660855209618284
sim_render-ego_min0.036099466482798256
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.970000000000056
survival_time_min5.749999999999988
No reset possible
218363306Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-73570:09:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.619739177983906
survival_time_median7.049999999999983
deviation-center-line_median0.6000032722784817
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06340138728802021
agent_compute-ego_mean0.06053878990886959
agent_compute-ego_median0.061588924725850425
agent_compute-ego_min0.056574356471393125
deviation-center-line_max1.1961135182069995
deviation-center-line_mean0.662469796482952
deviation-center-line_min0.16631155086202748
deviation-heading_max3.5117518369982985
deviation-heading_mean1.5088307768449607
deviation-heading_median1.0002689735616055
deviation-heading_min0.3121760369672929
driven_any_max3.5630961933287586
driven_any_mean1.7796881955856527
driven_any_median1.6426205092908013
driven_any_min0.4808742352727393
driven_lanedir_consec_max2.732058714547996
driven_lanedir_consec_mean1.5261760391327122
driven_lanedir_consec_min0.4622788329426877
driven_lanedir_max2.732058714547996
driven_lanedir_mean1.5261760391327122
driven_lanedir_median1.619739177983906
driven_lanedir_min0.4622788329426877
in-drivable-lane_max2.6500000000000377
in-drivable-lane_mean0.7500000000000107
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.5630961933287586, "sim_physics": 0.06146852016448975, "survival_time": 14.950000000000076, "driven_lanedir": 2.732058714547996, "sim_render-ego": 0.03681393067042033, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.061588924725850425, "deviation-heading": 3.5117518369982985, "set_robot_commands": 0.05684562126795451, "deviation-center-line": 1.1961135182069995, "driven_lanedir_consec": 2.732058714547996, "sim_compute_sim_state": 0.02374173084894816, "sim_compute_performance-ego": 0.03963514725367228, "sim_compute_robot_state-ego": 0.04184741258621216}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6426205092908013, "sim_physics": 0.05803737572744383, "survival_time": 7.049999999999983, "driven_lanedir": 1.619739177983906, "sim_render-ego": 0.03619352807389929, "in-drivable-lane": 0, "agent_compute-ego": 0.056574356471393125, "deviation-heading": 1.0002689735616055, "set_robot_commands": 0.05498795475520141, "deviation-center-line": 0.6000032722784817, "driven_lanedir_consec": 1.619739177983906, "sim_compute_sim_state": 0.023603432567407052, "sim_compute_performance-ego": 0.039680513084357515, "sim_compute_robot_state-ego": 0.04167948208802135}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5909370859314412, "sim_physics": 0.05799473415721546, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5871554638903027, "sim_render-ego": 0.036116443980823865, "in-drivable-lane": 0, "agent_compute-ego": 0.06186789165843617, "deviation-heading": 0.3121760369672929, "set_robot_commands": 0.05801650394092907, "deviation-center-line": 0.3139152521842598, "driven_lanedir_consec": 0.5871554638903027, "sim_compute_sim_state": 0.023519715395840732, "sim_compute_performance-ego": 0.04003285494717685, "sim_compute_robot_state-ego": 0.04176814772865989}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4808742352727393, "sim_physics": 0.06194710731506348, "survival_time": 2.3, "driven_lanedir": 0.4622788329426877, "sim_render-ego": 0.03612642702849015, "in-drivable-lane": 0, "agent_compute-ego": 0.05926138940064803, "deviation-heading": 0.6406398658274116, "set_robot_commands": 0.05839418846627941, "deviation-center-line": 0.16631155086202748, "driven_lanedir_consec": 0.4622788329426877, "sim_compute_sim_state": 0.02366146834000297, "sim_compute_performance-ego": 0.03966655420220416, "sim_compute_robot_state-ego": 0.041083724602409034}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.6209129541045235, "sim_physics": 0.057641212756817155, "survival_time": 11.050000000000022, "driven_lanedir": 2.2296480062986688, "sim_render-ego": 0.036593532130729016, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.06340138728802021, "deviation-heading": 2.0793171708701936, "set_robot_commands": 0.05499130676235009, "deviation-center-line": 1.036005388882992, "driven_lanedir_consec": 2.2296480062986688, "sim_compute_sim_state": 0.023789715443261607, "sim_compute_performance-ego": 0.03947609797861781, "sim_compute_robot_state-ego": 0.04184288568626162}}
set_robot_commands_max0.05839418846627941
set_robot_commands_mean0.056647115038542896
set_robot_commands_median0.05684562126795451
set_robot_commands_min0.05498795475520141
sim_compute_performance-ego_max0.04003285494717685
sim_compute_performance-ego_mean0.03969823349320572
sim_compute_performance-ego_median0.03966655420220416
sim_compute_performance-ego_min0.03947609797861781
sim_compute_robot_state-ego_max0.04184741258621216
sim_compute_robot_state-ego_mean0.04164433053831281
sim_compute_robot_state-ego_median0.04176814772865989
sim_compute_robot_state-ego_min0.041083724602409034
sim_compute_sim_state_max0.023789715443261607
sim_compute_sim_state_mean0.023663212519092106
sim_compute_sim_state_median0.02366146834000297
sim_compute_sim_state_min0.023519715395840732
sim_physics_max0.06194710731506348
sim_physics_mean0.05941779002420593
sim_physics_median0.05803737572744383
sim_physics_min0.057641212756817155
sim_render-ego_max0.03681393067042033
sim_render-ego_mean0.036368772376872534
sim_render-ego_median0.03619352807389929
sim_render-ego_min0.036116443980823865
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.620000000000016
survival_time_min2.3
No reset possible
218143294Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-73570:06:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6951608633574846
survival_time_median4.799999999999991
deviation-center-line_median0.32928443664497076
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.06217819246752509
agent_compute-ego_mean0.059896991130892405
agent_compute-ego_median0.059626513339103536
agent_compute-ego_min0.057157374918460846
deviation-center-line_max1.0083455915519175
deviation-center-line_mean0.41439070027373137
deviation-center-line_min0.14484601705741873
deviation-heading_max2.0311912077372813
deviation-heading_mean0.9216786979401516
deviation-heading_median0.6443791739458721
deviation-heading_min0.3526441801444514
driven_any_max3.5747899276089776
driven_any_mean1.319906453449887
driven_any_median1.0923205339881443
driven_any_min0.2730360690442603
driven_lanedir_consec_max2.0867744273159223
driven_lanedir_consec_mean0.9059996353700508
driven_lanedir_consec_min0.26439667307222603
driven_lanedir_max2.0867744273159223
driven_lanedir_mean0.9059996353700508
driven_lanedir_median0.6951608633574846
driven_lanedir_min0.26439667307222603
in-drivable-lane_max5.700000000000038
in-drivable-lane_mean1.5500000000000065
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.16628202924226, "sim_physics": 0.058296263796611895, "survival_time": 5.14999999999999, "driven_lanedir": 0.6951608633574846, "sim_render-ego": 0.036114560747609555, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.05861253414339232, "deviation-heading": 0.3526441801444514, "set_robot_commands": 0.05629794805952646, "deviation-center-line": 0.32928443664497076, "driven_lanedir_consec": 0.6951608633574846, "sim_compute_sim_state": 0.023630431554849864, "sim_compute_performance-ego": 0.039986962253607594, "sim_compute_robot_state-ego": 0.041496494441356474}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0923205339881443, "sim_physics": 0.0595581183830897, "survival_time": 4.799999999999991, "driven_lanedir": 1.0087639096543306, "sim_render-ego": 0.03604211409886678, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.057157374918460846, "deviation-heading": 1.223745022878899, "set_robot_commands": 0.05451978246370951, "deviation-center-line": 0.4201264913474453, "driven_lanedir_consec": 1.0087639096543306, "sim_compute_sim_state": 0.023863044877847035, "sim_compute_performance-ego": 0.03958561023076376, "sim_compute_robot_state-ego": 0.0423379714290301}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2730360690442603, "sim_physics": 0.06052883740129142, "survival_time": 1.4500000000000006, "driven_lanedir": 0.26439667307222603, "sim_render-ego": 0.036360789989602973, "in-drivable-lane": 0, "agent_compute-ego": 0.06217819246752509, "deviation-heading": 0.3564339049942533, "set_robot_commands": 0.05549910972858298, "deviation-center-line": 0.14484601705741873, "driven_lanedir_consec": 0.26439667307222603, "sim_compute_sim_state": 0.024452291685959388, "sim_compute_performance-ego": 0.03976955084965147, "sim_compute_robot_state-ego": 0.04234276146724306}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.49310370736579306, "sim_physics": 0.061319244668838827, "survival_time": 2.3499999999999996, "driven_lanedir": 0.4749023034502904, "sim_render-ego": 0.03671168773732287, "in-drivable-lane": 0, "agent_compute-ego": 0.059626513339103536, "deviation-heading": 0.6443791739458721, "set_robot_commands": 0.05559984673845007, "deviation-center-line": 0.16935096476690464, "driven_lanedir_consec": 0.4749023034502904, "sim_compute_sim_state": 0.02397236925490359, "sim_compute_performance-ego": 0.039763724550287774, "sim_compute_robot_state-ego": 0.04162657007257989}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5747899276089776, "sim_physics": 0.05903109312057495, "survival_time": 14.950000000000076, "driven_lanedir": 2.0867744273159223, "sim_render-ego": 0.03668107509613037, "in-drivable-lane": 5.700000000000038, "agent_compute-ego": 0.06191034078598023, "deviation-heading": 2.0311912077372813, "set_robot_commands": 0.056231749852498375, "deviation-center-line": 1.0083455915519175, "driven_lanedir_consec": 2.0867744273159223, "sim_compute_sim_state": 0.023961760997772218, "sim_compute_performance-ego": 0.03984642426172892, "sim_compute_robot_state-ego": 0.042424565156300865}}
set_robot_commands_max0.05629794805952646
set_robot_commands_mean0.05562968736855347
set_robot_commands_median0.05559984673845007
set_robot_commands_min0.05451978246370951
sim_compute_performance-ego_max0.039986962253607594
sim_compute_performance-ego_mean0.0397904544292079
sim_compute_performance-ego_median0.03976955084965147
sim_compute_performance-ego_min0.03958561023076376
sim_compute_robot_state-ego_max0.042424565156300865
sim_compute_robot_state-ego_mean0.042045672513302074
sim_compute_robot_state-ego_median0.0423379714290301
sim_compute_robot_state-ego_min0.041496494441356474
sim_compute_sim_state_max0.024452291685959388
sim_compute_sim_state_mean0.02397597967426642
sim_compute_sim_state_median0.023961760997772218
sim_compute_sim_state_min0.023630431554849864
sim_physics_max0.061319244668838827
sim_physics_mean0.05974671147408136
sim_physics_median0.0595581183830897
sim_physics_min0.058296263796611895
sim_render-ego_max0.03671168773732287
sim_render-ego_mean0.03638204553390651
sim_render-ego_median0.036360789989602973
sim_render-ego_min0.03604211409886678
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.740000000000012
survival_time_min1.4500000000000006
No reset possible
218083288Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-73570:08:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.347430185896025
survival_time_median6.299999999999986
deviation-center-line_median0.523954968185391
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06511637947776101
agent_compute-ego_mean0.062055201884127976
agent_compute-ego_median0.06271078382219587
agent_compute-ego_min0.05765869693150596
deviation-center-line_max1.3206346703630576
deviation-center-line_mean0.5915728614917056
deviation-center-line_min0.181837816518737
deviation-heading_max1.1458186742637968
deviation-heading_mean0.7851066758084461
deviation-heading_median0.8609675026330511
deviation-heading_min0.319897731200263
driven_any_max3.574771769069984
driven_any_mean1.6036023568185958
driven_any_median1.4591898989813483
driven_any_min0.3463657768117521
driven_lanedir_consec_max2.2414804490698663
driven_lanedir_consec_mean1.1872211678449418
driven_lanedir_consec_min0.3411866468571163
driven_lanedir_max2.2414804490698663
driven_lanedir_mean1.1872211678449418
driven_lanedir_median1.347430185896025
driven_lanedir_min0.3411866468571163
in-drivable-lane_max5.4000000000000625
in-drivable-lane_mean1.6300000000000132
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0467477371846083, "sim_physics": 0.057542945316859655, "survival_time": 8.74999999999999, "driven_lanedir": 1.347430185896025, "sim_render-ego": 0.037027473449707034, "in-drivable-lane": 2.7500000000000027, "agent_compute-ego": 0.06271078382219587, "deviation-heading": 0.9610541952833782, "set_robot_commands": 0.05628566196986607, "deviation-center-line": 0.7117242306222539, "driven_lanedir_consec": 1.347430185896025, "sim_compute_sim_state": 0.02384265899658203, "sim_compute_performance-ego": 0.039841134207589286, "sim_compute_robot_state-ego": 0.04206439290727888}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4591898989813483, "sim_physics": 0.0574365324444241, "survival_time": 6.299999999999986, "driven_lanedir": 1.4315622321123618, "sim_render-ego": 0.03671402969057598, "in-drivable-lane": 0, "agent_compute-ego": 0.05765869693150596, "deviation-heading": 1.1458186742637968, "set_robot_commands": 0.055755325726100376, "deviation-center-line": 0.523954968185391, "driven_lanedir_consec": 1.4315622321123618, "sim_compute_sim_state": 0.023880547947353788, "sim_compute_performance-ego": 0.039684602192470005, "sim_compute_robot_state-ego": 0.0417759342799111}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3463657768117521, "sim_physics": 0.062231036594935826, "survival_time": 1.7500000000000009, "driven_lanedir": 0.3411866468571163, "sim_render-ego": 0.03626339776175363, "in-drivable-lane": 0, "agent_compute-ego": 0.061285693304879325, "deviation-heading": 0.319897731200263, "set_robot_commands": 0.055706323896135605, "deviation-center-line": 0.181837816518737, "driven_lanedir_consec": 0.3411866468571163, "sim_compute_sim_state": 0.024058668954031807, "sim_compute_performance-ego": 0.039662953785487585, "sim_compute_robot_state-ego": 0.04219489097595215}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5909366020452861, "sim_physics": 0.058096634257923475, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5744463252893395, "sim_render-ego": 0.03627279021523216, "in-drivable-lane": 0, "agent_compute-ego": 0.06511637947776101, "deviation-heading": 0.637795275661741, "set_robot_commands": 0.05572604266079989, "deviation-center-line": 0.21971262176908885, "driven_lanedir_consec": 0.5744463252893395, "sim_compute_sim_state": 0.023631451346657492, "sim_compute_performance-ego": 0.04247978383844549, "sim_compute_robot_state-ego": 0.043051199479536575}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.574771769069984, "sim_physics": 0.057259129683176674, "survival_time": 14.950000000000076, "driven_lanedir": 2.2414804490698663, "sim_render-ego": 0.04112652699152629, "in-drivable-lane": 5.4000000000000625, "agent_compute-ego": 0.06350445588429769, "deviation-heading": 0.8609675026330511, "set_robot_commands": 0.05558971087137858, "deviation-center-line": 1.3206346703630576, "driven_lanedir_consec": 2.2414804490698663, "sim_compute_sim_state": 0.02376933495203654, "sim_compute_performance-ego": 0.03934644460678101, "sim_compute_robot_state-ego": 0.04194312572479248}}
set_robot_commands_max0.05628566196986607
set_robot_commands_mean0.05581261302485611
set_robot_commands_median0.05572604266079989
set_robot_commands_min0.05558971087137858
sim_compute_performance-ego_max0.04247978383844549
sim_compute_performance-ego_mean0.04020298372615467
sim_compute_performance-ego_median0.039684602192470005
sim_compute_performance-ego_min0.03934644460678101
sim_compute_robot_state-ego_max0.043051199479536575
sim_compute_robot_state-ego_mean0.04220590867349423
sim_compute_robot_state-ego_median0.04206439290727888
sim_compute_robot_state-ego_min0.0417759342799111
sim_compute_sim_state_max0.024058668954031807
sim_compute_sim_state_mean0.02383653243933233
sim_compute_sim_state_median0.02384265899658203
sim_compute_sim_state_min0.023631451346657492
sim_physics_max0.062231036594935826
sim_physics_mean0.05851325565946395
sim_physics_median0.057542945316859655
sim_physics_min0.057259129683176674
sim_render-ego_max0.04112652699152629
sim_render-ego_mean0.03748084362175902
sim_render-ego_median0.03671402969057598
sim_render-ego_min0.03626339776175363
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.900000000000011
survival_time_min1.7500000000000009
No reset possible
218053285jiang pengThird test - THaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-73570:12:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.568542104280338
survival_time_median14.700000000000074
deviation-center-line_median1.1961563938442314
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.09732860682970024
agent_compute-ego_mean0.09648219557723713
agent_compute-ego_median0.09649521963936944
agent_compute-ego_min0.09540212397672693
deviation-center-line_max1.7201401067701765
deviation-center-line_mean1.158085235293566
deviation-center-line_min0.17555135586469817
deviation-heading_max4.656086686860034
deviation-heading_mean3.3901661451967593
deviation-heading_median3.839797615077244
deviation-heading_min0.8148978379369916
driven_any_max3.8556704376914888
driven_any_mean2.5721023009571047
driven_any_median2.6695828459430824
driven_any_min1.0205429619753148
driven_lanedir_consec_max3.6533824570673734
driven_lanedir_consec_mean2.2755450549589136
driven_lanedir_consec_min0.8989199599458219
driven_lanedir_max3.6533824570673734
driven_lanedir_mean2.407981186045002
driven_lanedir_median2.568542104280338
driven_lanedir_min0.8989199599458219
in-drivable-lane_max1.7499999999999938
in-drivable-lane_mean0.4599999999999994
in-drivable-lane_min0.05000000000000071
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.6695828459430824, "sim_physics": 0.05690287590026855, "survival_time": 14.950000000000076, "driven_lanedir": 2.568542104280338, "sim_render-ego": 0.03586267948150635, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09686245838801066, "deviation-heading": 3.839797615077244, "set_robot_commands": 0.054718236923217776, "deviation-center-line": 1.602515896180432, "driven_lanedir_consec": 2.568542104280338, "sim_compute_sim_state": 0.02281388203303019, "sim_compute_performance-ego": 0.038250412940979, "sim_compute_robot_state-ego": 0.04039778153101603}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0205429619753148, "sim_physics": 0.05985201621542171, "survival_time": 2.4499999999999993, "driven_lanedir": 0.8989199599458219, "sim_render-ego": 0.034864931690449616, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.09540212397672693, "deviation-heading": 0.8148978379369916, "set_robot_commands": 0.05299474268543477, "deviation-center-line": 0.17555135586469817, "driven_lanedir_consec": 0.8989199599458219, "sim_compute_sim_state": 0.022691429877767757, "sim_compute_performance-ego": 0.03804122671789052, "sim_compute_robot_state-ego": 0.0402719293321882}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.8556704376914888, "sim_physics": 0.058374953918716534, "survival_time": 14.700000000000074, "driven_lanedir": 3.6533824570673734, "sim_render-ego": 0.036264087067169395, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.09649521963936944, "deviation-heading": 3.8756076857782102, "set_robot_commands": 0.05382746336411456, "deviation-center-line": 1.1961563938442314, "driven_lanedir_consec": 3.6533824570673734, "sim_compute_sim_state": 0.022795086815243677, "sim_compute_performance-ego": 0.03817202039316398, "sim_compute_robot_state-ego": 0.04067928044974398}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.022137747676995, "sim_physics": 0.05281235687286255, "survival_time": 12.550000000000043, "driven_lanedir": 1.869368103015384, "sim_render-ego": 0.03520068419407089, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.09732860682970024, "deviation-heading": 4.656086686860034, "set_robot_commands": 0.05372080954897451, "deviation-center-line": 1.0960624238082917, "driven_lanedir_consec": 1.2071874475849405, "sim_compute_sim_state": 0.022781515501409888, "sim_compute_performance-ego": 0.03892903783881807, "sim_compute_robot_state-ego": 0.040516001294808555}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.292577511498644, "sim_physics": 0.057200868924458824, "survival_time": 14.950000000000076, "driven_lanedir": 3.049693305916093, "sim_render-ego": 0.03603246132532756, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.09632256905237832, "deviation-heading": 3.764440900331316, "set_robot_commands": 0.05383500576019287, "deviation-center-line": 1.7201401067701765, "driven_lanedir_consec": 3.049693305916093, "sim_compute_sim_state": 0.02289351463317871, "sim_compute_performance-ego": 0.03808191458384196, "sim_compute_robot_state-ego": 0.04037259737650553}}
set_robot_commands_max0.054718236923217776
set_robot_commands_mean0.0538192516563869
set_robot_commands_median0.05382746336411456
set_robot_commands_min0.05299474268543477
sim_compute_performance-ego_max0.03892903783881807
sim_compute_performance-ego_mean0.03829492249493871
sim_compute_performance-ego_median0.03817202039316398
sim_compute_performance-ego_min0.03804122671789052
sim_compute_robot_state-ego_max0.04067928044974398
sim_compute_robot_state-ego_mean0.040447517996852464
sim_compute_robot_state-ego_median0.04039778153101603
sim_compute_robot_state-ego_min0.0402719293321882
sim_compute_sim_state_max0.02289351463317871
sim_compute_sim_state_mean0.022795085772126043
sim_compute_sim_state_median0.022795086815243677
sim_compute_sim_state_min0.022691429877767757
sim_physics_max0.05985201621542171
sim_physics_mean0.05702861436634563
sim_physics_median0.057200868924458824
sim_physics_min0.05281235687286255
sim_render-ego_max0.036264087067169395
sim_render-ego_mean0.03564496875170477
sim_render-ego_median0.03586267948150635
sim_render-ego_min0.034864931690449616
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.920000000000051
survival_time_min2.4499999999999993
No reset possible
218043284Angel Woo 🇭🇰Roasted duckaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-73570:09:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3449317774451037
survival_time_median5.249999999999989
deviation-center-line_median0.3080074464502732
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.12460820763199418
agent_compute-ego_mean0.12254613016466
agent_compute-ego_median0.12229212284088135
agent_compute-ego_min0.121344340474982
deviation-center-line_max0.898091305232166
deviation-center-line_mean0.42588102702
deviation-center-line_min0.28034543576690246
deviation-heading_max2.0889619833065596
deviation-heading_mean1.7451518522242462
deviation-heading_median1.790765481020634
deviation-heading_min1.0826927831606985
driven_any_max1.0947424899660012
driven_any_mean0.5699679385413926
driven_any_median0.39280007990622895
driven_any_min0.19363056591156075
driven_lanedir_consec_max1.0774555052077512
driven_lanedir_consec_mean0.50535972918085
driven_lanedir_consec_min0.1774628033166885
driven_lanedir_max1.0774555052077512
driven_lanedir_mean0.50535972918085
driven_lanedir_median0.3449317774451037
driven_lanedir_min0.1774628033166885
in-drivable-lane_max1.900000000000027
in-drivable-lane_mean0.4500000000000052
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0947424899660012, "sim_physics": 0.05477834304173788, "survival_time": 14.950000000000076, "driven_lanedir": 1.0774555052077512, "sim_render-ego": 0.035223063627878824, "in-drivable-lane": 0, "agent_compute-ego": 0.12229212284088135, "deviation-heading": 2.0889619833065596, "set_robot_commands": 0.05453743855158488, "deviation-center-line": 0.898091305232166, "driven_lanedir_consec": 1.0774555052077512, "sim_compute_sim_state": 0.022484488487243652, "sim_compute_performance-ego": 0.038732449213663735, "sim_compute_robot_state-ego": 0.03976092259089152}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8662035860626117, "sim_physics": 0.05173936580640698, "survival_time": 11.050000000000022, "driven_lanedir": 0.6824635168306054, "sim_render-ego": 0.03441923560060527, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.12290621019596427, "deviation-heading": 1.790765481020634, "set_robot_commands": 0.05381583196545079, "deviation-center-line": 0.3603733055817164, "driven_lanedir_consec": 0.6824635168306054, "sim_compute_sim_state": 0.022490924300111795, "sim_compute_performance-ego": 0.038003207331868856, "sim_compute_robot_state-ego": 0.03982999853418963}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.19363056591156075, "sim_physics": 0.05334242603235077, "survival_time": 2.849999999999998, "driven_lanedir": 0.1774628033166885, "sim_render-ego": 0.03407480842188785, "in-drivable-lane": 0, "agent_compute-ego": 0.121344340474982, "deviation-heading": 1.0826927831606985, "set_robot_commands": 0.05814989826135468, "deviation-center-line": 0.3080074464502732, "driven_lanedir_consec": 0.1774628033166885, "sim_compute_sim_state": 0.02240577078702157, "sim_compute_performance-ego": 0.03796014451144034, "sim_compute_robot_state-ego": 0.039394604532342205}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.30246297086056, "sim_physics": 0.05744265038290142, "survival_time": 4.049999999999994, "driven_lanedir": 0.24448504310410124, "sim_render-ego": 0.034932095327495055, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.12460820763199418, "deviation-heading": 1.9939231128879016, "set_robot_commands": 0.05387366259539569, "deviation-center-line": 0.28034543576690246, "driven_lanedir_consec": 0.24448504310410124, "sim_compute_sim_state": 0.022377791228117765, "sim_compute_performance-ego": 0.03827148307988673, "sim_compute_robot_state-ego": 0.039887972819952315}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.39280007990622895, "sim_physics": 0.056009129115513395, "survival_time": 5.249999999999989, "driven_lanedir": 0.3449317774451037, "sim_render-ego": 0.035376492000761484, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.12157976967947824, "deviation-heading": 1.7694159007454373, "set_robot_commands": 0.05369053341093517, "deviation-center-line": 0.28258764206894177, "driven_lanedir_consec": 0.3449317774451037, "sim_compute_sim_state": 0.02243329229808989, "sim_compute_performance-ego": 0.03756539935157412, "sim_compute_robot_state-ego": 0.03984330722263881}}
set_robot_commands_max0.05814989826135468
set_robot_commands_mean0.05481347295694424
set_robot_commands_median0.05387366259539569
set_robot_commands_min0.05369053341093517
sim_compute_performance-ego_max0.038732449213663735
sim_compute_performance-ego_mean0.03810653669768676
sim_compute_performance-ego_median0.038003207331868856
sim_compute_performance-ego_min0.03756539935157412
sim_compute_robot_state-ego_max0.039887972819952315
sim_compute_robot_state-ego_mean0.039743361140002896
sim_compute_robot_state-ego_median0.03982999853418963
sim_compute_robot_state-ego_min0.039394604532342205
sim_compute_sim_state_max0.022490924300111795
sim_compute_sim_state_mean0.02243845342011694
sim_compute_sim_state_median0.02243329229808989
sim_compute_sim_state_min0.022377791228117765
sim_physics_max0.05744265038290142
sim_physics_mean0.05466238287578209
sim_physics_median0.05477834304173788
sim_physics_min0.05173936580640698
sim_render-ego_max0.035376492000761484
sim_render-ego_mean0.034805138995725696
sim_render-ego_median0.034932095327495055
sim_render-ego_min0.03407480842188785
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.630000000000015
survival_time_min2.849999999999998
No reset possible
217953275jiang pengRL - TH -hhkaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-73570:13:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.696254433457334
survival_time_median14.950000000000076
deviation-center-line_median0.7480488627233534
in-drivable-lane_median3.049999999999991


other stats
agent_compute-ego_max0.10096181869506836
agent_compute-ego_mean0.0988150524081606
agent_compute-ego_median0.09794785181681316
agent_compute-ego_min0.09725211302439372
deviation-center-line_max0.9426633697461032
deviation-center-line_mean0.6620667925024297
deviation-center-line_min0.22108896407682324
deviation-heading_max5.7009185761023335
deviation-heading_mean2.697582487535169
deviation-heading_median2.3959938066521467
deviation-heading_min1.0879900405964016
driven_any_max4.1342306768558
driven_any_mean2.839099736680933
driven_any_median3.3364509491982193
driven_any_min1.1611401864437214
driven_lanedir_consec_max3.1619974288963424
driven_lanedir_consec_mean2.0295506323158015
driven_lanedir_consec_min1.1457475407122466
driven_lanedir_max3.1619974288963424
driven_lanedir_mean2.0295506323158015
driven_lanedir_median1.696254433457334
driven_lanedir_min1.1457475407122466
in-drivable-lane_max10.350000000000067
in-drivable-lane_mean3.870000000000023
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.4950671666846067, "sim_physics": 0.05819287697474162, "survival_time": 14.950000000000076, "driven_lanedir": 1.364331280191457, "sim_render-ego": 0.03583584626515706, "in-drivable-lane": 10.350000000000067, "agent_compute-ego": 0.09794785181681316, "deviation-heading": 1.0879900405964016, "set_robot_commands": 0.05478564898173014, "deviation-center-line": 0.22108896407682324, "driven_lanedir_consec": 1.364331280191457, "sim_compute_sim_state": 0.02280569553375244, "sim_compute_performance-ego": 0.03830567995707194, "sim_compute_robot_state-ego": 0.04033810456593832}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.1342306768558, "sim_physics": 0.05617347796758016, "survival_time": 14.950000000000076, "driven_lanedir": 3.1619974288963424, "sim_render-ego": 0.03530182600021362, "in-drivable-lane": 4.4000000000000625, "agent_compute-ego": 0.09727319240570068, "deviation-heading": 2.4927016733624607, "set_robot_commands": 0.05462793986002605, "deviation-center-line": 0.9426633697461032, "driven_lanedir_consec": 3.1619974288963424, "sim_compute_sim_state": 0.022765774726867676, "sim_compute_performance-ego": 0.03849088907241821, "sim_compute_robot_state-ego": 0.04149206717809041}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.068609704222319, "sim_physics": 0.06126334992322055, "survival_time": 8.79999999999999, "driven_lanedir": 1.696254433457334, "sim_render-ego": 0.03712644089352001, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.100640286098827, "deviation-heading": 1.8103083409625007, "set_robot_commands": 0.05550524592399597, "deviation-center-line": 0.6222241863629139, "driven_lanedir_consec": 1.696254433457334, "sim_compute_sim_state": 0.024115265770391983, "sim_compute_performance-ego": 0.04052106494253332, "sim_compute_robot_state-ego": 0.04107979481870478}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1611401864437214, "sim_physics": 0.05836130539576213, "survival_time": 14.950000000000076, "driven_lanedir": 1.1457475407122466, "sim_render-ego": 0.0392068362236023, "in-drivable-lane": 0, "agent_compute-ego": 0.10096181869506836, "deviation-heading": 5.7009185761023335, "set_robot_commands": 0.05600933392842611, "deviation-center-line": 0.7763085796029547, "driven_lanedir_consec": 1.1457475407122466, "sim_compute_sim_state": 0.023897763888041174, "sim_compute_performance-ego": 0.04092652559280396, "sim_compute_robot_state-ego": 0.041851043701171875}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.3364509491982193, "sim_physics": 0.05436462561289469, "survival_time": 14.950000000000076, "driven_lanedir": 2.779422478321627, "sim_render-ego": 0.03553480545679728, "in-drivable-lane": 3.049999999999991, "agent_compute-ego": 0.09725211302439372, "deviation-heading": 2.3959938066521467, "set_robot_commands": 0.05462106386820475, "deviation-center-line": 0.7480488627233534, "driven_lanedir_consec": 2.779422478321627, "sim_compute_sim_state": 0.02288945595423381, "sim_compute_performance-ego": 0.03867825667063395, "sim_compute_robot_state-ego": 0.039923094908396406}}
set_robot_commands_max0.05600933392842611
set_robot_commands_mean0.0551098465124766
set_robot_commands_median0.05478564898173014
set_robot_commands_min0.05462106386820475
sim_compute_performance-ego_max0.04092652559280396
sim_compute_performance-ego_mean0.039384483247092275
sim_compute_performance-ego_median0.03867825667063395
sim_compute_performance-ego_min0.03830567995707194
sim_compute_robot_state-ego_max0.041851043701171875
sim_compute_robot_state-ego_mean0.04093682103446035
sim_compute_robot_state-ego_median0.04107979481870478
sim_compute_robot_state-ego_min0.039923094908396406
sim_compute_sim_state_max0.024115265770391983
sim_compute_sim_state_mean0.02329479117465742
sim_compute_sim_state_median0.02288945595423381
sim_compute_sim_state_min0.022765774726867676
sim_physics_max0.06126334992322055
sim_physics_mean0.05767112717483983
sim_physics_median0.05819287697474162
sim_physics_min0.05436462561289469
sim_render-ego_max0.0392068362236023
sim_render-ego_mean0.03660115096785806
sim_render-ego_median0.03583584626515706
sim_render-ego_min0.03530182600021362
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.72000000000006
survival_time_min8.79999999999999
No reset possible
217893269jiang pengFirst test - THaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-42-167-73570:22:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0589195769255895
survival_time_median14.950000000000076
deviation-center-line_median1.0969556306255874
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.09675809701283772
agent_compute-ego_mean0.09625913365681966
agent_compute-ego_median0.09651647726694744
agent_compute-ego_min0.0953336278597514
deviation-center-line_max1.2878375257296713
deviation-center-line_mean1.151244341516025
deviation-center-line_min1.0526428385598516
deviation-heading_max8.902604011589787
deviation-heading_mean4.005554836281783
deviation-heading_median2.9567602742051213
deviation-heading_min2.344675878221125
driven_any_max4.837615398835928
driven_any_mean3.737015422768783
driven_any_median4.425950499520873
driven_any_min0.6029807392837757
driven_lanedir_consec_max4.152156616935665
driven_lanedir_consec_mean2.964252739944146
driven_lanedir_consec_min0.5955930647007972
driven_lanedir_max4.152274097236139
driven_lanedir_mean2.9644118897840435
driven_lanedir_median3.059135408140441
driven_lanedir_min0.5955930647007972
in-drivable-lane_max4.250000000000028
in-drivable-lane_mean1.890000000000012
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 4.788714937681327, "sim_physics": 0.0979462742805481, "survival_time": 14.950000000000076, "driven_lanedir": 4.152274097236139, "sim_render-ego": 0.03539883375167847, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.09675809701283772, "deviation-heading": 2.994364137987497, "set_robot_commands": 0.05720765352249146, "deviation-center-line": 1.0526428385598516, "driven_lanedir_consec": 4.152156616935665, "sim_compute_sim_state": 0.02231491724650065, "sim_compute_performance-ego": 0.03806467533111573, "sim_compute_robot_state-ego": 0.04034732421239217, "sim_compute_robot_state-npc0": 0.03973529815673829, "sim_compute_robot_state-npc1": 0.03897545178731283, "sim_compute_robot_state-npc2": 0.03871451457341512, "sim_compute_robot_state-npc3": 0.03877326250076294}, "udem1-1-0": {"driven_any": 0.6029807392837757, "sim_physics": 0.09881197849909464, "survival_time": 14.950000000000076, "driven_lanedir": 0.5955930647007972, "sim_render-ego": 0.035074647267659506, "in-drivable-lane": 0, "agent_compute-ego": 0.0953336278597514, "deviation-heading": 8.902604011589787, "set_robot_commands": 0.05388511339823405, "deviation-center-line": 1.2878375257296713, "driven_lanedir_consec": 0.5955930647007972, "sim_compute_sim_state": 0.022072909673055013, "sim_compute_performance-ego": 0.03801942984263102, "sim_compute_robot_state-ego": 0.04003801584243774, "sim_compute_robot_state-npc0": 0.04197445551554362, "sim_compute_robot_state-npc1": 0.03871854543685913, "sim_compute_robot_state-npc2": 0.03852875232696533, "sim_compute_robot_state-npc3": 0.03862658739089966}, "udem1-2-0": {"driven_any": 4.425950499520873, "sim_physics": 0.1070475991566976, "survival_time": 14.950000000000076, "driven_lanedir": 3.033724925261151, "sim_render-ego": 0.035486944516499835, "in-drivable-lane": 3.850000000000037, "agent_compute-ego": 0.0959775964419047, "deviation-heading": 2.829369879405387, "set_robot_commands": 0.05396465539932251, "deviation-center-line": 1.0581907255681706, "driven_lanedir_consec": 3.0332624875769905, "sim_compute_sim_state": 0.021970985730489095, "sim_compute_performance-ego": 0.03761926174163818, "sim_compute_robot_state-ego": 0.040985348224639895, "sim_compute_robot_state-npc0": 0.03928305149078369, "sim_compute_robot_state-npc1": 0.03868320862452189, "sim_compute_robot_state-npc2": 0.038314075469970704, "sim_compute_robot_state-npc3": 0.03862882932027181}, "udem1-3-0": {"driven_any": 4.837615398835928, "sim_physics": 0.1043912982940674, "survival_time": 14.950000000000076, "driven_lanedir": 3.059135408140441, "sim_render-ego": 0.03517599185307821, "in-drivable-lane": 4.250000000000028, "agent_compute-ego": 0.09670986970265706, "deviation-heading": 2.9567602742051213, "set_robot_commands": 0.05511754592259725, "deviation-center-line": 1.0969556306255874, "driven_lanedir_consec": 3.0589195769255895, "sim_compute_sim_state": 0.02204362869262695, "sim_compute_performance-ego": 0.0375812037785848, "sim_compute_robot_state-ego": 0.03967310905456543, "sim_compute_robot_state-npc0": 0.039161829153696696, "sim_compute_robot_state-npc1": 0.03858659108479818, "sim_compute_robot_state-npc2": 0.03823769728342692, "sim_compute_robot_state-npc3": 0.0384618878364563}, "udem1-4-0": {"driven_any": 4.029815538522011, "sim_physics": 0.1020731520652771, "survival_time": 14.950000000000076, "driven_lanedir": 3.98133195358169, "sim_render-ego": 0.03495578130086263, "in-drivable-lane": 0, "agent_compute-ego": 0.09651647726694744, "deviation-heading": 2.344675878221125, "set_robot_commands": 0.053840067386627194, "deviation-center-line": 1.260594987096844, "driven_lanedir_consec": 3.98133195358169, "sim_compute_sim_state": 0.021847176551818847, "sim_compute_performance-ego": 0.03759788990020752, "sim_compute_robot_state-ego": 0.039533289273579915, "sim_compute_robot_state-npc0": 0.03912205934524536, "sim_compute_robot_state-npc1": 0.038419560591379805, "sim_compute_robot_state-npc2": 0.03807205279668172, "sim_compute_robot_state-npc3": 0.03972354014714559}}
set_robot_commands_max0.05720765352249146
set_robot_commands_mean0.05480300712585449
set_robot_commands_median0.05396465539932251
set_robot_commands_min0.053840067386627194
sim_compute_performance-ego_max0.03806467533111573
sim_compute_performance-ego_mean0.03777649211883545
sim_compute_performance-ego_median0.03761926174163818
sim_compute_performance-ego_min0.0375812037785848
sim_compute_robot_state-ego_max0.040985348224639895
sim_compute_robot_state-ego_mean0.04011541732152303
sim_compute_robot_state-ego_median0.04003801584243774
sim_compute_robot_state-ego_min0.039533289273579915
sim_compute_robot_state-npc0_max0.04197445551554362
sim_compute_robot_state-npc0_mean0.03985533873240153
sim_compute_robot_state-npc0_median0.03928305149078369
sim_compute_robot_state-npc0_min0.03912205934524536
sim_compute_robot_state-npc1_max0.03897545178731283
sim_compute_robot_state-npc1_mean0.03867667150497437
sim_compute_robot_state-npc1_median0.03868320862452189
sim_compute_robot_state-npc1_min0.038419560591379805
sim_compute_robot_state-npc2_max0.03871451457341512
sim_compute_robot_state-npc2_mean0.03837341849009195
sim_compute_robot_state-npc2_median0.038314075469970704
sim_compute_robot_state-npc2_min0.03807205279668172
sim_compute_robot_state-npc3_max0.03972354014714559
sim_compute_robot_state-npc3_mean0.03884282143910726
sim_compute_robot_state-npc3_median0.03862882932027181
sim_compute_robot_state-npc3_min0.0384618878364563
sim_compute_sim_state_max0.02231491724650065
sim_compute_sim_state_mean0.022049923578898113
sim_compute_sim_state_median0.02204362869262695
sim_compute_sim_state_min0.021847176551818847
sim_physics_max0.1070475991566976
sim_physics_mean0.10205406045913697
sim_physics_median0.1020731520652771
sim_physics_min0.0979462742805481
sim_render-ego_max0.035486944516499835
sim_render-ego_mean0.03521843973795573
sim_render-ego_median0.03517599185307821
sim_render-ego_min0.03495578130086263
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
217833268Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-73570:09:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.788507381867637
survival_time_median4.499999999999992
deviation-center-line_median0.3199211934701053
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.07724432851753983
agent_compute-ego_mean0.07459531533855501
agent_compute-ego_median0.07604418436686199
agent_compute-ego_min0.07090672969818115
deviation-center-line_max1.0216620460388963
deviation-center-line_mean0.46336542412529297
deviation-center-line_min0.20301050426006703
deviation-heading_max2.9912012776457844
deviation-heading_mean1.2647040938999794
deviation-heading_median1.152064661594279
deviation-heading_min0.3105644034386246
driven_any_max3.5747536290514197
driven_any_mean1.43483464980255
driven_any_median1.01894055886202
driven_any_min0.529789256218238
driven_lanedir_consec_max2.3258595922457266
driven_lanedir_consec_mean1.040468424502097
driven_lanedir_consec_min0.510726526921605
driven_lanedir_max2.3258595922457266
driven_lanedir_mean1.040468424502097
driven_lanedir_median0.788507381867637
driven_lanedir_min0.510726526921605
in-drivable-lane_max4.400000000000037
in-drivable-lane_mean1.3400000000000056
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.5086694108334886, "sim_physics": 0.08259885183727468, "survival_time": 6.549999999999985, "driven_lanedir": 1.0391533698076671, "sim_render-ego": 0.04642884239895653, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.0767549303651766, "deviation-heading": 1.2359771896373517, "set_robot_commands": 0.0707396405343791, "deviation-center-line": 0.4836084028000766, "driven_lanedir_consec": 1.0391533698076671, "sim_compute_sim_state": 0.03069473040922907, "sim_compute_performance-ego": 0.04963130441330771, "sim_compute_robot_state-ego": 0.05409693171959797}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.01894055886202, "sim_physics": 0.07745087146759033, "survival_time": 4.499999999999992, "driven_lanedir": 0.788507381867637, "sim_render-ego": 0.0452905813852946, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.07202640374501547, "deviation-heading": 1.152064661594279, "set_robot_commands": 0.07058922714657254, "deviation-center-line": 0.3199211934701053, "driven_lanedir_consec": 0.788507381867637, "sim_compute_sim_state": 0.02859985033671061, "sim_compute_performance-ego": 0.04886198838551839, "sim_compute_robot_state-ego": 0.05409284697638617}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5420203940475832, "sim_physics": 0.09129971616408404, "survival_time": 2.549999999999999, "driven_lanedir": 0.5380952516678494, "sim_render-ego": 0.04467086231007295, "in-drivable-lane": 0, "agent_compute-ego": 0.07724432851753983, "deviation-heading": 0.3105644034386246, "set_robot_commands": 0.07488165182225845, "deviation-center-line": 0.2886249740573196, "driven_lanedir_consec": 0.5380952516678494, "sim_compute_sim_state": 0.030051254758647845, "sim_compute_performance-ego": 0.05344278204674814, "sim_compute_robot_state-ego": 0.057172167534921686}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.529789256218238, "sim_physics": 0.08747447013854981, "survival_time": 2.499999999999999, "driven_lanedir": 0.510726526921605, "sim_render-ego": 0.04508586406707764, "in-drivable-lane": 0, "agent_compute-ego": 0.07090672969818115, "deviation-heading": 0.6337129371838571, "set_robot_commands": 0.06422901630401612, "deviation-center-line": 0.20301050426006703, "driven_lanedir_consec": 0.510726526921605, "sim_compute_sim_state": 0.0290198278427124, "sim_compute_performance-ego": 0.048662242889404295, "sim_compute_robot_state-ego": 0.05197307586669922}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5747536290514197, "sim_physics": 0.07853020985921223, "survival_time": 14.950000000000076, "driven_lanedir": 2.3258595922457266, "sim_render-ego": 0.047385289669036865, "in-drivable-lane": 4.400000000000037, "agent_compute-ego": 0.07604418436686199, "deviation-heading": 2.9912012776457844, "set_robot_commands": 0.06970048983891805, "deviation-center-line": 1.0216620460388963, "driven_lanedir_consec": 2.3258595922457266, "sim_compute_sim_state": 0.030755765438079834, "sim_compute_performance-ego": 0.05198639710744222, "sim_compute_robot_state-ego": 0.05504519859949747}}
set_robot_commands_max0.07488165182225845
set_robot_commands_mean0.07002800512922887
set_robot_commands_median0.07058922714657254
set_robot_commands_min0.06422901630401612
sim_compute_performance-ego_max0.05344278204674814
sim_compute_performance-ego_mean0.05051694296848416
sim_compute_performance-ego_median0.04963130441330771
sim_compute_performance-ego_min0.048662242889404295
sim_compute_robot_state-ego_max0.057172167534921686
sim_compute_robot_state-ego_mean0.05447604413942051
sim_compute_robot_state-ego_median0.05409693171959797
sim_compute_robot_state-ego_min0.05197307586669922
sim_compute_sim_state_max0.030755765438079834
sim_compute_sim_state_mean0.029824285757075953
sim_compute_sim_state_median0.030051254758647845
sim_compute_sim_state_min0.02859985033671061
sim_physics_max0.09129971616408404
sim_physics_mean0.08347082389334222
sim_physics_median0.08259885183727468
sim_physics_min0.07745087146759033
sim_render-ego_max0.047385289669036865
sim_render-ego_mean0.04577228796608772
sim_render-ego_median0.0452905813852946
sim_render-ego_min0.04467086231007295
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.21000000000001
survival_time_min2.499999999999999
No reset possible
217592864Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-42-167-73570:58:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-42-167-7357-job21759/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217163078Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-42-167-73571:01:37
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3078/step1-simulation-ip-172-31-42-167-7357-job21716/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217062612Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-42-167-73570:29:20
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 491, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1032, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1187, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1234, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2612/step1-simulation-ip-172-31-42-167-7357-job21706/tmp/tmp4cjqe_8p/episodes/udem1-2-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible