Duckietown Challenges Home Challenges Submissions

Submission 3848

Submission3848
Competingyes
Challengeaido2-LF-sim-testing-offseason
UserJunghyun Seo 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 24058
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
24058step1-simulationsuccessyes0:08:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1229443581134273
survival_time_median1.3500000000000003
deviation-center-line_median0.07666609549956557
in-drivable-lane_median0


other stats
agent_compute-ego_max0.11029372612635296
agent_compute-ego_mean0.09718670064441325
agent_compute-ego_median0.09571255170381986
agent_compute-ego_min0.09446550499309192
deviation-center-line_max0.13280535346761538
deviation-center-line_mean0.08341721544931532
deviation-center-line_min0.044634091985992545
deviation-heading_max1.0509843201450328
deviation-heading_mean0.7268228368430759
deviation-heading_median0.7571356106125486
deviation-heading_min0.4407891421364369
driven_any_max0.24341132515354225
driven_any_mean0.1782360757850334
driven_any_median0.17394321290463016
driven_any_min0.1231734531965312
driven_lanedir_consec_max0.19202791779080508
driven_lanedir_consec_mean0.11795308596805625
driven_lanedir_consec_min0.058553136577239595
driven_lanedir_max0.19202791779080508
driven_lanedir_mean0.11795308596805625
driven_lanedir_median0.1229443581134273
driven_lanedir_min0.058553136577239595
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.08000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21784388970386043, "sim_physics": 0.059850431978702545, "survival_time": 1.6000000000000008, "driven_lanedir": 0.13562462050107582, "sim_render-ego": 0.03619995713233948, "in-drivable-lane": 0, "agent_compute-ego": 0.10377609729766846, "deviation-heading": 1.0509843201450328, "set_robot_commands": 0.055401675403118134, "deviation-center-line": 0.10424047374846002, "driven_lanedir_consec": 0.13562462050107582, "sim_compute_sim_state": 0.023091517388820648, "sim_compute_performance-ego": 0.03881244361400604, "sim_compute_robot_state-ego": 0.040485478937625885}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.24341132515354225, "sim_physics": 0.059744467054094585, "survival_time": 1.7500000000000009, "driven_lanedir": 0.17236304027848937, "sim_render-ego": 0.03575107710702079, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09633346966334752, "deviation-heading": 0.8881560403107783, "set_robot_commands": 0.05454801150730678, "deviation-center-line": 0.06549435431208495, "driven_lanedir_consec": 0.17236304027848937, "sim_compute_sim_state": 0.02344212532043457, "sim_compute_performance-ego": 0.039439208166939875, "sim_compute_robot_state-ego": 0.04088039398193359}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1231734531965312, "sim_physics": 0.05874059313819522, "survival_time": 1.0500000000000005, "driven_lanedir": 0.09414985618509952, "sim_render-ego": 0.035969745545160206, "in-drivable-lane": 0, "agent_compute-ego": 0.0961693014417376, "deviation-heading": 0.5586926307322083, "set_robot_commands": 0.05385372752235049, "deviation-center-line": 0.09794670099385716, "driven_lanedir_consec": 0.09414985618509952, "sim_compute_sim_state": 0.02333891959417434, "sim_compute_performance-ego": 0.039209116072881786, "sim_compute_robot_state-ego": 0.040715172177269346}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17633006573155224, "sim_physics": 0.06504533208649733, "survival_time": 1.4500000000000006, "driven_lanedir": 0.07616191045725307, "sim_render-ego": 0.03674069766340585, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.09720968378001246, "deviation-heading": 0.9805094729677124, "set_robot_commands": 0.05557279751218598, "deviation-center-line": 0.06413429802505513, "driven_lanedir_consec": 0.07616191045725307, "sim_compute_sim_state": 0.023410164076706454, "sim_compute_performance-ego": 0.03890867068849761, "sim_compute_robot_state-ego": 0.04067992341929469}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22275054588977952, "sim_physics": 0.06380349217039166, "survival_time": 1.6500000000000008, "driven_lanedir": 0.14638465078058038, "sim_render-ego": 0.03652576966719194, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.09683557712670528, "deviation-heading": 0.8492114904895192, "set_robot_commands": 0.0578853144790187, "deviation-center-line": 0.0712737219748357, "driven_lanedir_consec": 0.14638465078058038, "sim_compute_sim_state": 0.02341732834324692, "sim_compute_performance-ego": 0.039356202790231415, "sim_compute_robot_state-ego": 0.04107469500917377}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.18773213486094453, "sim_physics": 0.06225159764289856, "survival_time": 1.6000000000000008, "driven_lanedir": 0.058553136577239595, "sim_render-ego": 0.03682372719049454, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09568683058023451, "deviation-heading": 0.8976997876744849, "set_robot_commands": 0.05429675430059433, "deviation-center-line": 0.06037512768288391, "driven_lanedir_consec": 0.058553136577239595, "sim_compute_sim_state": 0.023168981075286865, "sim_compute_performance-ego": 0.03872343897819519, "sim_compute_robot_state-ego": 0.04045236110687256}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.2251873551058529, "sim_physics": 0.06152981122334798, "survival_time": 1.5000000000000009, "driven_lanedir": 0.19202791779080508, "sim_render-ego": 0.035486761728922525, "in-drivable-lane": 0, "agent_compute-ego": 0.09548126856486004, "deviation-heading": 0.5836644222385844, "set_robot_commands": 0.053549154599507647, "deviation-center-line": 0.10143054101209424, "driven_lanedir_consec": 0.19202791779080508, "sim_compute_sim_state": 0.023042448361714683, "sim_compute_performance-ego": 0.03862470785776774, "sim_compute_robot_state-ego": 0.04034092426300049}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.13775473224063794, "sim_physics": 0.05523665384812789, "survival_time": 1.1000000000000003, "driven_lanedir": 0.1051179778500404, "sim_render-ego": 0.035022063688798385, "in-drivable-lane": 0, "agent_compute-ego": 0.09446550499309192, "deviation-heading": 0.5783914395686329, "set_robot_commands": 0.0543942776593295, "deviation-center-line": 0.10137170634845805, "driven_lanedir_consec": 0.1051179778500404, "sim_compute_sim_state": 0.023315711454911667, "sim_compute_performance-ego": 0.03868713162162087, "sim_compute_robot_state-ego": 0.04071886972947554}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14382652503473223, "sim_physics": 0.05701860097738413, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07639718955321007, "sim_render-ego": 0.03588681037609394, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.0946797040792612, "deviation-heading": 0.7775430075810775, "set_robot_commands": 0.05432403087615967, "deviation-center-line": 0.044634091985992545, "driven_lanedir_consec": 0.07639718955321007, "sim_compute_sim_state": 0.023384992892925557, "sim_compute_performance-ego": 0.03883211429302509, "sim_compute_robot_state-ego": 0.04079767373891977}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.16575475257370412, "sim_physics": 0.0612483574793889, "survival_time": 1.3000000000000005, "driven_lanedir": 0.128276307911535, "sim_render-ego": 0.04227846402388353, "in-drivable-lane": 0, "agent_compute-ego": 0.09571255170381986, "deviation-heading": 0.5991811933956286, "set_robot_commands": 0.05450230378371019, "deviation-center-line": 0.09840410208342552, "driven_lanedir_consec": 0.128276307911535, "sim_compute_sim_state": 0.023311449931218073, "sim_compute_performance-ego": 0.039297085541945234, "sim_compute_robot_state-ego": 0.04104258463932918}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1586243662901447, "sim_physics": 0.06124300003051758, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1264633834032557, "sim_render-ego": 0.04200637817382812, "in-drivable-lane": 0, "agent_compute-ego": 0.09501618385314942, "deviation-heading": 0.5191351250629405, "set_robot_commands": 0.05459192276000977, "deviation-center-line": 0.11102855621744924, "driven_lanedir_consec": 0.1264633834032557, "sim_compute_sim_state": 0.023310766220092777, "sim_compute_performance-ego": 0.03858145713806152, "sim_compute_robot_state-ego": 0.0406609058380127}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14532602778681517, "sim_physics": 0.06638988852500916, "survival_time": 1.2000000000000004, "driven_lanedir": 0.10552075516404393, "sim_render-ego": 0.036208927631378174, "in-drivable-lane": 0, "agent_compute-ego": 0.11029372612635296, "deviation-heading": 0.6433314660550675, "set_robot_commands": 0.05407660206158956, "deviation-center-line": 0.07666609549956557, "driven_lanedir_consec": 0.10552075516404393, "sim_compute_sim_state": 0.023110419511795044, "sim_compute_performance-ego": 0.03887237111727397, "sim_compute_robot_state-ego": 0.04650078217188517}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.18283249884991845, "sim_physics": 0.05930591374635696, "survival_time": 1.6000000000000008, "driven_lanedir": 0.08043569777929549, "sim_render-ego": 0.03660367429256439, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.09504076093435287, "deviation-heading": 0.7779174036754858, "set_robot_commands": 0.05382777750492096, "deviation-center-line": 0.053782878450133, "driven_lanedir_consec": 0.08043569777929549, "sim_compute_sim_state": 0.023179173469543457, "sim_compute_performance-ego": 0.03899698704481125, "sim_compute_robot_state-ego": 0.04077526181936264}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.16905025145285457, "sim_physics": 0.05866719209230863, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1229443581134273, "sim_render-ego": 0.03519900028522198, "in-drivable-lane": 0, "agent_compute-ego": 0.09491450969989484, "deviation-heading": 0.7571356106125486, "set_robot_commands": 0.05364535405085637, "deviation-center-line": 0.06767022993781907, "driven_lanedir_consec": 0.1229443581134273, "sim_compute_sim_state": 0.023006109090951778, "sim_compute_performance-ego": 0.03866552389585055, "sim_compute_robot_state-ego": 0.04037053768451397}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.17394321290463016, "sim_physics": 0.05840714772542318, "survival_time": 1.3500000000000003, "driven_lanedir": 0.14887548717549315, "sim_render-ego": 0.036333931816948786, "in-drivable-lane": 0, "agent_compute-ego": 0.09618533982170951, "deviation-heading": 0.4407891421364369, "set_robot_commands": 0.05514686195938675, "deviation-center-line": 0.13280535346761538, "driven_lanedir_consec": 0.14887548717549315, "sim_compute_sim_state": 0.023279825846354168, "sim_compute_performance-ego": 0.03884870917708785, "sim_compute_robot_state-ego": 0.040822894484908494}}
set_robot_commands_max0.0578853144790187
set_robot_commands_mean0.05464110439866966
set_robot_commands_median0.0543942776593295
set_robot_commands_min0.053549154599507647
sim_compute_performance-ego_max0.039439208166939875
sim_compute_performance-ego_mean0.0389236778665464
sim_compute_performance-ego_median0.03884870917708785
sim_compute_performance-ego_min0.03858145713806152
sim_compute_robot_state-ego_max0.04650078217188517
sim_compute_robot_state-ego_mean0.04108789726677186
sim_compute_robot_state-ego_median0.04071886972947554
sim_compute_robot_state-ego_min0.04034092426300049
sim_compute_sim_state_max0.02344212532043457
sim_compute_sim_state_mean0.0232539955052118
sim_compute_sim_state_median0.023310766220092777
sim_compute_sim_state_min0.023006109090951778
sim_physics_max0.06638988852500916
sim_physics_mean0.060565498647909624
sim_physics_median0.059850431978702545
sim_physics_min0.05523665384812789
sim_render-ego_max0.04227846402388353
sim_render-ego_mean0.036869132421550176
sim_render-ego_median0.036208927631378174
sim_render-ego_min0.035022063688798385
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.4000000000000008
survival_time_min1.0500000000000005
No reset possible
24057step1-simulationhost-erroryes0:08:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1361, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1408, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing-offseason/submission3848/step1-simulation-ip-172-31-42-167-7227-job24057/tmp/tmpl1qgv5wi/episodes/ETHZ_autolab_technical_track-6-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible