Duckietown Challenges Home Challenges Submissions

Submission 11315

Submission11315
Competingyes
Challengeaido5-LF-sim-validation
UserAnastasiya Nikolskaya 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 53960
Next
User labelJetBrains Research
Admin priority60
Blessingn/a
User priority60

53960

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53960LFv-simsuccessyes0:46:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9575220411172665
survival_time_median59.99999999999873
deviation-center-line_median1.237202305385947
in-drivable-lane_median46.07499999999864


other stats
agent_compute-ego0_max0.06961360958394758
agent_compute-ego0_mean0.06648667468119422
agent_compute-ego0_median0.06711044190428239
agent_compute-ego0_min0.06211220533226452
complete-iteration_max0.4086545035801363
complete-iteration_mean0.35585954733236347
complete-iteration_median0.36220660426038986
complete-iteration_min0.29037047722853787
deviation-center-line_max10.52062463261962
deviation-center-line_mean3.280549762518244
deviation-center-line_min0.1271698066814605
deviation-heading_max18.41106986958364
deviation-heading_mean7.103972532016823
deviation-heading_median4.801527175563365
deviation-heading_min0.4017659073569224
driven_any_max7.622248692683846
driven_any_mean3.8743140847390785
driven_any_median3.5058278144877546
driven_any_min0.8633520172969583
driven_lanedir_consec_max7.005153690969786
driven_lanedir_consec_mean2.935459463580595
driven_lanedir_consec_min0.8216400811180619
driven_lanedir_max7.005153690969786
driven_lanedir_mean2.935459463580595
driven_lanedir_median1.9575220411172665
driven_lanedir_min0.8216400811180619
get_duckie_state_max1.4223722891446257e-06
get_duckie_state_mean1.3989473163436391e-06
get_duckie_state_median1.405796143137148e-06
get_duckie_state_min1.3618246899556358e-06
get_robot_state_max0.0040015149970138
get_robot_state_mean0.003850591073524545
get_robot_state_median0.003810863709271103
get_robot_state_min0.0037791218785421738
get_state_dump_max0.004965120707820794
get_state_dump_mean0.0047385277200201765
get_state_dump_median0.004679254647794115
get_state_dump_min0.0046304808766716825
get_ui_image_max0.03615121301465189
get_ui_image_mean0.031876246002095626
get_ui_image_median0.03247002747334807
get_ui_image_min0.02641371604703447
in-drivable-lane_max57.64999999999873
in-drivable-lane_mean37.737499999999
in-drivable-lane_min1.149999999999996
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.622248692683846, "get_ui_image": 0.028895825569476813, "step_physics": 0.19683906299486248, "survival_time": 59.99999999999873, "driven_lanedir": 7.005153690969786, "get_state_dump": 0.004636181681281224, "get_robot_state": 0.003803644450280589, "sim_render-ego0": 0.003908716967262694, "get_duckie_state": 1.4223722891446257e-06, "in-drivable-lane": 43.449999999998624, "deviation-heading": 3.567473275888339, "agent_compute-ego0": 0.06961360958394758, "complete-iteration": 0.32077967812874036, "set_robot_commands": 0.0022621164710992184, "deviation-center-line": 1.3287891977930597, "driven_lanedir_consec": 7.005153690969786, "sim_compute_sim_state": 0.008618526911358353, "sim_compute_performance-ego0": 0.002105473479462305}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6357525086111688, "get_ui_image": 0.03604422937721932, "step_physics": 0.27857091603529244, "survival_time": 59.99999999999873, "driven_lanedir": 1.161891071053795, "get_state_dump": 0.004722327614307006, "get_robot_state": 0.003818082968261617, "sim_render-ego0": 0.003906329803720898, "get_duckie_state": 1.4158212374290956e-06, "in-drivable-lane": 1.149999999999996, "deviation-heading": 18.41106986958364, "agent_compute-ego0": 0.0664573212051074, "complete-iteration": 0.4086545035801363, "set_robot_commands": 0.002310487054766068, "deviation-center-line": 10.52062463261962, "driven_lanedir_consec": 1.161891071053795, "sim_compute_sim_state": 0.01064573358635819, "sim_compute_performance-ego0": 0.002079737573539486}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.8633520172969583, "get_ui_image": 0.03615121301465189, "step_physics": 0.2765175742372486, "survival_time": 59.99999999999873, "driven_lanedir": 0.8216400811180619, "get_state_dump": 0.004965120707820794, "get_robot_state": 0.0040015149970138, "sim_render-ego0": 0.004245800142184979, "get_duckie_state": 1.3957710488452009e-06, "in-drivable-lane": 57.64999999999873, "deviation-heading": 0.4017659073569224, "agent_compute-ego0": 0.06211220533226452, "complete-iteration": 0.4036335303920393, "set_robot_commands": 0.0024501701675783485, "deviation-center-line": 0.1271698066814605, "driven_lanedir_consec": 0.8216400811180619, "sim_compute_sim_state": 0.010856313570452967, "sim_compute_performance-ego0": 0.0022296169020551925}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.37590312036434, "get_ui_image": 0.02641371604703447, "step_physics": 0.17306195905464675, "survival_time": 59.99999999999873, "driven_lanedir": 2.7531530111807374, "get_state_dump": 0.0046304808766716825, "get_robot_state": 0.0037791218785421738, "sim_render-ego0": 0.003917962883433931, "get_duckie_state": 1.3618246899556358e-06, "in-drivable-lane": 48.69999999999865, "deviation-heading": 6.03558107523839, "agent_compute-ego0": 0.06776356260345738, "complete-iteration": 0.29037047722853787, "set_robot_commands": 0.002294766118782545, "deviation-center-line": 1.1456154129788352, "driven_lanedir_consec": 2.7531530111807374, "sim_compute_sim_state": 0.0063544872102888296, "sim_compute_performance-ego0": 0.0020587307328884053}}
set_robot_commands_max0.0024501701675783485
set_robot_commands_mean0.002329384953056545
set_robot_commands_median0.0023026265867743066
set_robot_commands_min0.0022621164710992184
sim_compute_performance-ego0_max0.0022296169020551925
sim_compute_performance-ego0_mean0.0021183896719863477
sim_compute_performance-ego0_median0.002092605526500896
sim_compute_performance-ego0_min0.0020587307328884053
sim_compute_sim_state_max0.010856313570452967
sim_compute_sim_state_mean0.009118765319614584
sim_compute_sim_state_median0.009632130248858272
sim_compute_sim_state_min0.0063544872102888296
sim_render-ego0_max0.004245800142184979
sim_render-ego0_mean0.003994702449150626
sim_render-ego0_median0.003913339925348312
sim_render-ego0_min0.003906329803720898
simulation-passed1
step_physics_max0.27857091603529244
step_physics_mean0.23124737808051257
step_physics_median0.2366783186160555
step_physics_min0.17306195905464675
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
53957LFv-simsuccessyes0:46:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53935LFv-simhost-erroryes0:03:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53915LFv-simhost-erroryes0:02:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible