Duckietown Challenges Home Challenges Submissions

Submission 11314

Submission11314
Competingyes
Challengeaido5-LF-sim-validation
UserAnastasiya Nikolskaya 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 53961
Next
User labelJetBrains Research
Admin priority60
Blessingn/a
User priority60

53961

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53961LFv-simsuccessyes0:47:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3307258136570805
survival_time_median59.99999999999873
deviation-center-line_median1.1505637429024578
in-drivable-lane_median46.69999999999865


other stats
agent_compute-ego0_max0.06727865038068964
agent_compute-ego0_mean0.06345351441118938
agent_compute-ego0_median0.06399221404406749
agent_compute-ego0_min0.058550979175932896
complete-iteration_max0.37611720623521383
complete-iteration_mean0.33181089068531094
complete-iteration_median0.33919363593578733
complete-iteration_min0.27273908463445534
deviation-center-line_max10.278078473321797
deviation-center-line_mean3.2052091982888027
deviation-center-line_min0.24163083402849952
deviation-heading_max16.409868355895316
deviation-heading_mean7.358209012688837
deviation-heading_median5.877991484529253
deviation-heading_min1.2669847258015268
driven_any_max5.629267400776786
driven_any_mean3.1846305211608534
driven_any_median2.9997082193288076
driven_any_min1.1098382452090136
driven_lanedir_consec_max4.465989306447652
driven_lanedir_consec_mean2.5422020170776207
driven_lanedir_consec_min1.0413671345486706
driven_lanedir_max4.465989306447652
driven_lanedir_mean2.546221054280518
driven_lanedir_median2.338763888062875
driven_lanedir_min1.0413671345486706
get_duckie_state_max1.3487225865245758e-06
get_duckie_state_mean1.328672397940681e-06
get_duckie_state_median1.3266872307541566e-06
get_duckie_state_min1.3125925437298346e-06
get_robot_state_max0.0037731772954021263
get_robot_state_mean0.0036573056674420487
get_robot_state_median0.003626912460041285
get_robot_state_min0.003602220454283499
get_state_dump_max0.004753873310517908
get_state_dump_mean0.00465062357404647
get_state_dump_median0.004665928021954259
get_state_dump_min0.004516764941759451
get_ui_image_max0.03503699187533643
get_ui_image_mean0.03021908421798312
get_ui_image_median0.030120998000622193
get_ui_image_min0.02559734899535167
in-drivable-lane_max55.999999999998735
in-drivable-lane_mean37.62499999999901
in-drivable-lane_min1.1000000000000003
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.947182337995686, "get_ui_image": 0.02751688536358912, "step_physics": 0.19533332678598728, "survival_time": 59.99999999999873, "driven_lanedir": 1.449445712063376, "get_state_dump": 0.004516764941759451, "get_robot_state": 0.003602220454283499, "sim_render-ego0": 0.003699866659337535, "get_duckie_state": 1.3125925437298346e-06, "in-drivable-lane": 1.1000000000000003, "deviation-heading": 16.409868355895316, "agent_compute-ego0": 0.0653919445088662, "complete-iteration": 0.314994802681433, "set_robot_commands": 0.002132028068332847, "deviation-center-line": 10.278078473321797, "driven_lanedir_consec": 1.449445712063376, "sim_compute_sim_state": 0.01077412983261477, "sim_compute_performance-ego0": 0.00193970467426894}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.629267400776786, "get_ui_image": 0.03503699187533643, "step_physics": 0.24448661363492105, "survival_time": 59.99999999999873, "driven_lanedir": 4.465989306447652, "get_state_dump": 0.004650515580951522, "get_robot_state": 0.003630798722583984, "sim_render-ego0": 0.003792278574070863, "get_duckie_state": 1.3316501487204673e-06, "in-drivable-lane": 43.949999999998624, "deviation-heading": 7.788432576082212, "agent_compute-ego0": 0.06727865038068964, "complete-iteration": 0.37611720623521383, "set_robot_commands": 0.002188826877806804, "deviation-center-line": 1.5074359800714987, "driven_lanedir_consec": 4.465989306447652, "sim_compute_sim_state": 0.012963541342158004, "sim_compute_performance-ego0": 0.0019961511165672895}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.1098382452090136, "get_ui_image": 0.032725110637655264, "step_physics": 0.2447782128577824, "survival_time": 59.99999999999873, "driven_lanedir": 1.0413671345486706, "get_state_dump": 0.004753873310517908, "get_robot_state": 0.0037731772954021263, "sim_render-ego0": 0.003998326222962086, "get_duckie_state": 1.3487225865245758e-06, "in-drivable-lane": 55.999999999998735, "deviation-heading": 1.2669847258015268, "agent_compute-ego0": 0.058550979175932896, "complete-iteration": 0.3633924691901418, "set_robot_commands": 0.00228949450731873, "deviation-center-line": 0.24163083402849952, "driven_lanedir_consec": 1.0413671345486706, "sim_compute_sim_state": 0.01037564523809657, "sim_compute_performance-ego0": 0.0020501826029832317}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.052234100661929, "get_ui_image": 0.02559734899535167, "step_physics": 0.16172338504775377, "survival_time": 59.99999999999873, "driven_lanedir": 3.2280820640623737, "get_state_dump": 0.0046813404629569965, "get_robot_state": 0.0036230261974985857, "sim_render-ego0": 0.0037777402021803527, "get_duckie_state": 1.321724312787846e-06, "in-drivable-lane": 49.44999999999868, "deviation-heading": 3.967550392976293, "agent_compute-ego0": 0.06259248357926876, "complete-iteration": 0.27273908463445534, "set_robot_commands": 0.002174347663898452, "deviation-center-line": 0.7936915057334168, "driven_lanedir_consec": 3.2120059152507854, "sim_compute_sim_state": 0.006545875987641321, "sim_compute_performance-ego0": 0.0019342647206277077}}
set_robot_commands_max0.00228949450731873
set_robot_commands_mean0.0021961742793392084
set_robot_commands_median0.002181587270852628
set_robot_commands_min0.002132028068332847
sim_compute_performance-ego0_max0.0020501826029832317
sim_compute_performance-ego0_mean0.001980075778611792
sim_compute_performance-ego0_median0.001967927895418115
sim_compute_performance-ego0_min0.0019342647206277077
sim_compute_sim_state_max0.012963541342158004
sim_compute_sim_state_mean0.010164798100127666
sim_compute_sim_state_median0.01057488753535567
sim_compute_sim_state_min0.006545875987641321
sim_render-ego0_max0.003998326222962086
sim_render-ego0_mean0.00381705291463771
sim_render-ego0_median0.003785009388125608
sim_render-ego0_min0.003699866659337535
simulation-passed1
step_physics_max0.2447782128577824
step_physics_mean0.2115803845816111
step_physics_median0.21990997021045416
step_physics_min0.16172338504775377
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
53934LFv-simhost-erroryes0:03:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53911LFv-simhost-erroryes0:02:57
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible