Duckietown Challenges Home Challenges Submissions

Submission 11458

Submission11458
Competingyes
Challengeaido5-LF-sim-testing
UserAnastasiya Nikolskaya 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFt-sim: 54107
Next
User labelJetBrains Research
Admin priority60
Blessingn/a
User priority60

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
54107LFt-simsuccessyes0:45:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.728251446319533
survival_time_median59.99999999999873
deviation-center-line_median7.126651875906103
in-drivable-lane_median1.274999999999987


other stats
agent_compute-ego0_max0.06564123148128055
agent_compute-ego0_mean0.051752523865727554
agent_compute-ego0_median0.04848543700330164
agent_compute-ego0_min0.044397989975026406
complete-iteration_max0.3310489880850075
complete-iteration_mean0.28387052058975065
complete-iteration_median0.29263583240064356
complete-iteration_min0.21916142947270809
deviation-center-line_max8.536035099736788
deviation-center-line_mean6.8259927654366095
deviation-center-line_min4.514632210197447
deviation-heading_max16.258693334426425
deviation-heading_mean10.307797267681313
deviation-heading_median9.383704525546335
deviation-heading_min6.205086685206157
driven_any_max23.719351310378062
driven_any_mean13.234189057809512
driven_any_median10.622860098638574
driven_any_min7.971684723582841
driven_lanedir_consec_max23.102822469610587
driven_lanedir_consec_mean12.585873444911172
driven_lanedir_consec_min7.784168417395035
driven_lanedir_max23.102822469610587
driven_lanedir_mean12.585873444911172
driven_lanedir_median9.728251446319533
driven_lanedir_min7.784168417395035
get_duckie_state_max1.485103572238792e-06
get_duckie_state_mean1.3898651764652908e-06
get_duckie_state_median1.413538295164593e-06
get_duckie_state_min1.2472805432931866e-06
get_robot_state_max0.004020918815161763
get_robot_state_mean0.003887356320189794
get_robot_state_median0.0038562478074225456
get_robot_state_min0.003816010850752323
get_state_dump_max0.005106508086662706
get_state_dump_mean0.004986463637276554
get_state_dump_median0.005037020684082641
get_state_dump_min0.004765305094278226
get_ui_image_max0.03662229973906581
get_ui_image_mean0.03112549433402475
get_ui_image_median0.030802809725593863
get_ui_image_min0.026274058145845464
in-drivable-lane_max4.949999999999926
in-drivable-lane_mean1.9249999999999747
in-drivable-lane_min0.1999999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 23.719351310378062, "get_ui_image": 0.028801419752821335, "step_physics": 0.11855450557927905, "survival_time": 59.99999999999873, "driven_lanedir": 23.102822469610587, "get_state_dump": 0.00506047920620908, "get_robot_state": 0.004020918815161763, "sim_render-ego0": 0.004105335270534646, "get_duckie_state": 1.3892199971296706e-06, "in-drivable-lane": 1.2499999999999556, "deviation-heading": 8.107910378534271, "agent_compute-ego0": 0.044397989975026406, "complete-iteration": 0.21916142947270809, "set_robot_commands": 0.0024501872400161527, "deviation-center-line": 4.514632210197447, "driven_lanedir_consec": 23.102822469610587, "sim_compute_sim_state": 0.0093435258492145, "sim_compute_performance-ego0": 0.002323971501397253}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.372164081391883, "get_ui_image": 0.03662229973906581, "step_physics": 0.21263452255160087, "survival_time": 59.99999999999873, "driven_lanedir": 11.054175687966234, "get_state_dump": 0.005106508086662706, "get_robot_state": 0.003894328475494766, "sim_render-ego0": 0.004070354639540902, "get_duckie_state": 1.485103572238792e-06, "in-drivable-lane": 4.949999999999926, "deviation-heading": 16.258693334426425, "agent_compute-ego0": 0.05128946411520317, "complete-iteration": 0.3310489880850075, "set_robot_commands": 0.0023297407942747296, "deviation-center-line": 6.449971420383782, "driven_lanedir_consec": 11.054175687966234, "sim_compute_sim_state": 0.012846909792198925, "sim_compute_performance-ego0": 0.0021538653044180507}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.873556115885265, "get_ui_image": 0.03280419969836639, "step_physics": 0.20410376524151017, "survival_time": 59.99999999999873, "driven_lanedir": 8.402327204672833, "get_state_dump": 0.005013562161956203, "get_robot_state": 0.003816010850752323, "sim_render-ego0": 0.003974383121525417, "get_duckie_state": 1.4378565931995148e-06, "in-drivable-lane": 1.3000000000000185, "deviation-heading": 10.6594986725584, "agent_compute-ego0": 0.04568140989140011, "complete-iteration": 0.31185814919420124, "set_robot_commands": 0.002277135451965586, "deviation-center-line": 7.803332331428424, "driven_lanedir_consec": 8.402327204672833, "sim_compute_sim_state": 0.011964492456402806, "sim_compute_performance-ego0": 0.0021222902277327894}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.971684723582841, "get_ui_image": 0.026274058145845464, "step_physics": 0.15783281469225982, "survival_time": 59.99999999999873, "driven_lanedir": 7.784168417395035, "get_state_dump": 0.004765305094278226, "get_robot_state": 0.003818167139350326, "sim_render-ego0": 0.003818891923890126, "get_duckie_state": 1.2472805432931866e-06, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 6.205086685206157, "agent_compute-ego0": 0.06564123148128055, "complete-iteration": 0.2734135156070859, "set_robot_commands": 0.0022598791876800054, "deviation-center-line": 8.536035099736788, "driven_lanedir_consec": 7.784168417395035, "sim_compute_sim_state": 0.006860707026536419, "sim_compute_performance-ego0": 0.002052407181332451}}
set_robot_commands_max0.0024501872400161527
set_robot_commands_mean0.0023292356684841186
set_robot_commands_median0.002303438123120158
set_robot_commands_min0.0022598791876800054
sim_compute_performance-ego0_max0.002323971501397253
sim_compute_performance-ego0_mean0.002163133553720136
sim_compute_performance-ego0_median0.00213807776607542
sim_compute_performance-ego0_min0.002052407181332451
sim_compute_sim_state_max0.012846909792198925
sim_compute_sim_state_mean0.010253908781088162
sim_compute_sim_state_median0.010654009152808654
sim_compute_sim_state_min0.006860707026536419
sim_render-ego0_max0.004105335270534646
sim_render-ego0_mean0.003992241238872773
sim_render-ego0_median0.0040223688805331595
sim_render-ego0_min0.003818891923890126
simulation-passed1
step_physics_max0.21263452255160087
step_physics_mean0.1732814020161625
step_physics_median0.180968289966885
step_physics_min0.11855450557927905
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
54105LFt-simsuccessyes0:46:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54104LFt-simsuccessyes0:44:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54103LFt-simsuccessyes0:47:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42461LFt-simsuccessno0:31:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42460LFt-simhost-errorno0:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42459LFt-simhost-errorno0:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42458LFt-simhost-errorno0:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42457LFt-simhost-errorno0:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible