Duckietown Challenges Home Challenges Submissions

Submission 12671

Submission12671
Competingyes
Challengeaido5-LFP-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFP-sim: 59947
Next
User labelbaseline-duckietown
Admin priority50
Blessingn/a
User priority50

59947

Click the images to see detailed statistics about the episode.

LFP-norm-loop-000

LFP-norm-small_loop-000

LFP-norm-techtrack-000

LFP-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
59947LFP-simsuccessyes0:08:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.275000000000054
in-drivable-lane_median0.0
driven_lanedir_consec_median1.382566821439723
deviation-center-line_median0.5784660570568424


other stats
agent_compute-ego0_max0.01358279273623512
agent_compute-ego0_mean0.012326356509153296
agent_compute-ego0_median0.01228474482802259
agent_compute-ego0_min0.011153143644332886
complete-iteration_max0.2971456868307931
complete-iteration_mean0.22215784083818507
complete-iteration_median0.22125662918135036
complete-iteration_min0.14897241815924644
deviation-center-line_max1.445798907215078
deviation-center-line_mean0.6987718728507193
deviation-center-line_min0.19235647007411433
deviation-heading_max2.2623718444550196
deviation-heading_mean1.6213708765888717
deviation-heading_median1.6847059765048362
deviation-heading_min0.8536997088907943
driven_any_max1.9929143446297717
driven_any_mean1.4468603123922317
driven_any_median1.6244280292268467
driven_any_min0.5456708464854619
driven_lanedir_consec_max1.9646317464032184
driven_lanedir_consec_mean1.3161610093141878
driven_lanedir_consec_min0.534878647974086
driven_lanedir_max1.9646317464032184
driven_lanedir_mean1.3161610093141878
driven_lanedir_median1.382566821439723
driven_lanedir_min0.534878647974086
get_duckie_state_max0.025484357561383928
get_duckie_state_mean0.017922470148835183
get_duckie_state_median0.021158418888857028
get_duckie_state_min0.003888685256242752
get_robot_state_max0.004071975889660063
get_robot_state_mean0.003697403951818016
get_robot_state_median0.003735641685366592
get_robot_state_min0.0032463565468788145
get_state_dump_max0.008746252296874242
get_state_dump_mean0.007443237331416211
get_state_dump_median0.00814361498709256
get_state_dump_min0.004739467054605484
get_ui_image_max0.04013565154302688
get_ui_image_mean0.032362734260070074
get_ui_image_median0.03318170158234501
get_ui_image_min0.0229518823325634
in-drivable-lane_max3.1500000000000146
in-drivable-lane_mean0.7875000000000036
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 1.9929143446297717, "get_ui_image": 0.03238288808313216, "step_physics": 0.11041473453829748, "survival_time": 16.050000000000093, "driven_lanedir": 1.9646317464032184, "get_state_dump": 0.008746252296874242, "get_robot_state": 0.003829491064415215, "sim_render-ego0": 0.003971482656016853, "get_duckie_state": 0.025484357561383928, "in-drivable-lane": 0.0, "deviation-heading": 1.808270256757418, "agent_compute-ego0": 0.012145152743558704, "complete-iteration": 0.20950618663930004, "set_robot_commands": 0.0022467530292013416, "deviation-center-line": 0.7017075945156295, "driven_lanedir_consec": 1.9646317464032184, "sim_compute_sim_state": 0.008179963005255468, "sim_compute_performance-ego0": 0.0020035386825940625}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5456708464854619, "get_ui_image": 0.04013565154302688, "step_physics": 0.18937350227719263, "survival_time": 5.1999999999999895, "driven_lanedir": 0.534878647974086, "get_state_dump": 0.008556007203601656, "get_robot_state": 0.004071975889660063, "sim_render-ego0": 0.004078454063052223, "get_duckie_state": 0.02189821061633882, "in-drivable-lane": 0.0, "deviation-heading": 0.8536997088907943, "agent_compute-ego0": 0.01358279273623512, "complete-iteration": 0.2971456868307931, "set_robot_commands": 0.0023492404392787387, "deviation-center-line": 0.19235647007411433, "driven_lanedir_consec": 0.534878647974086, "sim_compute_sim_state": 0.010888390314011346, "sim_compute_performance-ego0": 0.0020956198374430337}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.2692889534700862, "get_ui_image": 0.03398051508155787, "step_physics": 0.13346133545530794, "survival_time": 10.600000000000016, "driven_lanedir": 1.249931888275848, "get_state_dump": 0.007731222770583462, "get_robot_state": 0.0036417923063179697, "sim_render-ego0": 0.0037834263743369233, "get_duckie_state": 0.02041862716137523, "in-drivable-lane": 0.0, "deviation-heading": 1.5611416962522546, "agent_compute-ego0": 0.012424336912486476, "complete-iteration": 0.2330070717234007, "set_robot_commands": 0.002058908972941654, "deviation-center-line": 0.4552245195980554, "driven_lanedir_consec": 1.249931888275848, "sim_compute_sim_state": 0.01347443531376655, "sim_compute_performance-ego0": 0.0019341970273586504}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.979567104983607, "get_ui_image": 0.0229518823325634, "step_physics": 0.090610371530056, "survival_time": 15.950000000000092, "driven_lanedir": 1.515201754603598, "get_state_dump": 0.004739467054605484, "get_robot_state": 0.0032463565468788145, "sim_render-ego0": 0.0034327365458011625, "get_duckie_state": 0.003888685256242752, "in-drivable-lane": 3.1500000000000146, "deviation-heading": 2.2623718444550196, "agent_compute-ego0": 0.011153143644332886, "complete-iteration": 0.14897241815924644, "set_robot_commands": 0.0018874615430831908, "deviation-center-line": 1.445798907215078, "driven_lanedir_consec": 1.515201754603598, "sim_compute_sim_state": 0.005295009911060333, "sim_compute_performance-ego0": 0.001686961203813553}}
set_robot_commands_max0.0023492404392787387
set_robot_commands_mean0.0021355909961262316
set_robot_commands_median0.002152831001071498
set_robot_commands_min0.0018874615430831908
sim_compute_performance-ego0_max0.0020956198374430337
sim_compute_performance-ego0_mean0.0019300791878023248
sim_compute_performance-ego0_median0.0019688678549763567
sim_compute_performance-ego0_min0.001686961203813553
sim_compute_sim_state_max0.01347443531376655
sim_compute_sim_state_mean0.009459449636023423
sim_compute_sim_state_median0.009534176659633409
sim_compute_sim_state_min0.005295009911060333
sim_render-ego0_max0.004078454063052223
sim_render-ego0_mean0.0038165249098017903
sim_render-ego0_median0.003877454515176888
sim_render-ego0_min0.0034327365458011625
simulation-passed1
step_physics_max0.18937350227719263
step_physics_mean0.13096498595021352
step_physics_median0.12193803499680272
step_physics_min0.090610371530056
survival_time_max16.050000000000093
survival_time_mean11.950000000000047
survival_time_min5.1999999999999895
No reset possible
59927LFP-simhost-erroryes0:01:58
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53511LFP-simsuccessno0:08:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53510LFP-simsuccessno0:08:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53508LFP-simsuccessno0:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible