Duckietown Challenges Home Challenges Submissions

Submission 12581

Submission12581
Competingyes
Challengeaido5-LFP-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFP-sim: 59946
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

59946

Click the images to see detailed statistics about the episode.

LFP-norm-loop-000

LFP-norm-small_loop-000

LFP-norm-techtrack-000

LFP-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
59946LFP-simsuccessyes0:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.599999999999988
in-drivable-lane_median3.799999999999988
driven_lanedir_consec_median0.42438751408771613
deviation-center-line_median0.16901455446056324


other stats
agent_compute-ego0_max0.013789607554065938
agent_compute-ego0_mean0.01305500669766301
agent_compute-ego0_median0.013246844731353524
agent_compute-ego0_min0.011936729773879051
complete-iteration_max0.2772665145445843
complete-iteration_mean0.23453022523706185
complete-iteration_median0.24513886415188668
complete-iteration_min0.17057665809988976
deviation-center-line_max0.1882986757239023
deviation-center-line_mean0.15393325650160825
deviation-center-line_min0.08940524136140421
deviation-heading_max1.3768490930878967
deviation-heading_mean0.8604153069792677
deviation-heading_median0.8082071194950275
deviation-heading_min0.4483978958391191
driven_any_max4.335709193399477
driven_any_mean2.056281081968489
driven_any_median1.4021106214720067
driven_any_min1.0851938915304653
driven_lanedir_consec_max0.9273218094142346
driven_lanedir_consec_mean0.49703055823628706
driven_lanedir_consec_min0.21202539535548115
driven_lanedir_max0.9273218094142346
driven_lanedir_mean0.49703055823628706
driven_lanedir_median0.42438751408771613
driven_lanedir_min0.21202539535548115
get_duckie_state_max0.025706480960456697
get_duckie_state_mean0.018423936998595628
get_duckie_state_median0.02200696110605755
get_duckie_state_min0.003975344821810722
get_robot_state_max0.004018871151671118
get_robot_state_mean0.003783199649712949
get_robot_state_median0.003870033998479808
get_robot_state_min0.0033738594502210617
get_state_dump_max0.008819879317770198
get_state_dump_mean0.007670902948846492
get_state_dump_median0.008421163069998471
get_state_dump_min0.005021406337618828
get_ui_image_max0.041259772923527935
get_ui_image_mean0.03410386694613913
get_ui_image_median0.035184636415945485
get_ui_image_min0.02478642202913761
in-drivable-lane_max11.650000000000086
in-drivable-lane_mean5.562500000000014
in-drivable-lane_min2.9999999999999933
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 1.1986329000478173, "get_ui_image": 0.033956362276661156, "step_physics": 0.1545074496950422, "survival_time": 4.849999999999991, "driven_lanedir": 0.21202539535548115, "get_state_dump": 0.008819879317770198, "get_robot_state": 0.003937947506807289, "sim_render-ego0": 0.004161815254055724, "get_duckie_state": 0.025706480960456697, "in-drivable-lane": 3.7499999999999902, "deviation-heading": 0.4483978958391191, "agent_compute-ego0": 0.013789607554065938, "complete-iteration": 0.2578011483562236, "set_robot_commands": 0.0022824954013435208, "deviation-center-line": 0.08940524136140421, "driven_lanedir_consec": 0.21202539535548115, "sim_compute_sim_state": 0.008476074861020458, "sim_compute_performance-ego0": 0.0020624180229342716}, "LFP-norm-zigzag-000-ego0": {"driven_any": 1.0851938915304653, "get_ui_image": 0.041259772923527935, "step_physics": 0.16811102020497226, "survival_time": 4.849999999999991, "driven_lanedir": 0.25249411283969836, "get_state_dump": 0.008718619541246064, "get_robot_state": 0.004018871151671118, "sim_render-ego0": 0.004111642740210708, "get_duckie_state": 0.02270284234261026, "in-drivable-lane": 2.9999999999999933, "deviation-heading": 1.3768490930878967, "agent_compute-ego0": 0.013320017834098972, "complete-iteration": 0.2772665145445843, "set_robot_commands": 0.002302245217926648, "deviation-center-line": 0.18116451173331533, "driven_lanedir_consec": 0.25249411283969836, "sim_compute_sim_state": 0.010429258249243912, "sim_compute_performance-ego0": 0.002159439787572744}, "LFP-norm-techtrack-000-ego0": {"driven_any": 4.335709193399477, "get_ui_image": 0.03641291055522981, "step_physics": 0.12971642056449514, "survival_time": 15.20000000000008, "driven_lanedir": 0.9273218094142346, "get_state_dump": 0.00812370659875088, "get_robot_state": 0.003802120490152328, "sim_render-ego0": 0.003948282022945216, "get_duckie_state": 0.021311079869504836, "in-drivable-lane": 11.650000000000086, "deviation-heading": 0.8564904388115755, "agent_compute-ego0": 0.013173671628608078, "complete-iteration": 0.23247657994754975, "set_robot_commands": 0.002204977879758741, "deviation-center-line": 0.1882986757239023, "driven_lanedir_consec": 0.9273218094142346, "sim_compute_sim_state": 0.011565795491953364, "sim_compute_performance-ego0": 0.002118986942729012}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.605588342896196, "get_ui_image": 0.02478642202913761, "step_physics": 0.10837586596608162, "survival_time": 6.349999999999985, "driven_lanedir": 0.5962809153357339, "get_state_dump": 0.005021406337618828, "get_robot_state": 0.0033738594502210617, "sim_render-ego0": 0.0035306233912706375, "get_duckie_state": 0.003975344821810722, "in-drivable-lane": 3.8499999999999863, "deviation-heading": 0.7599238001784796, "agent_compute-ego0": 0.011936729773879051, "complete-iteration": 0.17057665809988976, "set_robot_commands": 0.00194430910050869, "deviation-center-line": 0.15686459718781118, "driven_lanedir_consec": 0.5962809153357339, "sim_compute_sim_state": 0.005796119570732117, "sim_compute_performance-ego0": 0.0017547737807035446}}
set_robot_commands_max0.002302245217926648
set_robot_commands_mean0.0021835068998843996
set_robot_commands_median0.002243736640551131
set_robot_commands_min0.00194430910050869
sim_compute_performance-ego0_max0.002159439787572744
sim_compute_performance-ego0_mean0.002023904633484893
sim_compute_performance-ego0_median0.0020907024828316417
sim_compute_performance-ego0_min0.0017547737807035446
sim_compute_sim_state_max0.011565795491953364
sim_compute_sim_state_mean0.009066812043237464
sim_compute_sim_state_median0.009452666555132183
sim_compute_sim_state_min0.005796119570732117
sim_render-ego0_max0.004161815254055724
sim_render-ego0_mean0.003938090852120571
sim_render-ego0_median0.004029962381577962
sim_render-ego0_min0.0035306233912706375
simulation-passed1
step_physics_max0.16811102020497226
step_physics_mean0.1401776891076478
step_physics_median0.14211193512976866
step_physics_min0.10837586596608162
survival_time_max15.20000000000008
survival_time_mean7.812500000000012
survival_time_min4.849999999999991
No reset possible
59932LFP-simhost-erroryes0:01:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53639LFP-simsuccessno0:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible