Duckietown Challenges Home Challenges Submissions

Submission 11714

Submission11714
Competingyes
Challengeaido5-LF-sim-validation
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 53975
Next
User labelsim-exercise-2
Admin priority50
Blessingn/a
User priority50

53975

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53975LFv-simsuccessyes0:18:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9386351684425764
survival_time_median22.700000000000188
deviation-center-line_median1.068914855004385
in-drivable-lane_median7.9500000000001005


other stats
agent_compute-ego0_max0.013490584616635205
agent_compute-ego0_mean0.01333034835772188
agent_compute-ego0_median0.01329847574288397
agent_compute-ego0_min0.013233857328484372
complete-iteration_max0.2638579541689729
complete-iteration_mean0.23218763795844397
complete-iteration_median0.23874048885249025
complete-iteration_min0.1874116199598225
deviation-center-line_max2.6232074991764853
deviation-center-line_mean1.2889369179333796
deviation-center-line_min0.394710462548263
deviation-heading_max8.797506525066435
deviation-heading_mean4.929961041030632
deviation-heading_median4.566883029100266
deviation-heading_min1.7885715808555605
driven_any_max11.813387782230578
driven_any_mean5.2644311659291585
driven_any_median4.069040513099809
driven_any_min1.1062558552864372
driven_lanedir_consec_max4.393284506671839
driven_lanedir_consec_mean2.8067126980914354
driven_lanedir_consec_min0.9562959488087508
driven_lanedir_max7.884738652358721
driven_lanedir_mean3.679576234513157
driven_lanedir_median2.9386351684425764
driven_lanedir_min0.9562959488087508
get_duckie_state_max1.6591320299122432e-06
get_duckie_state_mean1.568964569808402e-06
get_duckie_state_median1.558664736669799e-06
get_duckie_state_min1.4993967759817665e-06
get_robot_state_max0.004214410912500669
get_robot_state_mean0.004112117030410946
get_robot_state_median0.004097349759446471
get_robot_state_min0.0040393576902501725
get_state_dump_max0.005234677795906826
get_state_dump_mean0.005175611113613611
get_state_dump_median0.005197670258846659
get_state_dump_min0.005072426140854301
get_ui_image_max0.03786251316331837
get_ui_image_mean0.03317504218068275
get_ui_image_median0.03339861023279385
get_ui_image_min0.02804043509382491
in-drivable-lane_max24.149999999999867
in-drivable-lane_mean10.400000000000016
in-drivable-lane_min1.5499999999999945
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.9135150505992247, "get_ui_image": 0.0308594429860262, "step_physics": 0.15254655338469006, "survival_time": 17.800000000000118, "driven_lanedir": 1.8071480744325024, "get_state_dump": 0.005216544415770459, "get_robot_state": 0.0040393576902501725, "sim_render-ego0": 0.004235372489907828, "get_duckie_state": 1.607488851253392e-06, "in-drivable-lane": 8.100000000000115, "deviation-heading": 3.0916144013464573, "agent_compute-ego0": 0.013233857328484372, "complete-iteration": 0.2254469969025513, "set_robot_commands": 0.00235164666376194, "deviation-center-line": 0.7879255968009413, "driven_lanedir_consec": 1.8071480744325024, "sim_compute_sim_state": 0.010627442715214748, "sim_compute_performance-ego0": 0.0022364136885528138}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.1062558552864372, "get_ui_image": 0.03786251316331837, "step_physics": 0.1827786638312144, "survival_time": 7.249999999999982, "driven_lanedir": 0.9562959488087508, "get_state_dump": 0.0051787961019228584, "get_robot_state": 0.004214410912500669, "sim_render-ego0": 0.00433231869789019, "get_duckie_state": 1.6591320299122432e-06, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 1.7885715808555605, "agent_compute-ego0": 0.013300149408105302, "complete-iteration": 0.2638579541689729, "set_robot_commands": 0.0025368700288746454, "deviation-center-line": 0.394710462548263, "driven_lanedir_consec": 0.9562959488087508, "sim_compute_sim_state": 0.011187443994495968, "sim_compute_performance-ego0": 0.0023618658928021992}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.2245659756003935, "get_ui_image": 0.0359377774795615, "step_physics": 0.17111507505447912, "survival_time": 27.600000000000257, "driven_lanedir": 4.07012226245265, "get_state_dump": 0.005234677795906826, "get_robot_state": 0.004137240525395702, "sim_render-ego0": 0.004227243754574878, "get_duckie_state": 1.5098406220862058e-06, "in-drivable-lane": 7.800000000000087, "deviation-heading": 6.042151656854076, "agent_compute-ego0": 0.013490584616635205, "complete-iteration": 0.2520339808024291, "set_robot_commands": 0.0024930590100141806, "deviation-center-line": 1.3499041132078284, "driven_lanedir_consec": 4.07012226245265, "sim_compute_sim_state": 0.012982269738940606, "sim_compute_performance-ego0": 0.002313362970059}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.813387782230578, "get_ui_image": 0.02804043509382491, "step_physics": 0.12136762763538726, "survival_time": 59.99999999999873, "driven_lanedir": 7.884738652358721, "get_state_dump": 0.005072426140854301, "get_robot_state": 0.00405745899349724, "sim_render-ego0": 0.004106475153533148, "get_duckie_state": 1.4993967759817665e-06, "in-drivable-lane": 24.149999999999867, "deviation-heading": 8.797506525066435, "agent_compute-ego0": 0.013296802077662637, "complete-iteration": 0.1874116199598225, "set_robot_commands": 0.002481774029187815, "deviation-center-line": 2.6232074991764853, "driven_lanedir_consec": 4.393284506671839, "sim_compute_sim_state": 0.006651699691886806, "sim_compute_performance-ego0": 0.002237824377271158}}
set_robot_commands_max0.0025368700288746454
set_robot_commands_mean0.002465837432959646
set_robot_commands_median0.0024874165196009978
set_robot_commands_min0.00235164666376194
sim_compute_performance-ego0_max0.0023618658928021992
sim_compute_performance-ego0_mean0.0022873667321712927
sim_compute_performance-ego0_median0.002275593673665079
sim_compute_performance-ego0_min0.0022364136885528138
sim_compute_sim_state_max0.012982269738940606
sim_compute_sim_state_mean0.010362214035134532
sim_compute_sim_state_median0.010907443354855356
sim_compute_sim_state_min0.006651699691886806
sim_render-ego0_max0.00433231869789019
sim_render-ego0_mean0.004225352523976511
sim_render-ego0_median0.004231308122241353
sim_render-ego0_min0.004106475153533148
simulation-passed1
step_physics_max0.1827786638312144
step_physics_mean0.1569519799764427
step_physics_median0.1618308142195846
step_physics_min0.12136762763538726
survival_time_max59.99999999999873
survival_time_mean28.162499999999778
survival_time_min7.249999999999982
No reset possible
53974LFv-simsuccessyes0:24:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53972LFv-simsuccessyes0:11:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53925LFv-simhost-erroryes0:03:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible