Duckietown Challenges Home Challenges Submissions

Submission 9781

Submission9781
Competingyes
Challengeaido5-LF-sim-validation
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 58083
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

58083

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
58083LFv-simsuccessyes0:16:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.332379382177287
survival_time_median28.950000000000188
deviation-center-line_median0.36118517385089705
in-drivable-lane_median18.10000000000013


other stats
agent_compute-ego0_max0.035293635408929054
agent_compute-ego0_mean0.018225579206847434
agent_compute-ego0_median0.012638803280881714
agent_compute-ego0_min0.012331074856697244
complete-iteration_max0.227379598516099
complete-iteration_mean0.19289677777832617
complete-iteration_median0.18640218558886373
complete-iteration_min0.17140314141947824
deviation-center-line_max1.238823067884464
deviation-center-line_mean0.542219186663784
deviation-center-line_min0.207683331068878
deviation-heading_max4.507880200412496
deviation-heading_mean2.7081249980251565
deviation-heading_median2.435748753246919
deviation-heading_min1.4531222851942935
driven_any_max9.541538107845822
driven_any_mean4.861478876380663
driven_any_median4.768423561434525
driven_any_min0.36753027480778266
driven_lanedir_consec_max2.47439762579513
driven_lanedir_consec_mean1.339217807283863
driven_lanedir_consec_min0.21771483898574884
driven_lanedir_max2.47439762579513
driven_lanedir_mean1.3403157077412646
driven_lanedir_median1.33457518309209
driven_lanedir_min0.21771483898574884
get_duckie_state_max1.4120114878701657e-06
get_duckie_state_mean1.3925056713130815e-06
get_duckie_state_median1.405599931122306e-06
get_duckie_state_min1.3468113351375498e-06
get_robot_state_max0.0039105570834615955
get_robot_state_mean0.003801342264242008
get_robot_state_median0.0038511895800324688
get_robot_state_min0.0035924328134415
get_state_dump_max0.004866210965142734
get_state_dump_mean0.004809369877683083
get_state_dump_median0.004843133687604006
get_state_dump_min0.004685001170381587
get_ui_image_max0.03573724817722402
get_ui_image_mean0.03133024019925042
get_ui_image_median0.03140221843382461
get_ui_image_min0.02677927575212844
in-drivable-lane_max41.94999999999921
in-drivable-lane_mean19.937499999999865
in-drivable-lane_min1.5999999999999943
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.541538107845822, "get_ui_image": 0.029045122786705988, "step_physics": 0.10339719941613744, "survival_time": 51.49999999999921, "driven_lanedir": 1.9733416661708545, "get_state_dump": 0.004826092465656921, "get_robot_state": 0.003873045530050964, "sim_render-ego0": 0.004060252214611213, "get_duckie_state": 1.4120114878701657e-06, "in-drivable-lane": 41.94999999999921, "deviation-heading": 1.4531222851942935, "agent_compute-ego0": 0.012469627461771037, "complete-iteration": 0.17140314141947824, "set_robot_commands": 0.0023719940685046517, "deviation-center-line": 0.3961229864643687, "driven_lanedir_consec": 1.9733416661708545, "sim_compute_sim_state": 0.00912996753688927, "sim_compute_performance-ego0": 0.0021350358321063157}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.36753027480778266, "get_ui_image": 0.03573724817722402, "step_physics": 0.15182704113899392, "survival_time": 4.6499999999999915, "driven_lanedir": 0.21771483898574884, "get_state_dump": 0.004685001170381587, "get_robot_state": 0.0035924328134415, "sim_render-ego0": 0.00412474033680368, "get_duckie_state": 1.3468113351375498e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 1.5368525977901208, "agent_compute-ego0": 0.012331074856697244, "complete-iteration": 0.227379598516099, "set_robot_commands": 0.0022357550073177257, "deviation-center-line": 0.207683331068878, "driven_lanedir_consec": 0.21771483898574884, "sim_compute_sim_state": 0.010737076718756492, "sim_compute_performance-ego0": 0.002017180970374574}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.822884536647169, "get_ui_image": 0.03375931408094323, "step_physics": 0.11299764522607776, "survival_time": 34.45000000000018, "driven_lanedir": 0.695808700013326, "get_state_dump": 0.004866210965142734, "get_robot_state": 0.0039105570834615955, "sim_render-ego0": 0.004194220943727355, "get_duckie_state": 1.4014866041100543e-06, "in-drivable-lane": 29.25000000000016, "deviation-heading": 3.3346449087037167, "agent_compute-ego0": 0.012807979099992392, "complete-iteration": 0.19028359254201252, "set_robot_commands": 0.0023658438005309174, "deviation-center-line": 0.32624736123742537, "driven_lanedir_consec": 0.6914170981837193, "sim_compute_sim_state": 0.01305642438971478, "sim_compute_performance-ego0": 0.002221698346345321}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.7139625862218817, "get_ui_image": 0.02677927575212844, "step_physics": 0.09705531850774238, "survival_time": 23.4500000000002, "driven_lanedir": 2.47439762579513, "get_state_dump": 0.0048601749095510925, "get_robot_state": 0.003829333630013973, "sim_render-ego0": 0.0039569616317749025, "get_duckie_state": 1.4097132581345578e-06, "in-drivable-lane": 6.950000000000099, "deviation-heading": 4.507880200412496, "agent_compute-ego0": 0.035293635408929054, "complete-iteration": 0.18252077863571492, "set_robot_commands": 0.0022887706756591795, "deviation-center-line": 1.238823067884464, "driven_lanedir_consec": 2.47439762579513, "sim_compute_sim_state": 0.00631669430022544, "sim_compute_performance-ego0": 0.002039387885560381}}
set_robot_commands_max0.0023719940685046517
set_robot_commands_mean0.0023155908880031183
set_robot_commands_median0.0023273072380950487
set_robot_commands_min0.0022357550073177257
sim_compute_performance-ego0_max0.002221698346345321
sim_compute_performance-ego0_mean0.002103325758596648
sim_compute_performance-ego0_median0.0020872118588333485
sim_compute_performance-ego0_min0.002017180970374574
sim_compute_sim_state_max0.01305642438971478
sim_compute_sim_state_mean0.009810040736396497
sim_compute_sim_state_median0.00993352212782288
sim_compute_sim_state_min0.00631669430022544
sim_render-ego0_max0.004194220943727355
sim_render-ego0_mean0.004084043781729287
sim_render-ego0_median0.004092496275707446
sim_render-ego0_min0.0039569616317749025
simulation-passed1
step_physics_max0.15182704113899392
step_physics_mean0.11631930107223788
step_physics_median0.1081974223211076
step_physics_min0.09705531850774238
survival_time_max51.49999999999921
survival_time_mean28.512499999999896
survival_time_min4.6499999999999915
No reset possible
58064LFv-simhost-erroryes0:17:54
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 803, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 45, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 265, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 272, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 163, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 149, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/aido5-LF-sim-validation/submission9781/LFv-sim-nogpu-prod-03_47baaefc82c8-job58064-a-wd/docker-compose.yaml' -> '/tmp/tmpynl3l4z2docker-compose.yaml'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
52120LFv-simerrorno0:09:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140522296532512
- M:video_aido:cmdline(in:/;out:/) 140522295425632
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
41635LFv-simsuccessno0:08:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
41634LFv-simsuccessno0:08:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38028LFv-simsuccessno0:08:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
36187LFv-simsuccessno0:09:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
35934LFv-simsuccessno0:07:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
35593LFv-simsuccessno0:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
35591LFv-simsuccessno0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
35244LFv-simsuccessno0:19:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
35237LFv-simerrorno0:14:26
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible