Duckietown Challenges Home Challenges Submissions

Submission 10761

Submission10761
Competingyes
Challengeaido5-LF-sim-validation
UserFernanda Custodio Pereira do Carmo 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57917
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

57917

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
57917LFv-simsuccessyes0:29:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.725588733388008
survival_time_median45.449999999999555
deviation-center-line_median2.8364559748340725
in-drivable-lane_median8.799999999999576


other stats
agent_compute-ego0_max0.043809619469520375
agent_compute-ego0_mean0.03609876721006019
agent_compute-ego0_median0.03844680588324555
agent_compute-ego0_min0.023691837604229268
complete-iteration_max0.21009168335348552
complete-iteration_mean0.2002332238470194
complete-iteration_median0.20526856004952063
complete-iteration_min0.18030409193555083
deviation-center-line_max4.329089770109452
deviation-center-line_mean2.891652509426798
deviation-center-line_min1.5646083179295958
deviation-heading_max7.727418789889517
deviation-heading_mean5.910760986774456
deviation-heading_median5.579248073008276
deviation-heading_min4.757129011191753
driven_any_max9.49062237187158
driven_any_mean7.170356642226713
driven_any_median6.638620025162751
driven_any_min5.913564146709767
driven_lanedir_consec_max7.146084058221088
driven_lanedir_consec_mean5.833625902604246
driven_lanedir_consec_min4.737242085419879
driven_lanedir_max7.146084058221088
driven_lanedir_mean5.833625902604246
driven_lanedir_median5.725588733388008
driven_lanedir_min4.737242085419879
get_duckie_state_max1.651863766531659e-06
get_duckie_state_mean1.464200127097902e-06
get_duckie_state_median1.4632879547140756e-06
get_duckie_state_min1.278360832431798e-06
get_robot_state_max0.003977134186997373
get_robot_state_mean0.0037779368038451944
get_robot_state_median0.0037916591818099726
get_robot_state_min0.003551294664763459
get_state_dump_max0.004899308212801942
get_state_dump_mean0.004661419646738703
get_state_dump_median0.00463577941600766
get_state_dump_min0.004474811542137552
get_ui_image_max0.03343623248765607
get_ui_image_mean0.030182194382497415
get_ui_image_median0.030991994320237495
get_ui_image_min0.02530855640185862
in-drivable-lane_max15.249999999999424
in-drivable-lane_mean9.274999999999602
in-drivable-lane_min4.249999999999837
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.13165024685864, "get_ui_image": 0.0295174338369288, "step_physics": 0.10411198755614778, "survival_time": 46.74999999999948, "driven_lanedir": 6.2218418428496145, "get_state_dump": 0.004899308212801942, "get_robot_state": 0.003977134186997373, "sim_render-ego0": 0.004200721653098734, "get_duckie_state": 1.651863766531659e-06, "in-drivable-lane": 7.099999999999596, "deviation-heading": 4.757129011191753, "agent_compute-ego0": 0.043809619469520375, "complete-iteration": 0.20583405988848108, "set_robot_commands": 0.0024586780967875426, "deviation-center-line": 1.5646083179295958, "driven_lanedir_consec": 6.2218418428496145, "sim_compute_sim_state": 0.01052878198460636, "sim_compute_performance-ego0": 0.002233534796625121}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.913564146709767, "get_ui_image": 0.03343623248765607, "step_physics": 0.11230809419719408, "survival_time": 40.29999999999985, "driven_lanedir": 5.229335623926402, "get_state_dump": 0.004474811542137552, "get_robot_state": 0.003551294664763459, "sim_render-ego0": 0.003680121056652424, "get_duckie_state": 1.278360832431798e-06, "in-drivable-lane": 4.249999999999837, "deviation-heading": 5.604092626763248, "agent_compute-ego0": 0.037742582838774616, "complete-iteration": 0.21009168335348552, "set_robot_commands": 0.0020959229569748284, "deviation-center-line": 3.072206638107624, "driven_lanedir_consec": 5.229335623926402, "sim_compute_sim_state": 0.010852020764734962, "sim_compute_performance-ego0": 0.0018664641303496143}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.145589803466864, "get_ui_image": 0.032466554803546196, "step_physics": 0.1174784947304704, "survival_time": 44.14999999999963, "driven_lanedir": 4.737242085419879, "get_state_dump": 0.004722185534050022, "get_robot_state": 0.003947366147019744, "sim_render-ego0": 0.004072027238785411, "get_duckie_state": 1.589367292585416e-06, "in-drivable-lane": 10.499999999999556, "deviation-heading": 5.554403519253303, "agent_compute-ego0": 0.023691837604229268, "complete-iteration": 0.20470306021056023, "set_robot_commands": 0.002434977309196783, "deviation-center-line": 2.600705311560521, "driven_lanedir_consec": 4.737242085419879, "sim_compute_sim_state": 0.013492043471444249, "sim_compute_performance-ego0": 0.0022989222906293913}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.49062237187158, "get_ui_image": 0.02530855640185862, "step_physics": 0.09357830150042049, "survival_time": 59.99999999999873, "driven_lanedir": 7.146084058221088, "get_state_dump": 0.004549373297965298, "get_robot_state": 0.003635952216600201, "sim_render-ego0": 0.0037657386754375017, "get_duckie_state": 1.337208616842735e-06, "in-drivable-lane": 15.249999999999424, "deviation-heading": 7.727418789889517, "agent_compute-ego0": 0.03915102892771648, "complete-iteration": 0.18030409193555083, "set_robot_commands": 0.0022213830241156456, "deviation-center-line": 4.329089770109452, "driven_lanedir_consec": 7.146084058221088, "sim_compute_sim_state": 0.006094880346255338, "sim_compute_performance-ego0": 0.001912402074402516}}
set_robot_commands_max0.0024586780967875426
set_robot_commands_mean0.0023027403467687
set_robot_commands_median0.002328180166656214
set_robot_commands_min0.0020959229569748284
sim_compute_performance-ego0_max0.0022989222906293913
sim_compute_performance-ego0_mean0.002077830823001661
sim_compute_performance-ego0_median0.0020729684355138187
sim_compute_performance-ego0_min0.0018664641303496143
sim_compute_sim_state_max0.013492043471444249
sim_compute_sim_state_mean0.010241931641760228
sim_compute_sim_state_median0.01069040137467066
sim_compute_sim_state_min0.006094880346255338
sim_render-ego0_max0.004200721653098734
sim_render-ego0_mean0.003929652155993518
sim_render-ego0_median0.003918882957111456
sim_render-ego0_min0.003680121056652424
simulation-passed1
step_physics_max0.1174784947304704
step_physics_mean0.10686921949605818
step_physics_median0.10821004087667094
step_physics_min0.09357830150042049
survival_time_max59.99999999999873
survival_time_mean47.79999999999942
survival_time_min40.29999999999985
No reset possible
51774LFv-simerrorno0:08:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139621818492912
- M:video_aido:cmdline(in:/;out:/) 139621818494448
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
51771LFv-simerrorno0:03:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140352577039184
- M:video_aido:cmdline(in:/;out:/) 140352578278592
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
51769LFv-simhost-errorno0:10:09
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
51758LFv-simhost-errorno0:07:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
51754LFv-simerrorno0:06:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140531551221648
- M:video_aido:cmdline(in:/;out:/) 140531549206608
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40992LFv-simsuccessno0:09:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40991LFv-simsuccessno0:09:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
37122LFv-simsuccessno0:10:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
37121LFv-simsuccessno0:10:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible