Duckietown Challenges Home Challenges Submissions

Submission 11078

Submission11078
Competingyes
Challengeaido5-LF-sim-validation
UserOlga (Ge Ya) Xu 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 56816
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

56816

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
56816LFv-simsuccessyes0:33:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.679907133578869
survival_time_median59.99999999999873
deviation-center-line_median4.028918160860801
in-drivable-lane_median6.724999999999772


other stats
agent_compute-ego0_max0.03393631751690181
agent_compute-ego0_mean0.030598816377336437
agent_compute-ego0_median0.03357071940051229
agent_compute-ego0_min0.02131750919141936
complete-iteration_max0.20262345723764383
complete-iteration_mean0.17796792902616934
complete-iteration_median0.17108821174087968
complete-iteration_min0.16707183538527412
deviation-center-line_max4.372243793007847
deviation-center-line_mean4.087731026177904
deviation-center-line_min3.920843989982169
deviation-heading_max15.722271009162286
deviation-heading_mean14.184439618223596
deviation-heading_median14.234904612715278
deviation-heading_min12.54567823830154
driven_any_max11.371436909197651
driven_any_mean8.9241266998913
driven_any_median8.773070347229694
driven_any_min6.77892919590816
driven_lanedir_consec_max10.589909016703675
driven_lanedir_consec_mean7.437618768874182
driven_lanedir_consec_min5.800751791635315
driven_lanedir_max10.589909016703675
driven_lanedir_mean7.937277956219926
driven_lanedir_median7.679225508270358
driven_lanedir_min5.800751791635315
get_duckie_state_max1.3344293827816013e-06
get_duckie_state_mean1.273038087538339e-06
get_duckie_state_median1.2663381482838195e-06
get_duckie_state_min1.225046670804115e-06
get_robot_state_max0.0035282606685489142
get_robot_state_mean0.003487800926491184
get_robot_state_median0.003490250176136738
get_robot_state_min0.0034424426851423456
get_state_dump_max0.004558607501650135
get_state_dump_mean0.004369808176375746
get_state_dump_median0.004367933583001511
get_state_dump_min0.004184758037849827
get_ui_image_max0.03360814734561358
get_ui_image_mean0.028554928491355776
get_ui_image_median0.027804133695527776
get_ui_image_min0.025003299228753977
in-drivable-lane_max10.449999999999957
in-drivable-lane_mean7.237499999999864
in-drivable-lane_min5.0499999999999545
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.371436909197651, "get_ui_image": 0.02672872158212527, "step_physics": 0.08924710383323904, "survival_time": 59.99999999999873, "driven_lanedir": 10.589909016703675, "get_state_dump": 0.004357277999611124, "get_robot_state": 0.003470007724110828, "sim_render-ego0": 0.003665513341174733, "get_duckie_state": 1.3344293827816013e-06, "in-drivable-lane": 5.699999999999797, "deviation-heading": 12.54567823830154, "agent_compute-ego0": 0.03352817905435554, "complete-iteration": 0.17352820514739303, "set_robot_commands": 0.0021734450083787395, "deviation-center-line": 4.051205235013524, "driven_lanedir_consec": 10.589909016703675, "sim_compute_sim_state": 0.008433783679679471, "sim_compute_performance-ego0": 0.0018403972813132205}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.77892919590816, "get_ui_image": 0.03360814734561358, "step_physics": 0.10819735812902648, "survival_time": 59.99999999999873, "driven_lanedir": 5.800751791635315, "get_state_dump": 0.004378589166391898, "get_robot_state": 0.0035282606685489142, "sim_render-ego0": 0.0037698346708934577, "get_duckie_state": 1.2387443243911324e-06, "in-drivable-lane": 7.749999999999748, "deviation-heading": 15.722271009162286, "agent_compute-ego0": 0.03393631751690181, "complete-iteration": 0.20262345723764383, "set_robot_commands": 0.0021569347699218547, "deviation-center-line": 4.006631086708078, "driven_lanedir_consec": 5.800751791635315, "sim_compute_sim_state": 0.01100485152150074, "sim_compute_performance-ego0": 0.0019590130058752308}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.902782319507624, "get_ui_image": 0.028879545808930283, "step_physics": 0.09144402582579904, "survival_time": 59.99999999999873, "driven_lanedir": 7.080858331793782, "get_state_dump": 0.004184758037849827, "get_robot_state": 0.0034424426851423456, "sim_render-ego0": 0.0036584634169452295, "get_duckie_state": 1.225046670804115e-06, "in-drivable-lane": 5.0499999999999545, "deviation-heading": 12.79002069815295, "agent_compute-ego0": 0.02131750919141936, "complete-iteration": 0.16864821833436633, "set_robot_commands": 0.0020487588410770564, "deviation-center-line": 4.372243793007847, "driven_lanedir_consec": 7.080858331793782, "sim_compute_sim_state": 0.011685926054637696, "sim_compute_performance-ego0": 0.0019084783914583509}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.643358374951768, "get_ui_image": 0.025003299228753977, "step_physics": 0.0865857936659026, "survival_time": 59.99999999999873, "driven_lanedir": 8.277592684746935, "get_state_dump": 0.004558607501650135, "get_robot_state": 0.003510492628162648, "sim_render-ego0": 0.0037202571055772, "get_duckie_state": 1.2939319721765066e-06, "in-drivable-lane": 10.449999999999957, "deviation-heading": 15.679788527277603, "agent_compute-ego0": 0.03361325974666904, "complete-iteration": 0.16707183538527412, "set_robot_commands": 0.002171617661983544, "deviation-center-line": 3.920843989982169, "driven_lanedir_consec": 6.278955935363957, "sim_compute_sim_state": 0.005937709697180247, "sim_compute_performance-ego0": 0.0018879648648531212}}
set_robot_commands_max0.0021734450083787395
set_robot_commands_mean0.0021376890703402986
set_robot_commands_median0.002164276215952699
set_robot_commands_min0.0020487588410770564
sim_compute_performance-ego0_max0.0019590130058752308
sim_compute_performance-ego0_mean0.0018989633858749809
sim_compute_performance-ego0_median0.001898221628155736
sim_compute_performance-ego0_min0.0018403972813132205
sim_compute_sim_state_max0.011685926054637696
sim_compute_sim_state_mean0.00926556773824954
sim_compute_sim_state_median0.009719317600590104
sim_compute_sim_state_min0.005937709697180247
sim_render-ego0_max0.0037698346708934577
sim_render-ego0_mean0.003703517133647655
sim_render-ego0_median0.003692885223375967
sim_render-ego0_min0.0036584634169452295
simulation-passed1
step_physics_max0.10819735812902648
step_physics_mean0.0938685703634918
step_physics_median0.09034556482951904
step_physics_min0.0865857936659026
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
56812LFv-simsuccessyes0:23:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
56811LFv-simsuccessyes0:34:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
56799LFv-simsuccessyes0:33:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
50745LFv-simerrorno0:09:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140692500321376
- M:video_aido:cmdline(in:/;out:/) 140692500321184
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
50737LFv-simhost-errorno0:09:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
50727LFv-simhost-errorno0:08:46
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40288LFv-simsuccessno0:10:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39673LFv-simsuccessno0:12:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39672LFv-simsuccessno0:09:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38863LFv-simsuccessno0:08:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38862LFv-simsuccessno0:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible