Duckietown Challenges Home Challenges Submissions

Submission 3372

Submission3372
Competingyes
Challengeaido2-LFVI-sim-validation
UserAmaury Camus 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22369
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

22369

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-1-0

udem1-2-0

udem1-3-0

udem1-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22369step1-simulationsuccessyes0:07:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15055601937430246
agent_compute-ego_mean0.14567213584090416
agent_compute-ego_median0.1449799144152299
agent_compute-ego_min0.14283205568790436
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.12012861348405668, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06082832662365104, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14283727995957, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.07631296145765087, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.035589498809621305, "sim_compute_performance-ego": 0.06371137763880476, "sim_compute_robot_state-ego": 0.06263763391518895, "sim_compute_robot_state-npc0": 0.07011581372611131, "sim_compute_robot_state-npc1": 0.06446102601063403, "sim_compute_robot_state-npc2": 0.06306147877174088, "sim_compute_robot_state-npc3": 0.06336311147182802}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.12211824314934867, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06218556846891131, "in-drivable-lane": 0, "agent_compute-ego": 0.15055601937430246, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.08068015745707921, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03554949590138027, "sim_compute_performance-ego": 0.06168184961591448, "sim_compute_robot_state-ego": 0.06548082828521729, "sim_compute_robot_state-npc0": 0.07619015659604754, "sim_compute_robot_state-npc1": 0.0646371841430664, "sim_compute_robot_state-npc2": 0.06254759856632777, "sim_compute_robot_state-npc3": 0.06448216949190412}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.11922996946908895, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.061013934681716474, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1449799144152299, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.07875880917299141, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03636310401472073, "sim_compute_performance-ego": 0.06316477812609626, "sim_compute_robot_state-ego": 0.06375958387134145, "sim_compute_robot_state-npc0": 0.07215185535764232, "sim_compute_robot_state-npc1": 0.06461230296533084, "sim_compute_robot_state-npc2": 0.0627233056188787, "sim_compute_robot_state-npc3": 0.06313626048634353}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.12328871587912242, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.059601018826166786, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14283205568790436, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07882741093635559, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03582717478275299, "sim_compute_performance-ego": 0.0648477574189504, "sim_compute_robot_state-ego": 0.06345211962858836, "sim_compute_robot_state-npc0": 0.07103179395198822, "sim_compute_robot_state-npc1": 0.06510089834531148, "sim_compute_robot_state-npc2": 0.06341751416524251, "sim_compute_robot_state-npc3": 0.06261361141999562}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1248404752640497, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06204137347993397, "in-drivable-lane": 0, "agent_compute-ego": 0.14715540976751418, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07999387241545178, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03456848008292062, "sim_compute_performance-ego": 0.06542063894725982, "sim_compute_robot_state-ego": 0.0635958853222075, "sim_compute_robot_state-npc0": 0.06827496346973237, "sim_compute_robot_state-npc1": 0.06257539703732445, "sim_compute_robot_state-npc2": 0.06334359305245536, "sim_compute_robot_state-npc3": 0.06221901802789597}}
set_robot_commands_max0.08068015745707921
set_robot_commands_mean0.07891464228790576
set_robot_commands_median0.07882741093635559
set_robot_commands_min0.07631296145765087
sim_compute_performance-ego_max0.06542063894725982
sim_compute_performance-ego_mean0.06376528034940514
sim_compute_performance-ego_median0.06371137763880476
sim_compute_performance-ego_min0.06168184961591448
sim_compute_robot_state-ego_max0.06548082828521729
sim_compute_robot_state-ego_mean0.06378521020450871
sim_compute_robot_state-ego_median0.0635958853222075
sim_compute_robot_state-ego_min0.06263763391518895
sim_compute_robot_state-npc0_max0.07619015659604754
sim_compute_robot_state-npc0_mean0.07155291662030436
sim_compute_robot_state-npc0_median0.07103179395198822
sim_compute_robot_state-npc0_min0.06827496346973237
sim_compute_robot_state-npc1_max0.06510089834531148
sim_compute_robot_state-npc1_mean0.06427736170033344
sim_compute_robot_state-npc1_median0.06461230296533084
sim_compute_robot_state-npc1_min0.06257539703732445
sim_compute_robot_state-npc2_max0.06341751416524251
sim_compute_robot_state-npc2_mean0.06301869803492904
sim_compute_robot_state-npc2_median0.06306147877174088
sim_compute_robot_state-npc2_min0.06254759856632777
sim_compute_robot_state-npc3_max0.06448216949190412
sim_compute_robot_state-npc3_mean0.06316283417959345
sim_compute_robot_state-npc3_median0.06313626048634353
sim_compute_robot_state-npc3_min0.06221901802789597
sim_compute_sim_state_max0.03636310401472073
sim_compute_sim_state_mean0.03557955071827919
sim_compute_sim_state_median0.035589498809621305
sim_compute_sim_state_min0.03456848008292062
sim_physics_max0.1248404752640497
sim_physics_mean0.12192120344913328
sim_physics_median0.12211824314934867
sim_physics_min0.11922996946908895
sim_render-ego_max0.06218556846891131
sim_render-ego_mean0.061134044416075915
sim_render-ego_median0.061013934681716474
sim_render-ego_min0.059601018826166786
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
21990step1-simulationsuccessno0:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21987step1-simulationsuccessno0:08:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21980step1-simulationhost-errorno0:03:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1066, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job21980-380060', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 535, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1071, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job21980-380060', 'down']:

   >  Command '['docker-compose', '-p', 'job21980-380060', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21955step1-simulationtimeoutno1:05:32
I can see how the jo [...]
I can see how the job 21955 is timeout because passed 3931 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21951step1-simulationtimeoutno1:05:48
I can see how the jo [...]
I can see how the job 21951 is timeout because passed 3947 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible