Duckietown Challenges Home Challenges Submissions

Evaluator 1433

ID1433
evaluatorp-4790
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processp-4790
versiond-c:4.0.30;d-c-r:4.0.47;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success5 23679
# timeout
# failed
# error3 23904
# aborted4 23763
# host-error1 23717
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
239933788Andrés Calderón 🇨🇴challenge-aido_LF-template-randomaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyesp-47900:07:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1420917933500266
agent_compute-ego_mean0.13836231020891177
agent_compute-ego_median0.13751234327043807
agent_compute-ego_min0.1361673048564366
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.11906738220890864, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.052759436112415944, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1420917933500266, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0789836841293528, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03300911867165867, "sim_compute_performance-ego": 0.055867038195646264, "sim_compute_robot_state-ego": 0.05984573122821277, "sim_compute_robot_state-npc0": 0.06335382823702655, "sim_compute_robot_state-npc1": 0.06003046337562271, "sim_compute_robot_state-npc2": 0.05936405930338027, "sim_compute_robot_state-npc3": 0.05915416645098336}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.11425032785960608, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.05335842711584909, "in-drivable-lane": 0, "agent_compute-ego": 0.1361673048564366, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.07468307018280029, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03353511435644967, "sim_compute_performance-ego": 0.05999536173684256, "sim_compute_robot_state-ego": 0.060704444135938375, "sim_compute_robot_state-npc0": 0.0595095157623291, "sim_compute_robot_state-npc1": 0.05674535036087036, "sim_compute_robot_state-npc2": 0.057753562927246094, "sim_compute_robot_state-npc3": 0.05873556647981916}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1219612348426893, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05554584623540489, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1370256618388648, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0775083569647039, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03346439704154302, "sim_compute_performance-ego": 0.0592113814307648, "sim_compute_robot_state-ego": 0.060506445690266135, "sim_compute_robot_state-npc0": 0.06276333679273291, "sim_compute_robot_state-npc1": 0.059327650996087826, "sim_compute_robot_state-npc2": 0.05902887779532127, "sim_compute_robot_state-npc3": 0.05862139035197138}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1435134063164393, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.059446280201276146, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.13901444772879282, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08177541196346283, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.036420002579689026, "sim_compute_performance-ego": 0.06401939193407695, "sim_compute_robot_state-ego": 0.06662533680597942, "sim_compute_robot_state-npc0": 0.06619328260421753, "sim_compute_robot_state-npc1": 0.0627124011516571, "sim_compute_robot_state-npc2": 0.06268198291460673, "sim_compute_robot_state-npc3": 0.06289344529310863}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.140973238717942, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.05735848063514346, "in-drivable-lane": 0, "agent_compute-ego": 0.13751234327043807, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07584376562209356, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.034110829943702334, "sim_compute_performance-ego": 0.06307332856314522, "sim_compute_robot_state-ego": 0.06434010324024018, "sim_compute_robot_state-npc0": 0.07094452494666689, "sim_compute_robot_state-npc1": 0.06373289653233119, "sim_compute_robot_state-npc2": 0.06209653899783179, "sim_compute_robot_state-npc3": 0.062338068371727354}}
set_robot_commands_max0.08177541196346283
set_robot_commands_mean0.07775885777248268
set_robot_commands_median0.0775083569647039
set_robot_commands_min0.07468307018280029
sim_compute_performance-ego_max0.06401939193407695
sim_compute_performance-ego_mean0.06043330037209517
sim_compute_performance-ego_median0.05999536173684256
sim_compute_performance-ego_min0.055867038195646264
sim_compute_robot_state-ego_max0.06662533680597942
sim_compute_robot_state-ego_mean0.06240441222012738
sim_compute_robot_state-ego_median0.060704444135938375
sim_compute_robot_state-ego_min0.05984573122821277
sim_compute_robot_state-npc0_max0.07094452494666689
sim_compute_robot_state-npc0_mean0.0645528976685946
sim_compute_robot_state-npc0_median0.06335382823702655
sim_compute_robot_state-npc0_min0.0595095157623291
sim_compute_robot_state-npc1_max0.06373289653233119
sim_compute_robot_state-npc1_mean0.06050975248331384
sim_compute_robot_state-npc1_median0.06003046337562271
sim_compute_robot_state-npc1_min0.05674535036087036
sim_compute_robot_state-npc2_max0.06268198291460673
sim_compute_robot_state-npc2_mean0.06018500438767723
sim_compute_robot_state-npc2_median0.05936405930338027
sim_compute_robot_state-npc2_min0.057753562927246094
sim_compute_robot_state-npc3_max0.06289344529310863
sim_compute_robot_state-npc3_mean0.060348527389521976
sim_compute_robot_state-npc3_median0.05915416645098336
sim_compute_robot_state-npc3_min0.05862139035197138
sim_compute_sim_state_max0.036420002579689026
sim_compute_sim_state_mean0.03410789251860854
sim_compute_sim_state_median0.03353511435644967
sim_compute_sim_state_min0.03300911867165867
sim_physics_max0.1435134063164393
sim_physics_mean0.12795311798911707
sim_physics_median0.1219612348426893
sim_physics_min0.11425032785960608
sim_render-ego_max0.059446280201276146
sim_render-ego_mean0.05569369406001791
sim_render-ego_median0.05554584623540489
sim_render-ego_min0.052759436112415944
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
239773631Nicky Eichmannaido2-LFVI-real-validationeval1-videos-watchtowerserroryesp-47903:00:37
Waited 10802 seconds [...]
Waited 10802 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239763631Nicky Eichmannaido2-LFVI-real-validationeval1-videos-autobotssuccessyesp-47900:25:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239493766Anastasiya Nikolskaya 🇷🇺Boxed Solution 0.2aido2-LFV-real-validationeval0-videos-autobotserroryesp-47903:00:28
Waited 10802 seconds [...]
Waited 10802 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239043764Anastasiya Nikolskaya 🇷🇺FINALaido2-LF-real-validationeval0-videos-watchtowerserroryesp-47903:00:32
Waited 10800 seconds [...]
Waited 10800 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
238203775Anastasiya Nikolskaya 🇷🇺Offset-based Oneaido2-LFV-real-validationeval0-videos-watchtowersabortedyesp-47903:00:39
Waited 10800 seconds [...]
Waited 10800 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
238103775Anastasiya Nikolskaya 🇷🇺Offset-based Oneaido2-LFV-real-validationeval0-videos-autobotssuccessyesp-47900:15:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237903770Anastasiya Nikolskaya 🇷🇺Boxed Solution 0.3aido2-LFVI-real-validationeval0-videos-autobotsabortedyesp-47901:16:47
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 820, in run_one
    time.sleep(5)
KeyboardInterrupt
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237813773Anastasiya Nikolskaya 🇷🇺Fine-tuned netaido2-LFVI-real-validationeval0-videos-autobotsabortedyesp-47901:07:42
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 820, in run_one
    time.sleep(5)
KeyboardInterrupt
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237633751sebastian glatzaido2-LFVI-real-validationeval0-videos-autobotsabortedyesp-47902:57:57
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237173608Riza Velioglu 🇩🇪aido2-LFV-real-validationeval1-videos-watchtowershost-erroryesp-47901:39:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1363, in upload
    copy_to_cache(realfile, sha256hex)
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner_cache.py", line 41, in copy_to_cache
    shutil.copy(fn, have)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237123608Riza Velioglu 🇩🇪aido2-LFV-real-validationeval1-videos-autobotssuccessyesp-47900:10:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
236793663jiang pengRL-TH-hhkaido2-LF-real-validationeval0-videos-watchtowerssuccessyesp-47901:33:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible