Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 113931308Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step1-simulation failed no nutonomy-P50-22102018-11-21 21:52:54+00:00 2018-11-21 21:53:45+00:00 0:00:51 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 135, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11384944Claudio Ruch Python template aido1_amod_efficiency_r1-v3step2-scoring success yes nutonomy-P50-22102018-11-21 20:58:11+00:00 2018-11-21 20:59:46+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency -73.46014637689947
other stats fleet_size -1000000000 service_quality -35.14982659422455
No reset possible 11375949Claudio Ruch Funky Controller 1 aido1_amod_service_quality_r1-v3step2-scoring success yes nutonomy-P50-22102018-11-21 20:56:12+00:00 2018-11-21 20:57:58+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -31.972205871029583
other stats efficiency -62.24230348411543 fleet_size -1000000000
No reset possible 11368944Claudio Ruch Python template aido1_amod_efficiency_r1-v3step1-simulation success yes nutonomy-P50-22102018-11-21 20:53:31+00:00 2018-11-21 20:56:07+00:00 0:02:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11353953Claudio Ruch Funky Controller 1 aido1_amod_fleet_size_r1-v3step2-scoring success yes nutonomy-P50-22102018-11-21 20:51:35+00:00 2018-11-21 20:53:23+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats efficiency -71.78208735945476 service_quality -34.48236183986373
No reset possible 11346950Claudio Ruch Funky Controller 1 aido1_amod_efficiency_r1-v3step1-simulation success yes nutonomy-P50-22102018-11-21 20:48:41+00:00 2018-11-21 20:51:28+00:00 0:02:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11336214Andrea Censi Java template aido1_amod_fleet_size_r1-v3step1-simulation error yes nutonomy-P50-22102018-11-21 20:38:02+00:00 2018-11-21 20:48:34+00:00 0:10:32 Timeout:
Waited 602 [...] Timeout:
Waited 602.011501074 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113351075Claudio Ruch Big Fleet Controller aido1_amod_service_quality_r1-v3step2-scoring success yes nutonomy-P50-22102018-11-21 20:37:38+00:00 2018-11-21 20:37:55+00:00 0:00:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -32.20435264541719
other stats efficiency -62.74909058166608 fleet_size -1000000000
No reset possible 113251075Claudio Ruch Big Fleet Controller aido1_amod_service_quality_r1-v3step1-simulation success yes nutonomy-P50-22102018-11-21 20:34:49+00:00 2018-11-21 20:37:32+00:00 0:02:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113221078Claudio Ruch Big Fleet Controller aido1_amod_fleet_size_r1-v3step1-simulation error yes nutonomy-P50-22102018-11-21 20:24:02+00:00 2018-11-21 20:34:42+00:00 0:10:40 Timeout:
Waited 601 [...] Timeout:
Waited 601.408833981 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113001307Tina Chu ROS-based Lane Following aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-22102018-11-21 10:20:30+00:00 2018-11-21 10:22:22+00:00 0:01:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112871306Tri Cao Baseline solution using imitation learning from logs aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-20 18:44:12+00:00 2018-11-20 18:47:50+00:00 0:03:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.126328901641123 deviation-center-line_median 0.415643248103966 in-drivable-lane_median 0.2333333333333325
other stats deviation-center-line_max 0.7541862215301725 deviation-center-line_mean 0.4892711559804683 deviation-center-line_min 0.24298771405394023 deviation-heading_max 2.447089970324129 deviation-heading_mean 1.298936339294108 deviation-heading_median 1.0187145134794806 deviation-heading_min 0.21585041143002096 driven_any_max 1.5956207756615906 driven_any_mean 0.9628076696138788 driven_any_median 1.1802158531170557 driven_any_min 0.31446540795764727 driven_lanedir_max 1.3608781016477778 driven_lanedir_mean 0.840751445772663 driven_lanedir_min 0.14435409354225948 in-drivable-lane_max 2.0999999999999925 in-drivable-lane_mean 0.6133333333333317 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3610528764051912, "driven_lanedir": 0.14435409354225948, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 2.447089970324129, "deviation-center-line": 0.24298771405394023}, "ep001": {"driven_any": 0.31446540795764727, "driven_lanedir": 0.31347372880387603, "in-drivable-lane": 0, "deviation-heading": 0.21585041143002096, "deviation-center-line": 0.29869339850706406}, "ep002": {"driven_any": 1.1802158531170557, "driven_lanedir": 1.126328901641123, "in-drivable-lane": 0.2333333333333325, "deviation-heading": 1.0187145134794806, "deviation-center-line": 0.7348451977071984}, "ep003": {"driven_any": 1.3626834349279089, "driven_lanedir": 1.3608781016477778, "in-drivable-lane": 0, "deviation-heading": 0.5398412378737178, "deviation-center-line": 0.7541862215301725}, "ep004": {"driven_any": 1.5956207756615906, "driven_lanedir": 1.2587224032282789, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 2.273185563363191, "deviation-center-line": 0.415643248103966}}
No reset possible 112821306Tri Cao Baseline solution using imitation learning from logs aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-22102018-11-20 18:41:54+00:00 2018-11-20 18:42:51+00:00 0:00:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112811306Tri Cao Baseline solution using imitation learning from logs aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-22102018-11-20 18:41:27+00:00 2018-11-20 18:41:46+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.199999999999974
other stats episodes details {"ep000": {"nsteps": 95, "reward": -10.783506638635146, "good_angle": 1.5058336819559393, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.666666666666665}, "ep001": {"nsteps": 83, "reward": -12.614138619368337, "good_angle": 0.017220027804123142, "survival_time": 2.7666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 306, "reward": -3.879368552244177, "good_angle": 1.199392002118851, "survival_time": 10.199999999999974, "traveled_tiles": 3, "valid_direction": 2.633333333333325}, "ep003": {"nsteps": 353, "reward": -3.1296388487682463, "good_angle": 0.03134739572415276, "survival_time": 11.766666666666636, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 413, "reward": -3.021035787713016, "good_angle": 23.628148302403908, "survival_time": 13.766666666666628, "traveled_tiles": 3, "valid_direction": 4.699999999999983}}good_angle_max 23.628148302403908 good_angle_mean 5.2763882820013945 good_angle_median 1.199392002118851 good_angle_min 0.017220027804123142 reward_max -3.021035787713016 reward_mean -6.685537689345783 reward_median -3.879368552244177 reward_min -12.614138619368337 survival_time_max 13.766666666666628 survival_time_mean 8.333333333333314 survival_time_min 2.7666666666666666 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 4.699999999999983 valid_direction_mean 1.999999999999995 valid_direction_median 2.633333333333325 valid_direction_min 0
No reset possible 112761306Tri Cao Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-20 18:38:01+00:00 2018-11-20 18:41:19+00:00 0:03:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112671305Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-20 14:36:32+00:00 2018-11-20 14:42:03+00:00 0:05:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 8.466416467829077 deviation-center-line_median 0.7491075821771831 in-drivable-lane_median 0.06666666666666643
other stats deviation-center-line_max 1.0852097769842697 deviation-center-line_mean 0.6828056697229344 deviation-center-line_min 0.110456458929874 deviation-heading_max 3.088169914104725 deviation-heading_mean 1.9361613489916736 deviation-heading_median 1.9716545225234337 deviation-heading_min 0.5532418461875583 driven_any_max 9.395397994412496 driven_any_mean 6.118783919231438 driven_any_median 8.673270359145661 driven_any_min 1.2271279931045092 driven_lanedir_max 9.106972393834644 driven_lanedir_mean 5.887907266761421 driven_lanedir_min 1.1523564491476126 in-drivable-lane_max 0.6999999999999994 in-drivable-lane_mean 0.19999999999999968 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 9.13343633823087, "driven_lanedir": 8.632442293612678, "in-drivable-lane": 0.6999999999999994, "deviation-heading": 2.9109849023974417, "deviation-center-line": 1.0852097769842697}, "ep001": {"driven_any": 2.164686911263656, "driven_lanedir": 2.0813487293830906, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.1567555597452082, "deviation-center-line": 0.3937472257413113}, "ep002": {"driven_any": 1.2271279931045092, "driven_lanedir": 1.1523564491476126, "in-drivable-lane": 0, "deviation-heading": 0.5532418461875583, "deviation-center-line": 0.110456458929874}, "ep003": {"driven_any": 9.395397994412496, "driven_lanedir": 9.106972393834644, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 3.088169914104725, "deviation-center-line": 1.0755073047820347}, "ep004": {"driven_any": 8.673270359145661, "driven_lanedir": 8.466416467829077, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.9716545225234337, "deviation-center-line": 0.7491075821771831}}
No reset possible 112581305Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-22102018-11-20 14:34:20+00:00 2018-11-20 14:36:02+00:00 0:01:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.999999999999956
other stats episodes details {"ep000": {"nsteps": 496, "reward": -2.0943019221591648, "good_angle": 0.7418744038601746, "survival_time": 16.533333333333314, "traveled_tiles": 15, "valid_direction": 2.0999999999999934}, "ep001": {"nsteps": 157, "reward": -6.806706450876608, "good_angle": 14.159941219201931, "survival_time": 5.2333333333333245, "traveled_tiles": 5, "valid_direction": 2.0999999999999996}, "ep002": {"nsteps": 59, "reward": -17.04080068322009, "good_angle": 0.15271570187640776, "survival_time": 1.9666666666666697, "traveled_tiles": 3, "valid_direction": 0.33333333333333437}, "ep003": {"nsteps": 500, "reward": 0.02414321799436584, "good_angle": 0.6871705559821161, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.1333333333333302}, "ep004": {"nsteps": 450, "reward": -2.2807499980605725, "good_angle": 35.64433197185651, "survival_time": 14.999999999999956, "traveled_tiles": 17, "valid_direction": 4.83333333333332}}good_angle_max 35.64433197185651 good_angle_mean 10.277206770555429 good_angle_median 0.7418744038601746 good_angle_min 0.15271570187640776 reward_max 0.02414321799436584 reward_mean -5.639683167264414 reward_median -2.2807499980605725 reward_min -17.04080068322009 survival_time_max 16.666666666666654 survival_time_mean 11.079999999999984 survival_time_min 1.9666666666666697 traveled_tiles_max 17 traveled_tiles_mean 11.2 traveled_tiles_median 15 traveled_tiles_min 3 valid_direction_max 4.83333333333332 valid_direction_mean 2.0999999999999956 valid_direction_median 2.0999999999999934 valid_direction_min 0.33333333333333437
No reset possible 112371304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-20 13:54:40+00:00 2018-11-20 14:00:59+00:00 0:06:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 8.562174484237758 deviation-center-line_median 0.7784140476070096 in-drivable-lane_median 0.29999999999999893
other stats deviation-center-line_max 0.8265762436927065 deviation-center-line_mean 0.7249512392397739 deviation-center-line_min 0.5702182166038914 deviation-heading_max 3.0638048935757873 deviation-heading_mean 2.527148965981655 deviation-heading_median 2.5224649823204026 deviation-heading_min 2.0232609899134695 driven_any_max 9.505485581933415 driven_any_mean 8.9320499466202 driven_any_median 9.184975142567506 driven_any_min 8.133230010945981 driven_lanedir_max 9.358315656087386 driven_lanedir_mean 8.602219035588002 driven_lanedir_min 7.828730971533036 in-drivable-lane_max 1.0000000000000044 in-drivable-lane_mean 0.4666666666666666 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 9.227693948046904, "driven_lanedir": 8.715607043574893, "in-drivable-lane": 1.0000000000000044, "deviation-heading": 3.0638048935757873, "deviation-center-line": 0.8216737935350183}, "ep001": {"driven_any": 8.133230010945981, "driven_lanedir": 7.828730971533036, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 2.813692563233782, "deviation-center-line": 0.6278738947602437}, "ep002": {"driven_any": 9.184975142567506, "driven_lanedir": 8.562174484237758, "in-drivable-lane": 0.9999999999999968, "deviation-heading": 2.2125214008648344, "deviation-center-line": 0.7784140476070096}, "ep003": {"driven_any": 9.505485581933415, "driven_lanedir": 9.358315656087386, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.5224649823204026, "deviation-center-line": 0.8265762436927065}, "ep004": {"driven_any": 8.608865049607198, "driven_lanedir": 8.546267022506928, "in-drivable-lane": 0, "deviation-heading": 2.0232609899134695, "deviation-center-line": 0.5702182166038914}}
No reset possible 112361304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-22102018-11-20 13:51:21+00:00 2018-11-20 13:54:26+00:00 0:03:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112261304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-22102018-11-20 13:49:29+00:00 2018-11-20 13:51:12+00:00 0:01:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.025241015423089267, "good_angle": 0.5660956539852379, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.3333333333333302}, "ep001": {"nsteps": 500, "reward": -0.3052277488233522, "good_angle": 41.3027307319338, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.600000000000018}, "ep002": {"nsteps": 500, "reward": -0.10230048004770652, "good_angle": 0.6659104569093917, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.9666666666666597}, "ep003": {"nsteps": 500, "reward": -0.06712517729547107, "good_angle": 0.4061192818354377, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 0.9333333333333308}, "ep004": {"nsteps": 500, "reward": -0.3235300897718407, "good_angle": 41.2754370289088, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.099999999999985}}good_angle_max 41.3027307319338 good_angle_mean 16.843258630714534 good_angle_median 0.6659104569093917 good_angle_min 0.4061192818354377 reward_max -0.025241015423089267 reward_mean -0.16468490227229196 reward_median -0.10230048004770652 reward_min -0.3235300897718407 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 17 traveled_tiles_mean 16.4 traveled_tiles_median 16 traveled_tiles_min 16 valid_direction_max 5.600000000000018 valid_direction_mean 2.986666666666665 valid_direction_median 1.9666666666666597 valid_direction_min 0.9333333333333308
No reset possible 112081304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-20 13:40:57+00:00 2018-11-20 13:46:05+00:00 0:05:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112061303Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-20 13:29:31+00:00 2018-11-20 13:35:13+00:00 0:05:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 4.247947866530568 deviation-center-line_median 0.4327948281734701 in-drivable-lane_median 0.33333333333333215
other stats deviation-center-line_max 0.8951573984927605 deviation-center-line_mean 0.5294639676056159 deviation-center-line_min 0.2553864082264141 deviation-heading_max 2.5086434238842648 deviation-heading_mean 1.7176914721650511 deviation-heading_median 1.3764712107670771 deviation-heading_min 0.935815621123276 driven_any_max 9.83643308694634 driven_any_mean 5.49635327088284 driven_any_median 4.3797351459243234 driven_any_min 2.1044204655967538 driven_lanedir_max 9.247955113262256 driven_lanedir_mean 5.215254784547498 driven_lanedir_min 1.8076115267915815 in-drivable-lane_max 0.7999999999999972 in-drivable-lane_mean 0.3466666666666658 in-drivable-lane_min 0.033333333333333215 per-episodes details {"ep000": {"driven_any": 2.4350440530543422, "driven_lanedir": 2.1641183480391843, "in-drivable-lane": 0.5, "deviation-heading": 0.935815621123276, "deviation-center-line": 0.2553864082264141}, "ep001": {"driven_any": 2.1044204655967538, "driven_lanedir": 1.8076115267915815, "in-drivable-lane": 0.33333333333333215, "deviation-heading": 1.3764712107670771, "deviation-center-line": 0.3623346537121123}, "ep002": {"driven_any": 9.83643308694634, "driven_lanedir": 9.247955113262256, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 2.4644149719140565, "deviation-center-line": 0.8951573984927605}, "ep003": {"driven_any": 4.3797351459243234, "driven_lanedir": 4.247947866530568, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.3031121331365825, "deviation-center-line": 0.4327948281734701}, "ep004": {"driven_any": 8.726133602892439, "driven_lanedir": 8.608641068113897, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.5086434238842648, "deviation-center-line": 0.701646549423322}}
No reset possible 111861303Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-20 13:18:46+00:00 2018-11-20 13:24:35+00:00 0:05:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111781302Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-20 12:15:34+00:00 2018-11-20 12:19:00+00:00 0:03:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5323895106250947 deviation-center-line_median 0.2069133082272764 in-drivable-lane_median 1.7666666666666604
other stats deviation-center-line_max 0.5467131081696794 deviation-center-line_mean 0.2602226065031052 deviation-center-line_min 0.109306961893104 deviation-heading_max 1.742323630223919 deviation-heading_mean 1.1567573530878712 deviation-heading_median 1.3282976503274275 deviation-heading_min 0.24355646859871627 driven_any_max 2.1899668958618665 driven_any_mean 0.991835190048022 driven_any_median 0.9696925230542558 driven_any_min 0.3178171092322331 driven_lanedir_max 0.7169311640978855 driven_lanedir_mean 0.45386049169510273 driven_lanedir_min 0.04178689899496413 in-drivable-lane_max 6.533333333333311 in-drivable-lane_mean 2.1733333333333262 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3178171092322331, "driven_lanedir": 0.04178689899496413, "in-drivable-lane": 0.633333333333334, "deviation-heading": 1.3282976503274275, "deviation-center-line": 0.109306961893104}, "ep001": {"driven_any": 1.1502565226532864, "driven_lanedir": 0.6512425203302821, "in-drivable-lane": 1.7666666666666604, "deviation-heading": 1.5861269978141073, "deviation-center-line": 0.30358180641808197}, "ep002": {"driven_any": 0.3314428994384689, "driven_lanedir": 0.32695236442728737, "in-drivable-lane": 0, "deviation-heading": 0.24355646859871627, "deviation-center-line": 0.1345978478073843}, "ep003": {"driven_any": 2.1899668958618665, "driven_lanedir": 0.7169311640978855, "in-drivable-lane": 6.533333333333311, "deviation-heading": 1.742323630223919, "deviation-center-line": 0.5467131081696794}, "ep004": {"driven_any": 0.9696925230542558, "driven_lanedir": 0.5323895106250947, "in-drivable-lane": 1.9333333333333265, "deviation-heading": 0.8834820184751857, "deviation-center-line": 0.2069133082272764}}
No reset possible 111681302Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-22102018-11-20 12:08:28+00:00 2018-11-20 12:10:06+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.66666666666666
other stats episodes details {"ep000": {"nsteps": 50, "reward": -20.329378296332433, "good_angle": 1.468160510939434, "survival_time": 1.6666666666666683, "traveled_tiles": 1, "valid_direction": 1.4000000000000017}, "ep001": {"nsteps": 171, "reward": -7.239350287157944, "good_angle": 12.220765922292202, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.066666666666656}, "ep002": {"nsteps": 49, "reward": -20.82356342794944, "good_angle": 0.0475471341694313, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.03333333333333344}, "ep003": {"nsteps": 328, "reward": -3.9637742684987263, "good_angle": 3.5554145744831076, "survival_time": 10.933333333333303, "traveled_tiles": 4, "valid_direction": 4.066666666666658}, "ep004": {"nsteps": 140, "reward": -8.124590363497763, "good_angle": 1.3339038883512928, "survival_time": 4.66666666666666, "traveled_tiles": 2, "valid_direction": 3.366666666666659}}good_angle_max 12.220765922292202 good_angle_mean 3.725158406047094 good_angle_median 1.468160510939434 good_angle_min 0.0475471341694313 reward_max -3.9637742684987263 reward_mean -12.09613132868726 reward_median -8.124590363497763 reward_min -20.82356342794944 survival_time_max 10.933333333333303 survival_time_mean 4.919999999999992 survival_time_min 1.633333333333335 traveled_tiles_max 4 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 4.066666666666658 valid_direction_mean 2.386666666666662 valid_direction_median 3.066666666666656 valid_direction_min 0.03333333333333344
No reset possible 111601301Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-20 11:23:39+00:00 2018-11-20 11:25:50+00:00 0:02:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.582873169132569 deviation-center-line_median 0.20455370794384953 in-drivable-lane_median 0.4
other stats deviation-center-line_max 0.3031086082543192 deviation-center-line_mean 0.20462843504646455 deviation-center-line_min 0.09141731520959732 deviation-heading_max 1.598602787656444 deviation-heading_mean 0.8809383171317908 deviation-heading_median 0.8108670692103306 deviation-heading_min 0.3346950565726476 driven_any_max 1.1630734025839593 driven_any_mean 0.722831473699513 driven_any_median 0.8007200595473488 driven_any_min 0.17684912442880266 driven_lanedir_max 0.7920217491121495 driven_lanedir_mean 0.46927076582913585 driven_lanedir_min 0.14426882883085923 in-drivable-lane_max 2.8666666666666565 in-drivable-lane_mean 1.1133333333333295 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.35853304939487557, "driven_lanedir": 0.14426882883085923, "in-drivable-lane": 0.4, "deviation-heading": 1.598602787656444, "deviation-center-line": 0.1668569456648827}, "ep001": {"driven_any": 1.1149817325425786, "driven_lanedir": 0.665637016607145, "in-drivable-lane": 2.299999999999992, "deviation-heading": 1.1635678494620274, "deviation-center-line": 0.3031086082543192}, "ep002": {"driven_any": 0.8007200595473488, "driven_lanedir": 0.7920217491121495, "in-drivable-lane": 0, "deviation-heading": 0.496958822757504, "deviation-center-line": 0.25720559815967414}, "ep003": {"driven_any": 1.1630734025839593, "driven_lanedir": 0.582873169132569, "in-drivable-lane": 2.8666666666666565, "deviation-heading": 0.8108670692103306, "deviation-center-line": 0.20455370794384953}, "ep004": {"driven_any": 0.17684912442880266, "driven_lanedir": 0.16155306546295645, "in-drivable-lane": 0, "deviation-heading": 0.3346950565726476, "deviation-center-line": 0.09141731520959732}}
No reset possible 111591301Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-22102018-11-20 11:22:23+00:00 2018-11-20 11:23:31+00:00 0:01:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111501301Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-22102018-11-20 11:20:38+00:00 2018-11-20 11:22:12+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.033333333333329
other stats episodes details {"ep000": {"nsteps": 60, "reward": -16.986505389073862, "good_angle": 0.9061986341032228, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 1.7666666666666693}, "ep001": {"nsteps": 175, "reward": -7.165024964154831, "good_angle": 16.00891330525849, "survival_time": 5.833333333333322, "traveled_tiles": 2, "valid_direction": 3.9333333333333234}, "ep002": {"nsteps": 121, "reward": -8.572560073753957, "good_angle": 0.1181062316229642, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 0.13333333333333286}, "ep003": {"nsteps": 183, "reward": -6.431596156241515, "good_angle": 1.08940483738514, "survival_time": 6.099999999999988, "traveled_tiles": 3, "valid_direction": 3.099999999999989}, "ep004": {"nsteps": 28, "reward": -36.25624855714185, "good_angle": 0.18152285177428645, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}}good_angle_max 16.00891330525849 good_angle_mean 3.66082917202882 good_angle_median 0.9061986341032228 good_angle_min 0.1181062316229642 reward_max -6.431596156241515 reward_mean -15.082387028073205 reward_median -8.572560073753957 reward_min -36.25624855714185 survival_time_max 6.099999999999988 survival_time_mean 3.779999999999995 survival_time_min 0.9333333333333332 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 3.9333333333333234 valid_direction_mean 1.879999999999996 valid_direction_median 1.7666666666666693 valid_direction_min 0.13333333333333286
No reset possible 111351300Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-20 10:25:41+00:00 2018-11-20 10:26:20+00:00 0:00:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 127, in run
solve(params, cis)
File "solution.py", line 89, in solve
cis.info('Logging. %s %s %s ' % (str(env.unwrapped.robot_speed), str(env.unwrapped.cur_pos), str(env.unwrapped.cur_angle)))
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'robot_speed'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111221299Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-20 10:19:40+00:00 2018-11-20 10:20:19+00:00 0:00:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 127, in run
solve(params, cis)
File "solution.py", line 72, in solve
env = make_env(config, debug=debug)
File "solution.py", line 38, in make_env
env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
AttributeError: 'module' object has no attribute 'UndistortWrapper'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111091297Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-20 09:54:54+00:00 2018-11-20 10:03:24+00:00 0:08:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 4.051829096858754 deviation-center-line_median 0.92971426400998 in-drivable-lane_median 0.09999999999999964
other stats deviation-center-line_max 0.942361718872175 deviation-center-line_mean 0.8572808146222097 deviation-center-line_min 0.6352737923652181 deviation-heading_max 4.154968182851831 deviation-heading_mean 3.0043615237383805 deviation-heading_median 3.2100480227248354 deviation-heading_min 1.448995458537678 driven_any_max 4.685052912313802 driven_any_mean 4.268651858623994 driven_any_median 4.270000785139785 driven_any_min 3.6056512932929903 driven_lanedir_max 4.666314634594814 driven_lanedir_mean 4.092641922881887 driven_lanedir_min 3.3140298965753785 in-drivable-lane_max 1.2666666666666664 in-drivable-lane_mean 0.3999999999999994 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 4.270000785139785, "driven_lanedir": 3.9149195004453623, "in-drivable-lane": 1.2666666666666664, "deviation-heading": 3.4530617576225806, "deviation-center-line": 0.92971426400998}, "ep001": {"driven_any": 3.6056512932929903, "driven_lanedir": 3.3140298965753785, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 4.154968182851831, "deviation-center-line": 0.942361718872175}, "ep002": {"driven_any": 4.151214909073667, "driven_lanedir": 4.051829096858754, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 2.7547341969549755, "deviation-center-line": 0.8444769561548144}, "ep003": {"driven_any": 4.631339393299723, "driven_lanedir": 4.516116485935129, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.2100480227248354, "deviation-center-line": 0.9345773417088612}, "ep004": {"driven_any": 4.685052912313802, "driven_lanedir": 4.666314634594814, "in-drivable-lane": 0, "deviation-heading": 1.448995458537678, "deviation-center-line": 0.6352737923652181}}
No reset possible 110771296Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-19 19:01:06+00:00 2018-11-19 19:09:14+00:00 0:08:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110701295Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-19 18:45:52+00:00 2018-11-19 18:52:15+00:00 0:06:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 3.910996529633443 deviation-center-line_median 0.804829668110413 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 1.039879518692922 deviation-center-line_mean 0.7667227890186241 deviation-center-line_min 0.3222291105867537 deviation-heading_max 3.2571936050662273 deviation-heading_mean 2.1809540644258907 deviation-heading_median 2.6458401641549094 deviation-heading_min 0.9822962818116744 driven_any_max 5.123266602593036 driven_any_mean 3.5595592135593237 driven_any_median 4.272131146626368 driven_any_min 1.5077016675170083 driven_lanedir_max 5.10905363944258 driven_lanedir_mean 3.432994515958099 driven_lanedir_min 1.4595445026629377 in-drivable-lane_max 1.0999999999999994 in-drivable-lane_mean 0.25999999999999973 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 4.272131146626368, "driven_lanedir": 3.910996529633443, "in-drivable-lane": 1.0999999999999994, "deviation-heading": 3.2571936050662273, "deviation-center-line": 1.039879518692922}, "ep001": {"driven_any": 2.1447119551227667, "driven_lanedir": 2.0224400944249012, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 2.6585454794779535, "deviation-center-line": 0.7527271103559265}, "ep002": {"driven_any": 1.5077016675170083, "driven_lanedir": 1.4595445026629377, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3608947916186889, "deviation-center-line": 0.3222291105867537}, "ep003": {"driven_any": 4.74998469593744, "driven_lanedir": 4.66293781362663, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.6458401641549094, "deviation-center-line": 0.804829668110413}, "ep004": {"driven_any": 5.123266602593036, "driven_lanedir": 5.10905363944258, "in-drivable-lane": 0, "deviation-heading": 0.9822962818116744, "deviation-center-line": 0.9139485373471052}}
No reset possible 110481295Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-22102018-11-19 18:42:46+00:00 2018-11-19 18:44:35+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.12137116433726625, "good_angle": 1.0419096888881556, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 2.633333333333326}, "ep001": {"nsteps": 303, "reward": -3.62843049893931, "good_angle": 15.400139654029603, "survival_time": 10.099999999999977, "traveled_tiles": 5, "valid_direction": 3.1666666666666554}, "ep002": {"nsteps": 186, "reward": -5.627489280993975, "good_angle": 0.27681601352758295, "survival_time": 6.199999999999988, "traveled_tiles": 4, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 500, "reward": -0.18406181560666304, "good_angle": 0.7270384677449752, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 1.6666666666666732}, "ep004": {"nsteps": 500, "reward": -0.04293484631704632, "good_angle": 40.92457506370659, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.633333333333317}}good_angle_max 40.92457506370659 good_angle_mean 11.674095777579382 good_angle_median 1.0419096888881556 good_angle_min 0.27681601352758295 reward_max -0.04293484631704632 reward_mean -1.920857521238852 reward_median -0.18406181560666304 reward_min -5.627489280993975 survival_time_max 16.666666666666654 survival_time_mean 13.259999999999986 survival_time_min 6.199999999999988 traveled_tiles_max 10 traveled_tiles_mean 7.2 traveled_tiles_median 8 traveled_tiles_min 4 valid_direction_max 4.633333333333317 valid_direction_mean 2.56666666666666 valid_direction_median 2.633333333333326 valid_direction_min 0.7333333333333307
No reset possible 110331293Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step4-viz success no nutonomy-P50-22102018-11-19 13:55:35+00:00 2018-11-19 13:59:55+00:00 0:04:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median 0.44433964314315433 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 0.5512591199175949 deviation-center-line_mean 0.4645859205989189 deviation-center-line_min 0.39335855914159346 deviation-heading_max 3.5598471575751542 deviation-heading_mean 1.764030711792994 deviation-heading_median 1.381299485180658 deviation-heading_min 1.1199561623878598 driven_any_max 1.49079583364818 driven_any_mean 1.1297417190774648 driven_any_median 1.2306824401524008 driven_any_min 0.6871560381108496 driven_lanedir_max 1.450214316231856 driven_lanedir_mean 0.9909222089183176 driven_lanedir_median 1.1890923792085335 driven_lanedir_min 0.1581492283862641 in-drivable-lane_max 2.7333333333333316 in-drivable-lane_mean 0.5599999999999996 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.6871560381108496, "driven_lanedir": 0.1581492283862641, "in-drivable-lane": 2.7333333333333316, "deviation-heading": 3.5598471575751542, "deviation-center-line": 0.4027841572493933}, "ep001": {"driven_any": 0.8036306246797625, "driven_lanedir": 0.7607355319904787, "in-drivable-lane": 0, "deviation-heading": 1.1199561623878598, "deviation-center-line": 0.39335855914159346}, "ep002": {"driven_any": 1.2306824401524008, "driven_lanedir": 1.1890923792085335, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.381299485180658, "deviation-center-line": 0.5512591199175949}, "ep003": {"driven_any": 1.49079583364818, "driven_lanedir": 1.450214316231856, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3004450133719043, "deviation-center-line": 0.5311881235428586}, "ep004": {"driven_any": 1.4364436587961311, "driven_lanedir": 1.3964195887744555, "in-drivable-lane": 0, "deviation-heading": 1.458605740449393, "deviation-center-line": 0.44433964314315433}}
No reset possible 110251293Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step3-videos success yes nutonomy-P50-22102018-11-19 13:53:52+00:00 2018-11-19 13:54:54+00:00 0:01:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110171293Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step1-simulation success no nutonomy-P50-22102018-11-19 13:47:38+00:00 2018-11-19 13:51:20+00:00 0:03:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110141292Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-19 13:32:03+00:00 2018-11-19 13:32:38+00:00 0:00:35 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 124, in run
solve(params, cis)
File "solution.py", line 69, in solve
env = make_env(config, debug=debug)
File "solution.py", line 40, in make_env
env = BaseWrapper(env)
File "/workspace/wrappers.py", line 280, in __init__
self.cur_pos = self._env.cur_pos
AttributeError: 'TimeLimit' object has no attribute 'cur_pos'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110071291Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-19 13:29:35+00:00 2018-11-19 13:30:15+00:00 0:00:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 124, in run
solve(params, cis)
File "solution.py", line 69, in solve
env = make_env(config, debug=debug)
File "solution.py", line 40, in make_env
env = BaseWrapper(env)
File "/workspace/wrappers.py", line 278, in __init__
super().__init__(env)
TypeError: super() takes at least 1 argument (0 given)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110031290Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-19 12:51:55+00:00 2018-11-19 12:58:26+00:00 0:06:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.567528656397519 deviation-center-line_median 1.0314261754372154 in-drivable-lane_median 1.8000000000000025
other stats deviation-center-line_max 1.1495890962817945 deviation-center-line_mean 0.9690856088373276 deviation-center-line_min 0.6766247807849696 deviation-heading_max 3.941604068378368 deviation-heading_mean 2.2824951855297098 deviation-heading_median 2.29469239931807 deviation-heading_min 0.490186778431544 driven_any_max 1.77870780337893 driven_any_mean 1.7786930581721971 driven_any_median 1.7786958483229494 driven_any_min 1.778665937185382 driven_lanedir_max 1.7755630287738702 driven_lanedir_mean 1.5640709458206878 driven_lanedir_min 1.3262672930289792 in-drivable-lane_max 3.733333333333355 in-drivable-lane_mean 1.5133333333333367 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.7787039960005906, "driven_lanedir": 1.567528656397519, "in-drivable-lane": 1.8000000000000025, "deviation-heading": 1.5419265634410058, "deviation-center-line": 0.6766247807849696}, "ep001": {"driven_any": 1.778665937185382, "driven_lanedir": 1.3262672930289792, "in-drivable-lane": 3.733333333333355, "deviation-heading": 3.1440661180795613, "deviation-center-line": 1.1495890962817945}, "ep002": {"driven_any": 1.778691705973134, "driven_lanedir": 1.4091608907992712, "in-drivable-lane": 2.033333333333326, "deviation-heading": 3.941604068378368, "deviation-center-line": 1.0314261754372154}, "ep003": {"driven_any": 1.77870780337893, "driven_lanedir": 1.7755630287738702, "in-drivable-lane": 0, "deviation-heading": 0.490186778431544, "deviation-center-line": 0.8534399105921283}, "ep004": {"driven_any": 1.7786958483229494, "driven_lanedir": 1.741834860103799, "in-drivable-lane": 0, "deviation-heading": 2.29469239931807, "deviation-center-line": 1.1343480810905304}}
No reset possible 109981290Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-22102018-11-19 12:46:46+00:00 2018-11-19 12:47:06+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.0997283233529888, "good_angle": 0.2520961888276448, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep001": {"nsteps": 500, "reward": -0.5514429277753224, "good_angle": 14.373030369485033, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 6.800000000000011}, "ep002": {"nsteps": 500, "reward": -0.20782254621386528, "good_angle": 2.347591111222324, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 5.099999999999987}, "ep003": {"nsteps": 500, "reward": -0.22671328952908515, "good_angle": 0.00980639504192846, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.25195742256822995, "good_angle": 11.306899587623128, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 3.1999999999999886}}good_angle_max 14.373030369485033 good_angle_mean 5.657884730440012 good_angle_median 2.347591111222324 good_angle_min 0.00980639504192846 reward_max -0.0997283233529888 reward_mean -0.26753290188789836 reward_median -0.22671328952908515 reward_min -0.5514429277753224 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 5 traveled_tiles_mean 4.2 traveled_tiles_median 4 traveled_tiles_min 4 valid_direction_max 6.800000000000011 valid_direction_mean 3.019999999999998 valid_direction_median 3.1999999999999886 valid_direction_min 0
No reset possible 109961290Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-19 12:35:31+00:00 2018-11-19 12:46:40+00:00 0:11:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109901289Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-19 11:43:24+00:00 2018-11-19 11:48:03+00:00 0:04:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 2.584127024574969 deviation-center-line_median 0.8957135530269953 in-drivable-lane_median 5.599999999999988
other stats deviation-center-line_max 1.0628532579939705 deviation-center-line_mean 0.758096814737046 deviation-center-line_min 0.41251532190998896 deviation-heading_max 4.640536440502557 deviation-heading_mean 3.3367766559045444 deviation-heading_median 3.937012118101925 deviation-heading_min 1.4162991141928378 driven_any_max 4.585768801921272 driven_any_mean 4.293099308186692 driven_any_median 4.213185987470461 driven_any_min 3.991820366110123 driven_lanedir_max 4.226648014935285 driven_lanedir_mean 2.477820234325766 driven_lanedir_min 1.313664631432375 in-drivable-lane_max 11.466666666666663 in-drivable-lane_mean 6.56666666666666 in-drivable-lane_min 0.4333333333333318 per-episodes details {"ep000": {"driven_any": 3.991820366110123, "driven_lanedir": 2.584127024574969, "in-drivable-lane": 5.599999999999988, "deviation-heading": 3.937012118101925, "deviation-center-line": 0.8957135530269953}, "ep001": {"driven_any": 4.213185987470461, "driven_lanedir": 1.313664631432375, "in-drivable-lane": 11.433333333333328, "deviation-heading": 2.3426908741159047, "deviation-center-line": 0.5088328462513643}, "ep002": {"driven_any": 4.10212742582897, "driven_lanedir": 2.923768919161928, "in-drivable-lane": 3.899999999999987, "deviation-heading": 4.347344732609495, "deviation-center-line": 0.9105690945029116}, "ep003": {"driven_any": 4.572593959602632, "driven_lanedir": 4.226648014935285, "in-drivable-lane": 0.4333333333333318, "deviation-heading": 4.640536440502557, "deviation-center-line": 1.0628532579939705}, "ep004": {"driven_any": 4.585768801921272, "driven_lanedir": 1.340892581524269, "in-drivable-lane": 11.466666666666663, "deviation-heading": 1.4162991141928378, "deviation-center-line": 0.41251532190998896}}
No reset possible 109881289Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-22102018-11-19 11:41:25+00:00 2018-11-19 11:41:44+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.5155811812859029, "good_angle": 3.628556763100416, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 6.0333333333333155}, "ep001": {"nsteps": 500, "reward": -1.782332134154145, "good_angle": 61.04875597771131, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 10.7}, "ep002": {"nsteps": 500, "reward": -0.5043799358881078, "good_angle": 3.598961650239402, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 5.999999999999988}, "ep003": {"nsteps": 500, "reward": -0.056422112440224735, "good_angle": 1.5037491973700476, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 2.1666666666666945}, "ep004": {"nsteps": 500, "reward": -1.9298303503713103, "good_angle": 52.81007762986282, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 7.099999999999975}}good_angle_max 61.04875597771131 good_angle_mean 24.5180202436568 good_angle_median 3.628556763100416 good_angle_min 1.5037491973700476 reward_max -0.056422112440224735 reward_mean -0.957709142827938 reward_median -0.5155811812859029 reward_min -1.9298303503713103 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 9 traveled_tiles_mean 8.6 traveled_tiles_median 9 traveled_tiles_min 8 valid_direction_max 10.7 valid_direction_mean 6.399999999999993 valid_direction_median 6.0333333333333155 valid_direction_min 2.1666666666666945
No reset possible 109511282Yun Chen PyTorch template aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-22102018-11-19 04:29:17+00:00 2018-11-19 04:31:57+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109471282Yun Chen PyTorch template aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-22102018-11-19 04:26:43+00:00 2018-11-19 04:28:35+00:00 0:01:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.966810409963131, "good_angle": 47.08330822850749, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.233333333333322}, "ep001": {"nsteps": 500, "reward": -1.300191262960434, "good_angle": 13.8317262841996, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}, "ep002": {"nsteps": 500, "reward": -1.117795492440462, "good_angle": 13.808909540839275, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333326}, "ep003": {"nsteps": 500, "reward": -0.9294596527849426, "good_angle": 13.819737231108473, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}, "ep004": {"nsteps": 500, "reward": -1.163820459574461, "good_angle": 13.824014957850544, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}}good_angle_max 47.08330822850749 good_angle_mean 20.473539248501076 good_angle_median 13.824014957850544 good_angle_min 13.808909540839275 reward_max -0.9294596527849426 reward_mean -1.0956154555446862 reward_median -1.117795492440462 reward_min -1.300191262960434 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 2 traveled_tiles_mean 1.2 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 14.233333333333322 valid_direction_mean 13.266666666666657 valid_direction_median 13.09999999999999 valid_direction_min 12.933333333333326
No reset possible 109231282Yun Chen PyTorch template aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-19 04:17:55+00:00 2018-11-19 04:24:14+00:00 0:06:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109201281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-19 04:11:11+00:00 2018-11-19 04:17:45+00:00 0:06:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109031280Yun Chen Random execution aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-19 03:53:04+00:00 2018-11-19 03:56:58+00:00 0:03:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.0912619516892297 deviation-center-line_median 0.35434867307286394 in-drivable-lane_median 0.09999999999999964
other stats deviation-center-line_max 0.5503217644623789 deviation-center-line_mean 0.3430555191422603 deviation-center-line_min 0.19008849208663176 deviation-heading_max 3.5738141012812856 deviation-heading_mean 1.5780346998192003 deviation-heading_median 1.6281599088608705 deviation-heading_min 0.17673821454925606 driven_any_max 1.600431044772758 driven_any_mean 0.8967643246163399 driven_any_median 1.0949819717424556 driven_any_min 0.2573432846425337 driven_lanedir_max 1.2646710312972245 driven_lanedir_mean 0.7693333122921573 driven_lanedir_min 0.1261801357102449 in-drivable-lane_max 0.7999999999999972 in-drivable-lane_mean 0.2999999999999994 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3483184683821576, "driven_lanedir": 0.1261801357102449, "in-drivable-lane": 0.6, "deviation-heading": 2.035647668091897, "deviation-center-line": 0.19008849208663176}, "ep001": {"driven_any": 0.2573432846425337, "driven_lanedir": 0.2561200256083098, "in-drivable-lane": 0, "deviation-heading": 0.17673821454925606, "deviation-center-line": 0.20420172648538432}, "ep002": {"driven_any": 1.182746853541795, "driven_lanedir": 1.1084334171557773, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.6281599088608705, "deviation-center-line": 0.35434867307286394}, "ep003": {"driven_any": 1.0949819717424556, "driven_lanedir": 1.0912619516892297, "in-drivable-lane": 0, "deviation-heading": 0.4758136063126942, "deviation-center-line": 0.4163169396040424}, "ep004": {"driven_any": 1.600431044772758, "driven_lanedir": 1.2646710312972245, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 3.5738141012812856, "deviation-center-line": 0.5503217644623789}}
No reset possible 108931280Yun Chen Random execution aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-19 03:47:28+00:00 2018-11-19 03:50:51+00:00 0:03:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108811279Yun Chen ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-22102018-11-19 03:29:07+00:00 2018-11-19 03:33:48+00:00 0:04:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.2332896871989636 deviation-center-line_median 0.2116792544883902 in-drivable-lane_median 0
other stats deviation-center-line_max 0.6323564732185519 deviation-center-line_mean 0.2912504656486582 deviation-center-line_min 0.12670548452775535 deviation-heading_max 1.728976789403258 deviation-heading_mean 0.8194124233994693 deviation-heading_median 0.582523377361064 deviation-heading_min 0.4668112744530743 driven_any_max 1.0714883694442423 driven_any_mean 0.39858127916586666 driven_any_median 0.25000443206491196 driven_any_min 0.14641855465317552 driven_lanedir_max 0.8388467814636376 driven_lanedir_mean 0.33922668007033285 driven_lanedir_min 0.129237910180789 in-drivable-lane_max 1.9000000000000024 in-drivable-lane_mean 0.3800000000000005 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.0714883694442423, "driven_lanedir": 0.8388467814636376, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.728976789403258, "deviation-center-line": 0.6323564732185519}, "ep001": {"driven_any": 0.3250077317230347, "driven_lanedir": 0.31702584203169426, "in-drivable-lane": 0, "deviation-heading": 0.4668112744530743, "deviation-center-line": 0.35258484316877714}, "ep002": {"driven_any": 0.14641855465317552, "driven_lanedir": 0.129237910180789, "in-drivable-lane": 0, "deviation-heading": 0.582523377361064, "deviation-center-line": 0.12670548452775535}, "ep003": {"driven_any": 0.1999873079439689, "driven_lanedir": 0.17773317947657974, "in-drivable-lane": 0, "deviation-heading": 0.742904646059641, "deviation-center-line": 0.13292627283981628}, "ep004": {"driven_any": 0.25000443206491196, "driven_lanedir": 0.2332896871989636, "in-drivable-lane": 0, "deviation-heading": 0.5758460297203092, "deviation-center-line": 0.2116792544883902}}
No reset possible 108611279Yun Chen ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-19 03:24:07+00:00 2018-11-19 03:27:55+00:00 0:03:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108541278Rob Venables Solution template aido1_luck-v3step1 success yes nutonomy-P50-22102018-11-19 03:20:58+00:00 2018-11-19 03:21:45+00:00 0:00:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108521277Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation error no nutonomy-P50-22102018-11-19 02:56:16+00:00 2018-11-19 03:07:03+00:00 0:10:47 Timeout:
Waited 601 [...] Timeout:
Waited 601.692614079 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108391276Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-19 02:17:02+00:00 2018-11-19 02:27:51+00:00 0:10:49 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108361275Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation error no nutonomy-P50-22102018-11-19 01:40:38+00:00 2018-11-19 01:51:22+00:00 0:10:44 Timeout:
Waited 605 [...] Timeout:
Waited 605.975848913 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108261273Guohao Li Solution template aido1_luck-v3step1 success yes nutonomy-P50-22102018-11-18 21:57:53+00:00 2018-11-18 21:58:29+00:00 0:00:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108071271Andrea Censi Random execution aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-22102018-11-18 13:50:55+00:00 2018-11-18 13:52:45+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.49999999999998
other stats episodes details {"ep000": {"nsteps": 81, "reward": -12.594963072856634, "good_angle": 1.179753153433826, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 230, "reward": -5.431255984695062, "good_angle": 16.109426524471456, "survival_time": 7.666666666666649, "traveled_tiles": 2, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 255, "reward": -4.346870108328614, "good_angle": 1.0142558554378145, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.0999999999999934}, "ep003": {"nsteps": 361, "reward": -3.0704857812487516, "good_angle": 0.034109257356551625, "survival_time": 12.0333333333333, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 346, "reward": -3.565080447820505, "good_angle": 21.142156874080055, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}good_angle_max 21.142156874080055 good_angle_mean 7.8959403329559406 good_angle_median 1.179753153433826 good_angle_min 0.034109257356551625 reward_max -3.0704857812487516 reward_mean -5.8017310789899135 reward_median -4.346870108328614 reward_min -12.594963072856634 survival_time_max 12.0333333333333 survival_time_mean 8.486666666666647 survival_time_min 2.7 traveled_tiles_max 4 traveled_tiles_mean 2.6 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.9666666666666535 valid_direction_mean 2.4466666666666597 valid_direction_median 2.2333333333333334 valid_direction_min 0
No reset possible 107871270Andrea Censi Random execution aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-22102018-11-18 13:43:48+00:00 2018-11-18 13:45:46+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.799999999999986
other stats episodes details {"ep000": {"nsteps": 81, "reward": -12.59392248302767, "good_angle": 1.2156126068944273, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 81, "reward": -12.911595400836733, "good_angle": 0.011156086737876828, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 254, "reward": -4.437077517995215, "good_angle": 0.8658368839697798, "survival_time": 8.466666666666647, "traveled_tiles": 3, "valid_direction": 2.033333333333327}, "ep003": {"nsteps": 204, "reward": -5.272974844510649, "good_angle": 0.03033246554319256, "survival_time": 6.799999999999986, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 346, "reward": -3.655747907953468, "good_angle": 21.771657353630022, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}good_angle_max 21.771657353630022 good_angle_mean 4.77891907935506 good_angle_median 0.8658368839697798 good_angle_min 0.011156086737876828 reward_max -3.655747907953468 reward_mean -7.7742636308647475 reward_median -5.272974844510649 reward_min -12.911595400836733 survival_time_max 11.533333333333305 survival_time_mean 6.439999999999986 survival_time_min 2.7 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 3.93333333333332 valid_direction_mean 1.6399999999999963 valid_direction_median 2.033333333333327 valid_direction_min 0
No reset possible
Andrea Censi 🇨🇭
