Submission 17618

Submission

17618

Competing

yes

Challenge

aido-LFV_multi-full-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-02 08:54:55+00:00

Last status update

2021-12-04 20:47:45+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 104641 sim-1of4: 104638 sim-2of4: 104637 sim-3of4: 104640

User label

minimal-agent-full

Admin priority

Blessing

n/a

User priority

104641

Click the images to see detailed statistics about the episode.

loop2-000

104640

Click the images to see detailed statistics about the episode.

zigzag-000

104638

Click the images to see detailed statistics about the episode.

autolab-000

104637

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

104641

sim-0of4

success

yes

2021-11-02 19:38:48+00:00

2021-11-02 19:45:53+00:00

0:07:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.1249999999999662
driven_lanedir_consec_median	1.4456503520453423
deviation-center-line_median	5.2165714063097

other stats

deviation-center-line_max	5.528679809125458
deviation-center-line_mean	5.2165714063097
deviation-center-line_min	4.904463003493942
deviation-heading_max	8.48735406391615
deviation-heading_mean	8.116239531071809
deviation-heading_median	8.116239531071809
deviation-heading_min	7.7451249982274675
distance-from-start_max	1.242743835742773
distance-from-start_mean	1.2243627584318864
distance-from-start_median	1.2243627584318864
distance-from-start_min	1.205981681121
driven_any_max	3.4865832572710787
driven_any_mean	3.4858336367538625
driven_any_median	3.4858336367538625
driven_any_min	3.4850840162366463
driven_lanedir_consec_max	1.4708900970780958
driven_lanedir_consec_mean	1.4456503520453423
driven_lanedir_consec_min	1.4204106070125888
driven_lanedir_max	3.2904966241055256
driven_lanedir_mean	3.288148700061684
driven_lanedir_median	3.288148700061684
driven_lanedir_min	3.285800776017842
in-drivable-lane_max	3.1499999999999666
in-drivable-lane_mean	3.1249999999999662
in-drivable-lane_min	3.099999999999966
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.4850840162366463, "survival_time": 59.99999999999873, "driven_lanedir": 3.2904966241055256, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.7451249982274675, "distance-from-start": 1.205981681121, "deviation-center-line": 4.904463003493942, "driven_lanedir_consec": 1.4204106070125888}, "loop2-000-ego1": {"driven_any": 3.4865832572710787, "survival_time": 59.99999999999873, "driven_lanedir": 3.285800776017842, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.48735406391615, "distance-from-start": 1.242743835742773, "deviation-center-line": 5.528679809125458, "driven_lanedir_consec": 1.4708900970780958}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104640

sim-3of4

success

yes

2021-11-02 19:37:44+00:00

2021-11-02 19:51:38+00:00

0:13:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.899999999999888
driven_lanedir_consec_median	2.577147081404033
deviation-center-line_median	6.473819545759991

other stats

deviation-center-line_max	6.67414186858749
deviation-center-line_mean	6.181505974927821
deviation-center-line_min	5.104242939603813
deviation-heading_max	10.109778463057898
deviation-heading_mean	8.400916955237046
deviation-heading_median	8.14470326891814
deviation-heading_min	7.204482820054009
distance-from-start_max	2.170988126335053
distance-from-start_mean	1.563488645703338
distance-from-start_median	1.6003159096716135
distance-from-start_min	0.8823346371350725
driven_any_max	3.4820813210699813
driven_any_mean	3.464122337409231
driven_any_median	3.4626626970634273
driven_any_min	3.449082634440088
driven_lanedir_consec_max	3.283655000392273
driven_lanedir_consec_mean	2.512031151865401
driven_lanedir_consec_min	1.6101754442612652
driven_lanedir_max	3.283655000392273
driven_lanedir_mean	3.242098610430684
driven_lanedir_median	3.2385172829127216
driven_lanedir_min	3.2077048755050215
in-drivable-lane_max	4.349999999999895
in-drivable-lane_mean	3.8499999999999073
in-drivable-lane_min	3.249999999999958
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.4715894450565123, "survival_time": 59.99999999999873, "driven_lanedir": 3.283655000392273, "in-drivable-lane": 3.599999999999884, "deviation-heading": 7.204482820054009, "distance-from-start": 1.6768936287564808, "deviation-center-line": 6.67414186858749, "driven_lanedir_consec": 3.283655000392273}, "zigzag-000-ego1": {"driven_any": 3.453735949070342, "survival_time": 59.99999999999873, "driven_lanedir": 3.215991718710423, "in-drivable-lane": 4.199999999999893, "deviation-heading": 8.20099581172048, "distance-from-start": 2.170988126335053, "deviation-center-line": 6.65956544167938, "driven_lanedir_consec": 3.215991718710423}, "zigzag-000-ego2": {"driven_any": 3.4820813210699813, "survival_time": 59.99999999999873, "driven_lanedir": 3.26104284711502, "in-drivable-lane": 3.249999999999958, "deviation-heading": 10.109778463057898, "distance-from-start": 1.5237381905867464, "deviation-center-line": 5.104242939603813, "driven_lanedir_consec": 1.6101754442612652}, "zigzag-000-ego3": {"driven_any": 3.449082634440088, "survival_time": 59.99999999999873, "driven_lanedir": 3.2077048755050215, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.088410726115796, "distance-from-start": 0.8823346371350725, "deviation-center-line": 6.2880736498406025, "driven_lanedir_consec": 1.9383024440976424}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104638

sim-1of4

success

yes

2021-11-02 19:33:04+00:00

2021-11-02 19:46:33+00:00

0:13:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.4749999999999552
driven_lanedir_consec_median	3.4002821622357984
deviation-center-line_median	5.992377953630339

other stats

deviation-center-line_max	7.516029088900642
deviation-center-line_mean	6.078065413935748
deviation-center-line_min	4.81147665958167
deviation-heading_max	12.168685206029926
deviation-heading_mean	6.8808867794243
deviation-heading_median	6.217393990233779
deviation-heading_min	2.9200739311997133
distance-from-start_max	3.0901348300566136
distance-from-start_mean	2.5082472337191244
distance-from-start_median	2.747884262658891
distance-from-start_min	1.4470855795021027
driven_any_max	3.549582457242765
driven_any_mean	3.534964335885894
driven_any_median	3.5353456174417777
driven_any_min	3.5195836514172565
driven_lanedir_consec_max	3.485653904322902
driven_lanedir_consec_mean	3.0923220036529804
driven_lanedir_consec_min	2.0830697858174214
driven_lanedir_max	3.485653904322902
driven_lanedir_mean	3.409680770298687
driven_lanedir_median	3.4002821622357984
driven_lanedir_min	3.3525048524002488
in-drivable-lane_max	2.0000000000000284
in-drivable-lane_mean	1.4874999999999703
in-drivable-lane_min	0.9999999999999432
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.5465963269625904, "survival_time": 59.99999999999873, "driven_lanedir": 3.485653904322902, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9200739311997133, "distance-from-start": 2.876631299535302, "deviation-center-line": 7.516029088900642, "driven_lanedir_consec": 3.485653904322902}, "autolab-000-ego1": {"driven_any": 3.524094907920965, "survival_time": 59.99999999999873, "driven_lanedir": 3.4260604158491743, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.516330158155915, "distance-from-start": 2.6191372257824805, "deviation-center-line": 6.510873598064531, "driven_lanedir_consec": 3.4260604158491743}, "autolab-000-ego2": {"driven_any": 3.549582457242765, "survival_time": 59.99999999999873, "driven_lanedir": 3.3745039086224224, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 12.168685206029926, "distance-from-start": 3.0901348300566136, "deviation-center-line": 4.81147665958167, "driven_lanedir_consec": 3.3745039086224224}, "autolab-000-ego3": {"driven_any": 3.5195836514172565, "survival_time": 59.99999999999873, "driven_lanedir": 3.3525048524002488, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 8.918457822311643, "distance-from-start": 1.4470855795021027, "deviation-center-line": 5.4738823091961475, "driven_lanedir_consec": 2.0830697858174214}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

104637

sim-2of4

success

yes

2021-11-02 19:31:54+00:00

2021-11-02 19:44:19+00:00

0:12:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.8249999999998965
driven_lanedir_consec_median	2.089362646121113
deviation-center-line_median	5.1606969042445545

other stats

deviation-center-line_max	5.884537088976699
deviation-center-line_mean	4.608902728622449
deviation-center-line_min	2.229680017023988
deviation-heading_max	33.00132974561592
deviation-heading_mean	11.086939889451044
deviation-heading_median	5.3156324990396016
deviation-heading_min	0.7151648141090522
distance-from-start_max	2.400773804592291
distance-from-start_mean	1.855033439894366
distance-from-start_median	1.8031549983915716
distance-from-start_min	1.4130499582020293
driven_any_max	3.5300951074200313
driven_any_mean	2.5187726211552675
driven_any_median	2.5310927358554984
driven_any_min	1.4828099054900417
driven_lanedir_consec_max	3.4375556548524067
driven_lanedir_consec_mean	2.243867367124486
driven_lanedir_consec_min	1.359188521403314
driven_lanedir_max	3.4375556548524067
driven_lanedir_mean	2.430771337654275
driven_lanedir_median	2.4562457120319685
driven_lanedir_min	1.373038271700757
in-drivable-lane_max	2.0000000000000284
in-drivable-lane_mean	1.4124999999999552
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 1.5425992768883967, "survival_time": 59.99999999999873, "driven_lanedir": 1.537863345389593, "in-drivable-lane": 0.0, "deviation-heading": 0.7151648141090522, "distance-from-start": 1.538166429460106, "deviation-center-line": 2.229680017023988, "driven_lanedir_consec": 1.537863345389593}, "loop-000-ego1": {"driven_any": 3.5195861948226006, "survival_time": 59.99999999999873, "driven_lanedir": 3.3746280786743443, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.2883954590350015, "distance-from-start": 2.068143567323037, "deviation-center-line": 5.233752335699729, "driven_lanedir_consec": 2.640861946852633}, "loop-000-ego2": {"driven_any": 3.5300951074200313, "survival_time": 59.99999999999873, "driven_lanedir": 3.4375556548524067, "in-drivable-lane": 1.6499999999999062, "deviation-heading": 4.342869539044202, "distance-from-start": 2.400773804592291, "deviation-center-line": 5.884537088976699, "driven_lanedir_consec": 3.4375556548524067}, "loop-000-ego3": {"driven_any": 1.4828099054900417, "survival_time": 59.99999999999873, "driven_lanedir": 1.373038271700757, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 33.00132974561592, "distance-from-start": 1.4130499582020293, "deviation-center-line": 5.08764147278938, "driven_lanedir_consec": 1.359188521403314}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible