ML之XGBoost：利用XGBoost算法对波士顿数据集回归预测(模型调参【2种方法，ShuffleSplit+GridSearchCV、TimeSeriesSplitGSCV】、模型评估)

ML之XGBoost：利用XGBoost算法对波士顿数据集回归预测(模型调参【2种方法，ShuffleSplit+GridSearchCV、TimeSeriesSplitGSCV】、模型评估)

---

相关文章
ML之XGBoost：利用XGBoost算法对波士顿数据集回归预测(模型调参【2种方法，ShuffleSplit+GridSearchCV、TimeSeriesSplitGSCV】、模型评估)
ML之XGBoost：利用XGBoost算法对波士顿数据集回归预测(模型调参【2种方法，ShuffleSplit+GridSearchCV、TimeSeriesSplitGSCV】、模型评估)实现

利用XGBoost算法对波士顿数据集回归预测

T1、ShuffleSplit+GSCV模型调参

输出XGBR_GSCV模型最佳得分、最优参数：0.8630,{'learning_rate': 0.12, 'max_depth': 3, 'n_estimators': 200}
XGBR_Shuffle_GSCV time： 256.7015066994206
XGBoost Score value: 0.8536645272887292
XGBoost R2    value: 0.8536645272887292
XGBoost MAE   value: 2.1987844654894246
XGBoost RMSE  value: 3.368537070469827

0.588111 (0.039989) with: {'learning_rate': 0.03, 'max_depth': 1, 'n_estimators': 50}
0.745248 (0.039715) with: {'learning_rate': 0.03, 'max_depth': 1, 'n_estimators': 100}
0.780673 (0.041418) with: {'learning_rate': 0.03, 'max_depth': 1, 'n_estimators': 150}
0.794564 (0.045098) with: {'learning_rate': 0.03, 'max_depth': 1, 'n_estimators': 200}
0.739650 (0.048542) with: {'learning_rate': 0.03, 'max_depth': 3, 'n_estimators': 50}
0.827152 (0.051752) with: {'learning_rate': 0.03, 'max_depth': 3, 'n_estimators': 100}
0.843543 (0.056119) with: {'learning_rate': 0.03, 'max_depth': 3, 'n_estimators': 150}
0.849557 (0.055848) with: {'learning_rate': 0.03, 'max_depth': 3, 'n_estimators': 200}
0.740037 (0.040934) with: {'learning_rate': 0.03, 'max_depth': 5, 'n_estimators': 50}
0.826966 (0.045216) with: {'learning_rate': 0.03, 'max_depth': 5, 'n_estimators': 100}
0.841845 (0.047665) with: {'learning_rate': 0.03, 'max_depth': 5, 'n_estimators': 150}
0.845978 (0.047794) with: {'learning_rate': 0.03, 'max_depth': 5, 'n_estimators': 200}
0.720503 (0.038676) with: {'learning_rate': 0.03, 'max_depth': 7, 'n_estimators': 50}
0.798275 (0.047791) with: {'learning_rate': 0.03, 'max_depth': 7, 'n_estimators': 100}
0.808659 (0.048699) with: {'learning_rate': 0.03, 'max_depth': 7, 'n_estimators': 150}
0.812894 (0.047902) with: {'learning_rate': 0.03, 'max_depth': 7, 'n_estimators': 200}
0.716254 (0.039716) with: {'learning_rate': 0.03, 'max_depth': 9, 'n_estimators': 50}
0.795603 (0.049370) with: {'learning_rate': 0.03, 'max_depth': 9, 'n_estimators': 100}
0.804215 (0.054399) with: {'learning_rate': 0.03, 'max_depth': 9, 'n_estimators': 150}
0.806022 (0.054965) with: {'learning_rate': 0.03, 'max_depth': 9, 'n_estimators': 200}
0.714920 (0.040201) with: {'learning_rate': 0.03, 'max_depth': 11, 'n_estimators': 50}
0.796940 (0.043692) with: {'learning_rate': 0.03, 'max_depth': 11, 'n_estimators': 100}
0.803563 (0.047487) with: {'learning_rate': 0.03, 'max_depth': 11, 'n_estimators': 150}
0.805639 (0.049146) with: {'learning_rate': 0.03, 'max_depth': 11, 'n_estimators': 200}
0.717114 (0.040552) with: {'learning_rate': 0.03, 'max_depth': 13, 'n_estimators': 50}
0.798669 (0.044140) with: {'learning_rate': 0.03, 'max_depth': 13, 'n_estimators': 100}
0.807001 (0.047485) with: {'learning_rate': 0.03, 'max_depth': 13, 'n_estimators': 150}
0.808231 (0.048622) with: {'learning_rate': 0.03, 'max_depth': 13, 'n_estimators': 200}
0.716787 (0.040747) with: {'learning_rate': 0.03, 'max_depth': 15, 'n_estimators': 50}
0.800528 (0.042525) with: {'learning_rate': 0.03, 'max_depth': 15, 'n_estimators': 100}
0.810075 (0.045364) with: {'learning_rate': 0.03, 'max_depth': 15, 'n_estimators': 150}
0.810928 (0.047001) with: {'learning_rate': 0.03, 'max_depth': 15, 'n_estimators': 200}
0.748057 (0.039107) with: {'learning_rate': 0.06, 'max_depth': 1, 'n_estimators': 50}
0.796450 (0.044658) with: {'learning_rate': 0.06, 'max_depth': 1, 'n_estimators': 100}
0.810749 (0.049107) with: {'learning_rate': 0.06, 'max_depth': 1, 'n_estimators': 150}
0.818271 (0.049566) with: {'learning_rate': 0.06, 'max_depth': 1, 'n_estimators': 200}
0.825470 (0.054236) with: {'learning_rate': 0.06, 'max_depth': 3, 'n_estimators': 50}
0.847820 (0.057729) with: {'learning_rate': 0.06, 'max_depth': 3, 'n_estimators': 100}
0.852501 (0.057970) with: {'learning_rate': 0.06, 'max_depth': 3, 'n_estimators': 150}
0.855974 (0.057133) with: {'learning_rate': 0.06, 'max_depth': 3, 'n_estimators': 200}
0.830130 (0.042166) with: {'learning_rate': 0.06, 'max_depth': 5, 'n_estimators': 50}
0.848818 (0.043202) with: {'learning_rate': 0.06, 'max_depth': 5, 'n_estimators': 100}
0.850634 (0.043955) with: {'learning_rate': 0.06, 'max_depth': 5, 'n_estimators': 150}
0.850776 (0.044242) with: {'learning_rate': 0.06, 'max_depth': 5, 'n_estimators': 200}
0.797091 (0.049104) with: {'learning_rate': 0.06, 'max_depth': 7, 'n_estimators': 50}
0.811453 (0.050410) with: {'learning_rate': 0.06, 'max_depth': 7, 'n_estimators': 100}
0.812925 (0.050391) with: {'learning_rate': 0.06, 'max_depth': 7, 'n_estimators': 150}
0.813141 (0.050317) with: {'learning_rate': 0.06, 'max_depth': 7, 'n_estimators': 200}
0.798523 (0.048830) with: {'learning_rate': 0.06, 'max_depth': 9, 'n_estimators': 50}
0.807724 (0.053522) with: {'learning_rate': 0.06, 'max_depth': 9, 'n_estimators': 100}
0.808858 (0.053694) with: {'learning_rate': 0.06, 'max_depth': 9, 'n_estimators': 150}
0.809064 (0.053787) with: {'learning_rate': 0.06, 'max_depth': 9, 'n_estimators': 200}
0.795488 (0.045973) with: {'learning_rate': 0.06, 'max_depth': 11, 'n_estimators': 50}
0.803783 (0.051639) with: {'learning_rate': 0.06, 'max_depth': 11, 'n_estimators': 100}
0.805366 (0.052070) with: {'learning_rate': 0.06, 'max_depth': 11, 'n_estimators': 150}
0.805499 (0.052113) with: {'learning_rate': 0.06, 'max_depth': 11, 'n_estimators': 200}
0.796173 (0.046698) with: {'learning_rate': 0.06, 'max_depth': 13, 'n_estimators': 50}
0.806388 (0.050425) with: {'learning_rate': 0.06, 'max_depth': 13, 'n_estimators': 100}
0.807511 (0.050917) with: {'learning_rate': 0.06, 'max_depth': 13, 'n_estimators': 150}
0.807696 (0.050925) with: {'learning_rate': 0.06, 'max_depth': 13, 'n_estimators': 200}
0.795853 (0.045518) with: {'learning_rate': 0.06, 'max_depth': 15, 'n_estimators': 50}
0.805835 (0.048817) with: {'learning_rate': 0.06, 'max_depth': 15, 'n_estimators': 100}
0.806752 (0.049863) with: {'learning_rate': 0.06, 'max_depth': 15, 'n_estimators': 150}
0.806967 (0.049886) with: {'learning_rate': 0.06, 'max_depth': 15, 'n_estimators': 200}
0.782405 (0.041673) with: {'learning_rate': 0.09, 'max_depth': 1, 'n_estimators': 50}
0.810724 (0.050393) with: {'learning_rate': 0.09, 'max_depth': 1, 'n_estimators': 100}
0.820115 (0.051026) with: {'learning_rate': 0.09, 'max_depth': 1, 'n_estimators': 150}
0.825857 (0.051649) with: {'learning_rate': 0.09, 'max_depth': 1, 'n_estimators': 200}
0.843458 (0.056602) with: {'learning_rate': 0.09, 'max_depth': 3, 'n_estimators': 50}
0.855060 (0.056710) with: {'learning_rate': 0.09, 'max_depth': 3, 'n_estimators': 100}
0.858793 (0.055724) with: {'learning_rate': 0.09, 'max_depth': 3, 'n_estimators': 150}
0.860149 (0.055734) with: {'learning_rate': 0.09, 'max_depth': 3, 'n_estimators': 200}
0.842437 (0.046911) with: {'learning_rate': 0.09, 'max_depth': 5, 'n_estimators': 50}
0.849599 (0.045852) with: {'learning_rate': 0.09, 'max_depth': 5, 'n_estimators': 100}
0.850152 (0.046078) with: {'learning_rate': 0.09, 'max_depth': 5, 'n_estimators': 150}
0.849891 (0.046197) with: {'learning_rate': 0.09, 'max_depth': 5, 'n_estimators': 200}
0.807907 (0.051134) with: {'learning_rate': 0.09, 'max_depth': 7, 'n_estimators': 50}
0.810696 (0.051038) with: {'learning_rate': 0.09, 'max_depth': 7, 'n_estimators': 100}
0.810941 (0.050779) with: {'learning_rate': 0.09, 'max_depth': 7, 'n_estimators': 150}
0.810979 (0.050839) with: {'learning_rate': 0.09, 'max_depth': 7, 'n_estimators': 200}
0.804573 (0.052898) with: {'learning_rate': 0.09, 'max_depth': 9, 'n_estimators': 50}
0.809204 (0.053292) with: {'learning_rate': 0.09, 'max_depth': 9, 'n_estimators': 100}
0.809325 (0.053303) with: {'learning_rate': 0.09, 'max_depth': 9, 'n_estimators': 150}
0.809351 (0.053284) with: {'learning_rate': 0.09, 'max_depth': 9, 'n_estimators': 200}
0.804379 (0.051647) with: {'learning_rate': 0.09, 'max_depth': 11, 'n_estimators': 50}
0.807157 (0.053047) with: {'learning_rate': 0.09, 'max_depth': 11, 'n_estimators': 100}
0.807332 (0.053061) with: {'learning_rate': 0.09, 'max_depth': 11, 'n_estimators': 150}
0.807335 (0.053062) with: {'learning_rate': 0.09, 'max_depth': 11, 'n_estimators': 200}
0.809283 (0.050355) with: {'learning_rate': 0.09, 'max_depth': 13, 'n_estimators': 50}
0.812004 (0.052245) with: {'learning_rate': 0.09, 'max_depth': 13, 'n_estimators': 100}
0.812156 (0.052289) with: {'learning_rate': 0.09, 'max_depth': 13, 'n_estimators': 150}
0.812158 (0.052290) with: {'learning_rate': 0.09, 'max_depth': 13, 'n_estimators': 200}
0.808697 (0.047241) with: {'learning_rate': 0.09, 'max_depth': 15, 'n_estimators': 50}
0.811460 (0.049551) with: {'learning_rate': 0.09, 'max_depth': 15, 'n_estimators': 100}
0.811645 (0.049603) with: {'learning_rate': 0.09, 'max_depth': 15, 'n_estimators': 150}
0.811647 (0.049603) with: {'learning_rate': 0.09, 'max_depth': 15, 'n_estimators': 200}
0.797008 (0.044026) with: {'learning_rate': 0.12, 'max_depth': 1, 'n_estimators': 50}
0.819497 (0.048774) with: {'learning_rate': 0.12, 'max_depth': 1, 'n_estimators': 100}
0.828557 (0.049254) with: {'learning_rate': 0.12, 'max_depth': 1, 'n_estimators': 150}
0.831446 (0.048579) with: {'learning_rate': 0.12, 'max_depth': 1, 'n_estimators': 200}
0.850108 (0.054443) with: {'learning_rate': 0.12, 'max_depth': 3, 'n_estimators': 50}
0.860703 (0.051990) with: {'learning_rate': 0.12, 'max_depth': 3, 'n_estimators': 100}
0.862097 (0.050875) with: {'learning_rate': 0.12, 'max_depth': 3, 'n_estimators': 150}
0.862991 (0.050771) with: {'learning_rate': 0.12, 'max_depth': 3, 'n_estimators': 200}
0.845629 (0.050619) with: {'learning_rate': 0.12, 'max_depth': 5, 'n_estimators': 50}
0.846694 (0.051708) with: {'learning_rate': 0.12, 'max_depth': 5, 'n_estimators': 100}
0.846881 (0.051518) with: {'learning_rate': 0.12, 'max_depth': 5, 'n_estimators': 150}
0.847447 (0.051179) with: {'learning_rate': 0.12, 'max_depth': 5, 'n_estimators': 200}
0.818390 (0.048416) with: {'learning_rate': 0.12, 'max_depth': 7, 'n_estimators': 50}
0.820131 (0.048414) with: {'learning_rate': 0.12, 'max_depth': 7, 'n_estimators': 100}
0.820054 (0.048396) with: {'learning_rate': 0.12, 'max_depth': 7, 'n_estimators': 150}
0.820016 (0.048421) with: {'learning_rate': 0.12, 'max_depth': 7, 'n_estimators': 200}
0.804340 (0.057268) with: {'learning_rate': 0.12, 'max_depth': 9, 'n_estimators': 50}
0.806046 (0.057127) with: {'learning_rate': 0.12, 'max_depth': 9, 'n_estimators': 100}
0.806095 (0.057104) with: {'learning_rate': 0.12, 'max_depth': 9, 'n_estimators': 150}
0.806095 (0.057104) with: {'learning_rate': 0.12, 'max_depth': 9, 'n_estimators': 200}
0.810022 (0.052949) with: {'learning_rate': 0.12, 'max_depth': 11, 'n_estimators': 50}
0.810958 (0.053529) with: {'learning_rate': 0.12, 'max_depth': 11, 'n_estimators': 100}
0.810963 (0.053537) with: {'learning_rate': 0.12, 'max_depth': 11, 'n_estimators': 150}
0.810963 (0.053537) with: {'learning_rate': 0.12, 'max_depth': 11, 'n_estimators': 200}
0.807990 (0.050201) with: {'learning_rate': 0.12, 'max_depth': 13, 'n_estimators': 50}
0.809496 (0.050527) with: {'learning_rate': 0.12, 'max_depth': 13, 'n_estimators': 100}
0.809512 (0.050529) with: {'learning_rate': 0.12, 'max_depth': 13, 'n_estimators': 150}
0.809512 (0.050529) with: {'learning_rate': 0.12, 'max_depth': 13, 'n_estimators': 200}
0.810050 (0.051373) with: {'learning_rate': 0.12, 'max_depth': 15, 'n_estimators': 50}
0.811131 (0.052055) with: {'learning_rate': 0.12, 'max_depth': 15, 'n_estimators': 100}
0.811146 (0.052061) with: {'learning_rate': 0.12, 'max_depth': 15, 'n_estimators': 150}
0.811146 (0.052061) with: {'learning_rate': 0.12, 'max_depth': 15, 'n_estimators': 200}
0.807162 (0.048547) with: {'learning_rate': 0.15, 'max_depth': 1, 'n_estimators': 50}
0.824273 (0.050445) with: {'learning_rate': 0.15, 'max_depth': 1, 'n_estimators': 100}
0.830500 (0.050552) with: {'learning_rate': 0.15, 'max_depth': 1, 'n_estimators': 150}
0.830391 (0.051783) with: {'learning_rate': 0.15, 'max_depth': 1, 'n_estimators': 200}
0.852195 (0.056525) with: {'learning_rate': 0.15, 'max_depth': 3, 'n_estimators': 50}
0.858841 (0.055583) with: {'learning_rate': 0.15, 'max_depth': 3, 'n_estimators': 100}
0.860678 (0.055755) with: {'learning_rate': 0.15, 'max_depth': 3, 'n_estimators': 150}
0.860202 (0.056060) with: {'learning_rate': 0.15, 'max_depth': 3, 'n_estimators': 200}
0.851480 (0.042938) with: {'learning_rate': 0.15, 'max_depth': 5, 'n_estimators': 50}
0.852485 (0.043547) with: {'learning_rate': 0.15, 'max_depth': 5, 'n_estimators': 100}
0.852983 (0.043729) with: {'learning_rate': 0.15, 'max_depth': 5, 'n_estimators': 150}
0.853004 (0.043800) with: {'learning_rate': 0.15, 'max_depth': 5, 'n_estimators': 200}
0.811017 (0.051230) with: {'learning_rate': 0.15, 'max_depth': 7, 'n_estimators': 50}
0.811935 (0.051563) with: {'learning_rate': 0.15, 'max_depth': 7, 'n_estimators': 100}
0.812016 (0.051550) with: {'learning_rate': 0.15, 'max_depth': 7, 'n_estimators': 150}
0.812016 (0.051550) with: {'learning_rate': 0.15, 'max_depth': 7, 'n_estimators': 200}
0.807335 (0.054503) with: {'learning_rate': 0.15, 'max_depth': 9, 'n_estimators': 50}
0.807742 (0.054438) with: {'learning_rate': 0.15, 'max_depth': 9, 'n_estimators': 100}
0.807742 (0.054438) with: {'learning_rate': 0.15, 'max_depth': 9, 'n_estimators': 150}
0.807742 (0.054438) with: {'learning_rate': 0.15, 'max_depth': 9, 'n_estimators': 200}
0.810597 (0.052285) with: {'learning_rate': 0.15, 'max_depth': 11, 'n_estimators': 50}
0.810936 (0.052312) with: {'learning_rate': 0.15, 'max_depth': 11, 'n_estimators': 100}
0.810936 (0.052312) with: {'learning_rate': 0.15, 'max_depth': 11, 'n_estimators': 150}
0.810936 (0.052312) with: {'learning_rate': 0.15, 'max_depth': 11, 'n_estimators': 200}
0.814041 (0.049302) with: {'learning_rate': 0.15, 'max_depth': 13, 'n_estimators': 50}
0.814413 (0.049371) with: {'learning_rate': 0.15, 'max_depth': 13, 'n_estimators': 100}
0.814413 (0.049371) with: {'learning_rate': 0.15, 'max_depth': 13, 'n_estimators': 150}
0.814413 (0.049371) with: {'learning_rate': 0.15, 'max_depth': 13, 'n_estimators': 200}
0.807168 (0.053947) with: {'learning_rate': 0.15, 'max_depth': 15, 'n_estimators': 50}
0.807499 (0.054091) with: {'learning_rate': 0.15, 'max_depth': 15, 'n_estimators': 100}
0.807499 (0.054091) with: {'learning_rate': 0.15, 'max_depth': 15, 'n_estimators': 150}
0.807499 (0.054091) with: {'learning_rate': 0.15, 'max_depth': 15, 'n_estimators': 200}
0.810923 (0.050566) with: {'learning_rate': 0.18, 'max_depth': 1, 'n_estimators': 50}
0.826561 (0.050272) with: {'learning_rate': 0.18, 'max_depth': 1, 'n_estimators': 100}
0.830294 (0.049726) with: {'learning_rate': 0.18, 'max_depth': 1, 'n_estimators': 150}
0.830412 (0.050068) with: {'learning_rate': 0.18, 'max_depth': 1, 'n_estimators': 200}
0.847566 (0.059016) with: {'learning_rate': 0.18, 'max_depth': 3, 'n_estimators': 50}
0.854473 (0.056008) with: {'learning_rate': 0.18, 'max_depth': 3, 'n_estimators': 100}
0.855668 (0.056143) with: {'learning_rate': 0.18, 'max_depth': 3, 'n_estimators': 150}
0.855706 (0.055851) with: {'learning_rate': 0.18, 'max_depth': 3, 'n_estimators': 200}
0.841307 (0.052664) with: {'learning_rate': 0.18, 'max_depth': 5, 'n_estimators': 50}
0.841590 (0.053217) with: {'learning_rate': 0.18, 'max_depth': 5, 'n_estimators': 100}
0.841445 (0.053423) with: {'learning_rate': 0.18, 'max_depth': 5, 'n_estimators': 150}
0.841435 (0.053478) with: {'learning_rate': 0.18, 'max_depth': 5, 'n_estimators': 200}
0.807878 (0.052757) with: {'learning_rate': 0.18, 'max_depth': 7, 'n_estimators': 50}
0.808334 (0.052373) with: {'learning_rate': 0.18, 'max_depth': 7, 'n_estimators': 100}
0.808363 (0.052378) with: {'learning_rate': 0.18, 'max_depth': 7, 'n_estimators': 150}
0.808363 (0.052378) with: {'learning_rate': 0.18, 'max_depth': 7, 'n_estimators': 200}
0.804948 (0.054592) with: {'learning_rate': 0.18, 'max_depth': 9, 'n_estimators': 50}
0.805130 (0.054519) with: {'learning_rate': 0.18, 'max_depth': 9, 'n_estimators': 100}
0.805130 (0.054519) with: {'learning_rate': 0.18, 'max_depth': 9, 'n_estimators': 150}
0.805130 (0.054519) with: {'learning_rate': 0.18, 'max_depth': 9, 'n_estimators': 200}
0.803086 (0.052977) with: {'learning_rate': 0.18, 'max_depth': 11, 'n_estimators': 50}
0.803229 (0.052990) with: {'learning_rate': 0.18, 'max_depth': 11, 'n_estimators': 100}
0.803229 (0.052990) with: {'learning_rate': 0.18, 'max_depth': 11, 'n_estimators': 150}
0.803229 (0.052990) with: {'learning_rate': 0.18, 'max_depth': 11, 'n_estimators': 200}
0.806149 (0.054086) with: {'learning_rate': 0.18, 'max_depth': 13, 'n_estimators': 50}
0.806294 (0.054156) with: {'learning_rate': 0.18, 'max_depth': 13, 'n_estimators': 100}
0.806294 (0.054156) with: {'learning_rate': 0.18, 'max_depth': 13, 'n_estimators': 150}
0.806294 (0.054156) with: {'learning_rate': 0.18, 'max_depth': 13, 'n_estimators': 200}
0.805339 (0.054438) with: {'learning_rate': 0.18, 'max_depth': 15, 'n_estimators': 50}
0.805497 (0.054478) with: {'learning_rate': 0.18, 'max_depth': 15, 'n_estimators': 100}
0.805497 (0.054478) with: {'learning_rate': 0.18, 'max_depth': 15, 'n_estimators': 150}
0.805497 (0.054478) with: {'learning_rate': 0.18, 'max_depth': 15, 'n_estimators': 200}
0.818772 (0.048965) with: {'learning_rate': 0.21, 'max_depth': 1, 'n_estimators': 50}
0.830305 (0.048710) with: {'learning_rate': 0.21, 'max_depth': 1, 'n_estimators': 100}
0.832875 (0.048551) with: {'learning_rate': 0.21, 'max_depth': 1, 'n_estimators': 150}
0.833115 (0.049489) with: {'learning_rate': 0.21, 'max_depth': 1, 'n_estimators': 200}
0.852619 (0.055268) with: {'learning_rate': 0.21, 'max_depth': 3, 'n_estimators': 50}
0.854279 (0.055507) with: {'learning_rate': 0.21, 'max_depth': 3, 'n_estimators': 100}
0.855926 (0.055786) with: {'learning_rate': 0.21, 'max_depth': 3, 'n_estimators': 150}
0.857225 (0.055403) with: {'learning_rate': 0.21, 'max_depth': 3, 'n_estimators': 200}
0.844948 (0.048417) with: {'learning_rate': 0.21, 'max_depth': 5, 'n_estimators': 50}
0.844659 (0.048358) with: {'learning_rate': 0.21, 'max_depth': 5, 'n_estimators': 100}
0.844761 (0.048342) with: {'learning_rate': 0.21, 'max_depth': 5, 'n_estimators': 150}
0.844807 (0.048326) with: {'learning_rate': 0.21, 'max_depth': 5, 'n_estimators': 200}
0.816587 (0.052132) with: {'learning_rate': 0.21, 'max_depth': 7, 'n_estimators': 50}
0.816323 (0.052509) with: {'learning_rate': 0.21, 'max_depth': 7, 'n_estimators': 100}
0.816322 (0.052509) with: {'learning_rate': 0.21, 'max_depth': 7, 'n_estimators': 150}
0.816322 (0.052509) with: {'learning_rate': 0.21, 'max_depth': 7, 'n_estimators': 200}
0.807687 (0.050865) with: {'learning_rate': 0.21, 'max_depth': 9, 'n_estimators': 50}
0.807783 (0.050856) with: {'learning_rate': 0.21, 'max_depth': 9, 'n_estimators': 100}
0.807783 (0.050856) with: {'learning_rate': 0.21, 'max_depth': 9, 'n_estimators': 150}
0.807783 (0.050856) with: {'learning_rate': 0.21, 'max_depth': 9, 'n_estimators': 200}
0.807752 (0.054800) with: {'learning_rate': 0.21, 'max_depth': 11, 'n_estimators': 50}
0.807782 (0.054819) with: {'learning_rate': 0.21, 'max_depth': 11, 'n_estimators': 100}
0.807782 (0.054819) with: {'learning_rate': 0.21, 'max_depth': 11, 'n_estimators': 150}
0.807782 (0.054819) with: {'learning_rate': 0.21, 'max_depth': 11, 'n_estimators': 200}
0.806377 (0.052411) with: {'learning_rate': 0.21, 'max_depth': 13, 'n_estimators': 50}
0.806415 (0.052447) with: {'learning_rate': 0.21, 'max_depth': 13, 'n_estimators': 100}
0.806415 (0.052447) with: {'learning_rate': 0.21, 'max_depth': 13, 'n_estimators': 150}
0.806415 (0.052447) with: {'learning_rate': 0.21, 'max_depth': 13, 'n_estimators': 200}
0.807638 (0.052222) with: {'learning_rate': 0.21, 'max_depth': 15, 'n_estimators': 50}
0.807671 (0.052247) with: {'learning_rate': 0.21, 'max_depth': 15, 'n_estimators': 100}
0.807671 (0.052247) with: {'learning_rate': 0.21, 'max_depth': 15, 'n_estimators': 150}
0.807671 (0.052247) with: {'learning_rate': 0.21, 'max_depth': 15, 'n_estimators': 200}
0.819971 (0.046487) with: {'learning_rate': 0.24, 'max_depth': 1, 'n_estimators': 50}
0.830501 (0.048655) with: {'learning_rate': 0.24, 'max_depth': 1, 'n_estimators': 100}
0.832064 (0.049740) with: {'learning_rate': 0.24, 'max_depth': 1, 'n_estimators': 150}
0.831840 (0.050128) with: {'learning_rate': 0.24, 'max_depth': 1, 'n_estimators': 200}
0.857136 (0.046683) with: {'learning_rate': 0.24, 'max_depth': 3, 'n_estimators': 50}
0.859483 (0.045770) with: {'learning_rate': 0.24, 'max_depth': 3, 'n_estimators': 100}
0.859945 (0.045322) with: {'learning_rate': 0.24, 'max_depth': 3, 'n_estimators': 150}
0.859801 (0.045460) with: {'learning_rate': 0.24, 'max_depth': 3, 'n_estimators': 200}
0.850955 (0.049845) with: {'learning_rate': 0.24, 'max_depth': 5, 'n_estimators': 50}
0.850508 (0.050615) with: {'learning_rate': 0.24, 'max_depth': 5, 'n_estimators': 100}
0.850476 (0.050598) with: {'learning_rate': 0.24, 'max_depth': 5, 'n_estimators': 150}
0.850498 (0.050571) with: {'learning_rate': 0.24, 'max_depth': 5, 'n_estimators': 200}
0.811733 (0.057462) with: {'learning_rate': 0.24, 'max_depth': 7, 'n_estimators': 50}
0.811878 (0.057440) with: {'learning_rate': 0.24, 'max_depth': 7, 'n_estimators': 100}
0.811878 (0.057440) with: {'learning_rate': 0.24, 'max_depth': 7, 'n_estimators': 150}
0.811878 (0.057440) with: {'learning_rate': 0.24, 'max_depth': 7, 'n_estimators': 200}
0.807850 (0.060428) with: {'learning_rate': 0.24, 'max_depth': 9, 'n_estimators': 50}
0.807894 (0.060424) with: {'learning_rate': 0.24, 'max_depth': 9, 'n_estimators': 100}
0.807894 (0.060424) with: {'learning_rate': 0.24, 'max_depth': 9, 'n_estimators': 150}
0.807894 (0.060424) with: {'learning_rate': 0.24, 'max_depth': 9, 'n_estimators': 200}
0.802244 (0.059772) with: {'learning_rate': 0.24, 'max_depth': 11, 'n_estimators': 50}
0.802246 (0.059770) with: {'learning_rate': 0.24, 'max_depth': 11, 'n_estimators': 100}
0.802246 (0.059770) with: {'learning_rate': 0.24, 'max_depth': 11, 'n_estimators': 150}
0.802246 (0.059770) with: {'learning_rate': 0.24, 'max_depth': 11, 'n_estimators': 200}
0.807033 (0.061863) with: {'learning_rate': 0.24, 'max_depth': 13, 'n_estimators': 50}
0.807040 (0.061864) with: {'learning_rate': 0.24, 'max_depth': 13, 'n_estimators': 100}
0.807040 (0.061864) with: {'learning_rate': 0.24, 'max_depth': 13, 'n_estimators': 150}
0.807040 (0.061864) with: {'learning_rate': 0.24, 'max_depth': 13, 'n_estimators': 200}
0.804463 (0.063512) with: {'learning_rate': 0.24, 'max_depth': 15, 'n_estimators': 50}
0.804475 (0.063511) with: {'learning_rate': 0.24, 'max_depth': 15, 'n_estimators': 100}
0.804475 (0.063511) with: {'learning_rate': 0.24, 'max_depth': 15, 'n_estimators': 150}
0.804475 (0.063511) with: {'learning_rate': 0.24, 'max_depth': 15, 'n_estimators': 200}
0.821150 (0.049890) with: {'learning_rate': 0.27, 'max_depth': 1, 'n_estimators': 50}
0.830742 (0.049213) with: {'learning_rate': 0.27, 'max_depth': 1, 'n_estimators': 100}
0.831787 (0.050679) with: {'learning_rate': 0.27, 'max_depth': 1, 'n_estimators': 150}
0.830709 (0.051395) with: {'learning_rate': 0.27, 'max_depth': 1, 'n_estimators': 200}
0.857873 (0.052985) with: {'learning_rate': 0.27, 'max_depth': 3, 'n_estimators': 50}
0.861046 (0.050332) with: {'learning_rate': 0.27, 'max_depth': 3, 'n_estimators': 100}
0.861720 (0.049712) with: {'learning_rate': 0.27, 'max_depth': 3, 'n_estimators': 150}
0.861372 (0.049998) with: {'learning_rate': 0.27, 'max_depth': 3, 'n_estimators': 200}
0.847206 (0.051159) with: {'learning_rate': 0.27, 'max_depth': 5, 'n_estimators': 50}
0.847094 (0.051525) with: {'learning_rate': 0.27, 'max_depth': 5, 'n_estimators': 100}
0.847037 (0.051513) with: {'learning_rate': 0.27, 'max_depth': 5, 'n_estimators': 150}
0.847035 (0.051514) with: {'learning_rate': 0.27, 'max_depth': 5, 'n_estimators': 200}
0.803202 (0.050403) with: {'learning_rate': 0.27, 'max_depth': 7, 'n_estimators': 50}
0.803226 (0.050360) with: {'learning_rate': 0.27, 'max_depth': 7, 'n_estimators': 100}
0.803226 (0.050360) with: {'learning_rate': 0.27, 'max_depth': 7, 'n_estimators': 150}
0.803226 (0.050360) with: {'learning_rate': 0.27, 'max_depth': 7, 'n_estimators': 200}
0.806931 (0.056619) with: {'learning_rate': 0.27, 'max_depth': 9, 'n_estimators': 50}
0.806930 (0.056616) with: {'learning_rate': 0.27, 'max_depth': 9, 'n_estimators': 100}
0.806930 (0.056616) with: {'learning_rate': 0.27, 'max_depth': 9, 'n_estimators': 150}
0.806930 (0.056616) with: {'learning_rate': 0.27, 'max_depth': 9, 'n_estimators': 200}
0.802898 (0.060888) with: {'learning_rate': 0.27, 'max_depth': 11, 'n_estimators': 50}
0.802900 (0.060887) with: {'learning_rate': 0.27, 'max_depth': 11, 'n_estimators': 100}
0.802900 (0.060887) with: {'learning_rate': 0.27, 'max_depth': 11, 'n_estimators': 150}
0.802900 (0.060887) with: {'learning_rate': 0.27, 'max_depth': 11, 'n_estimators': 200}
0.799887 (0.055534) with: {'learning_rate': 0.27, 'max_depth': 13, 'n_estimators': 50}
0.799886 (0.055534) with: {'learning_rate': 0.27, 'max_depth': 13, 'n_estimators': 100}
0.799886 (0.055534) with: {'learning_rate': 0.27, 'max_depth': 13, 'n_estimators': 150}
0.799886 (0.055534) with: {'learning_rate': 0.27, 'max_depth': 13, 'n_estimators': 200}
0.800050 (0.056070) with: {'learning_rate': 0.27, 'max_depth': 15, 'n_estimators': 50}
0.800051 (0.056071) with: {'learning_rate': 0.27, 'max_depth': 15, 'n_estimators': 100}
0.800051 (0.056071) with: {'learning_rate': 0.27, 'max_depth': 15, 'n_estimators': 150}
0.800051 (0.056071) with: {'learning_rate': 0.27, 'max_depth': 15, 'n_estimators': 200}
0.819760 (0.053159) with: {'learning_rate': 0.3, 'max_depth': 1, 'n_estimators': 50}
0.827881 (0.052422) with: {'learning_rate': 0.3, 'max_depth': 1, 'n_estimators': 100}
0.828890 (0.053188) with: {'learning_rate': 0.3, 'max_depth': 1, 'n_estimators': 150}
0.829313 (0.052821) with: {'learning_rate': 0.3, 'max_depth': 1, 'n_estimators': 200}
0.854570 (0.052578) with: {'learning_rate': 0.3, 'max_depth': 3, 'n_estimators': 50}
0.857880 (0.050891) with: {'learning_rate': 0.3, 'max_depth': 3, 'n_estimators': 100}
0.858274 (0.051601) with: {'learning_rate': 0.3, 'max_depth': 3, 'n_estimators': 150}
0.858004 (0.051720) with: {'learning_rate': 0.3, 'max_depth': 3, 'n_estimators': 200}
0.837382 (0.048349) with: {'learning_rate': 0.3, 'max_depth': 5, 'n_estimators': 50}
0.837511 (0.048140) with: {'learning_rate': 0.3, 'max_depth': 5, 'n_estimators': 100}
0.837538 (0.048128) with: {'learning_rate': 0.3, 'max_depth': 5, 'n_estimators': 150}
0.837538 (0.048128) with: {'learning_rate': 0.3, 'max_depth': 5, 'n_estimators': 200}
0.814336 (0.051179) with: {'learning_rate': 0.3, 'max_depth': 7, 'n_estimators': 50}
0.814383 (0.051205) with: {'learning_rate': 0.3, 'max_depth': 7, 'n_estimators': 100}
0.814383 (0.051205) with: {'learning_rate': 0.3, 'max_depth': 7, 'n_estimators': 150}
0.814383 (0.051205) with: {'learning_rate': 0.3, 'max_depth': 7, 'n_estimators': 200}
0.806069 (0.051545) with: {'learning_rate': 0.3, 'max_depth': 9, 'n_estimators': 50}
0.806069 (0.051545) with: {'learning_rate': 0.3, 'max_depth': 9, 'n_estimators': 100}
0.806069 (0.051545) with: {'learning_rate': 0.3, 'max_depth': 9, 'n_estimators': 150}
0.806069 (0.051545) with: {'learning_rate': 0.3, 'max_depth': 9, 'n_estimators': 200}
0.810698 (0.049687) with: {'learning_rate': 0.3, 'max_depth': 11, 'n_estimators': 50}
0.810698 (0.049687) with: {'learning_rate': 0.3, 'max_depth': 11, 'n_estimators': 100}
0.810698 (0.049687) with: {'learning_rate': 0.3, 'max_depth': 11, 'n_estimators': 150}
0.810698 (0.049687) with: {'learning_rate': 0.3, 'max_depth': 11, 'n_estimators': 200}
0.807420 (0.051992) with: {'learning_rate': 0.3, 'max_depth': 13, 'n_estimators': 50}
0.807420 (0.051992) with: {'learning_rate': 0.3, 'max_depth': 13, 'n_estimators': 100}
0.807420 (0.051992) with: {'learning_rate': 0.3, 'max_depth': 13, 'n_estimators': 150}
0.807420 (0.051992) with: {'learning_rate': 0.3, 'max_depth': 13, 'n_estimators': 200}
0.803384 (0.054540) with: {'learning_rate': 0.3, 'max_depth': 15, 'n_estimators': 50}
0.803384 (0.054540) with: {'learning_rate': 0.3, 'max_depth': 15, 'n_estimators': 100}
0.803384 (0.054540) with: {'learning_rate': 0.3, 'max_depth': 15, 'n_estimators': 150}
0.803384 (0.054540) with: {'learning_rate': 0.3, 'max_depth': 15, 'n_estimators': 200}

T2、TimeSeriesSplit=GSCV模型调参

输出XGBR_GSCV模型最佳得分、最优参数：0.8772,{'learning_rate': 0.15, 'max_depth': 3, 'n_estimators': 200}
XGBR_TimeS_GSCV time： 365.73213645175
XGBoost Score value: 0.8392863414585984
XGBoost R2    value: 0.8392863414585984
XGBoost MAE   value: 2.265871170374352
XGBoost RMSE  value: 3.5301480357113575

Fitting 6 folds for each of 320 candidates, totalling 1920 fits
[Parallel(n_jobs=1)]: Using backend SequentialBackend with 1 concurrent workers.
[Parallel(n_jobs=1)]: Done 1920 out of 1920 | elapsed:  6.1min finished
0.601753 (0.041626) with: {'learning_rate': 0.03, 'max_depth': 1, 'n_estimators': 50}
0.741963 (0.052567) with: {'learning_rate': 0.03, 'max_depth': 1, 'n_estimators': 100}
0.769275 (0.057973) with: {'learning_rate': 0.03, 'max_depth': 1, 'n_estimators': 150}
0.777850 (0.062691) with: {'learning_rate': 0.03, 'max_depth': 1, 'n_estimators': 200}
0.761917 (0.044601) with: {'learning_rate': 0.03, 'max_depth': 3, 'n_estimators': 50}
0.849871 (0.032589) with: {'learning_rate': 0.03, 'max_depth': 3, 'n_estimators': 100}
0.860943 (0.036123) with: {'learning_rate': 0.03, 'max_depth': 3, 'n_estimators': 150}
0.865884 (0.036296) with: {'learning_rate': 0.03, 'max_depth': 3, 'n_estimators': 200}
0.768191 (0.046584) with: {'learning_rate': 0.03, 'max_depth': 5, 'n_estimators': 50}
0.847475 (0.037179) with: {'learning_rate': 0.03, 'max_depth': 5, 'n_estimators': 100}
0.857618 (0.034498) with: {'learning_rate': 0.03, 'max_depth': 5, 'n_estimators': 150}
0.860371 (0.034667) with: {'learning_rate': 0.03, 'max_depth': 5, 'n_estimators': 200}
0.762532 (0.043118) with: {'learning_rate': 0.03, 'max_depth': 7, 'n_estimators': 50}
0.838141 (0.032139) with: {'learning_rate': 0.03, 'max_depth': 7, 'n_estimators': 100}
0.846885 (0.027194) with: {'learning_rate': 0.03, 'max_depth': 7, 'n_estimators': 150}
0.850041 (0.025481) with: {'learning_rate': 0.03, 'max_depth': 7, 'n_estimators': 200}
0.757383 (0.050920) with: {'learning_rate': 0.03, 'max_depth': 9, 'n_estimators': 50}
0.834539 (0.037476) with: {'learning_rate': 0.03, 'max_depth': 9, 'n_estimators': 100}
0.845794 (0.033418) with: {'learning_rate': 0.03, 'max_depth': 9, 'n_estimators': 150}
0.848075 (0.032044) with: {'learning_rate': 0.03, 'max_depth': 9, 'n_estimators': 200}
0.754782 (0.053572) with: {'learning_rate': 0.03, 'max_depth': 11, 'n_estimators': 50}
0.831093 (0.039371) with: {'learning_rate': 0.03, 'max_depth': 11, 'n_estimators': 100}
0.838982 (0.034142) with: {'learning_rate': 0.03, 'max_depth': 11, 'n_estimators': 150}
0.841296 (0.031967) with: {'learning_rate': 0.03, 'max_depth': 11, 'n_estimators': 200}
0.756791 (0.051747) with: {'learning_rate': 0.03, 'max_depth': 13, 'n_estimators': 50}
0.830920 (0.039090) with: {'learning_rate': 0.03, 'max_depth': 13, 'n_estimators': 100}
0.840551 (0.032427) with: {'learning_rate': 0.03, 'max_depth': 13, 'n_estimators': 150}
0.843931 (0.030071) with: {'learning_rate': 0.03, 'max_depth': 13, 'n_estimators': 200}
0.756117 (0.054046) with: {'learning_rate': 0.03, 'max_depth': 15, 'n_estimators': 50}
0.831666 (0.040286) with: {'learning_rate': 0.03, 'max_depth': 15, 'n_estimators': 100}
0.840035 (0.034584) with: {'learning_rate': 0.03, 'max_depth': 15, 'n_estimators': 150}
0.843151 (0.032286) with: {'learning_rate': 0.03, 'max_depth': 15, 'n_estimators': 200}
0.745626 (0.052724) with: {'learning_rate': 0.06, 'max_depth': 1, 'n_estimators': 50}
0.777825 (0.062635) with: {'learning_rate': 0.06, 'max_depth': 1, 'n_estimators': 100}
0.790555 (0.063551) with: {'learning_rate': 0.06, 'max_depth': 1, 'n_estimators': 150}
0.795161 (0.067328) with: {'learning_rate': 0.06, 'max_depth': 1, 'n_estimators': 200}
0.850889 (0.032347) with: {'learning_rate': 0.06, 'max_depth': 3, 'n_estimators': 50}
0.867786 (0.034764) with: {'learning_rate': 0.06, 'max_depth': 3, 'n_estimators': 100}
0.870313 (0.035557) with: {'learning_rate': 0.06, 'max_depth': 3, 'n_estimators': 150}
0.870957 (0.036189) with: {'learning_rate': 0.06, 'max_depth': 3, 'n_estimators': 200}
0.850339 (0.038543) with: {'learning_rate': 0.06, 'max_depth': 5, 'n_estimators': 50}
0.864939 (0.034315) with: {'learning_rate': 0.06, 'max_depth': 5, 'n_estimators': 100}
0.865762 (0.033280) with: {'learning_rate': 0.06, 'max_depth': 5, 'n_estimators': 150}
0.865658 (0.032928) with: {'learning_rate': 0.06, 'max_depth': 5, 'n_estimators': 200}
0.839195 (0.034252) with: {'learning_rate': 0.06, 'max_depth': 7, 'n_estimators': 50}
0.852720 (0.027235) with: {'learning_rate': 0.06, 'max_depth': 7, 'n_estimators': 100}
0.853702 (0.027123) with: {'learning_rate': 0.06, 'max_depth': 7, 'n_estimators': 150}
0.853363 (0.026771) with: {'learning_rate': 0.06, 'max_depth': 7, 'n_estimators': 200}
0.835426 (0.038498) with: {'learning_rate': 0.06, 'max_depth': 9, 'n_estimators': 50}
0.850673 (0.029506) with: {'learning_rate': 0.06, 'max_depth': 9, 'n_estimators': 100}
0.851901 (0.028517) with: {'learning_rate': 0.06, 'max_depth': 9, 'n_estimators': 150}
0.852140 (0.028341) with: {'learning_rate': 0.06, 'max_depth': 9, 'n_estimators': 200}
0.830953 (0.038574) with: {'learning_rate': 0.06, 'max_depth': 11, 'n_estimators': 50}
0.843297 (0.032231) with: {'learning_rate': 0.06, 'max_depth': 11, 'n_estimators': 100}
0.844927 (0.031055) with: {'learning_rate': 0.06, 'max_depth': 11, 'n_estimators': 150}
0.845079 (0.030915) with: {'learning_rate': 0.06, 'max_depth': 11, 'n_estimators': 200}
0.832709 (0.036911) with: {'learning_rate': 0.06, 'max_depth': 13, 'n_estimators': 50}
0.844690 (0.029680) with: {'learning_rate': 0.06, 'max_depth': 13, 'n_estimators': 100}
0.846225 (0.028501) with: {'learning_rate': 0.06, 'max_depth': 13, 'n_estimators': 150}
0.846421 (0.028346) with: {'learning_rate': 0.06, 'max_depth': 13, 'n_estimators': 200}
0.832991 (0.037219) with: {'learning_rate': 0.06, 'max_depth': 15, 'n_estimators': 50}
0.846270 (0.027385) with: {'learning_rate': 0.06, 'max_depth': 15, 'n_estimators': 100}
0.847907 (0.026163) with: {'learning_rate': 0.06, 'max_depth': 15, 'n_estimators': 150}
0.848179 (0.025976) with: {'learning_rate': 0.06, 'max_depth': 15, 'n_estimators': 200}
0.769494 (0.058840) with: {'learning_rate': 0.09, 'max_depth': 1, 'n_estimators': 50}
0.791904 (0.061566) with: {'learning_rate': 0.09, 'max_depth': 1, 'n_estimators': 100}
0.798994 (0.066574) with: {'learning_rate': 0.09, 'max_depth': 1, 'n_estimators': 150}
0.803098 (0.068958) with: {'learning_rate': 0.09, 'max_depth': 1, 'n_estimators': 200}
0.857212 (0.039482) with: {'learning_rate': 0.09, 'max_depth': 3, 'n_estimators': 50}
0.864690 (0.041052) with: {'learning_rate': 0.09, 'max_depth': 3, 'n_estimators': 100}
0.866892 (0.042026) with: {'learning_rate': 0.09, 'max_depth': 3, 'n_estimators': 150}
0.867056 (0.044514) with: {'learning_rate': 0.09, 'max_depth': 3, 'n_estimators': 200}
0.863862 (0.033670) with: {'learning_rate': 0.09, 'max_depth': 5, 'n_estimators': 50}
0.867507 (0.032224) with: {'learning_rate': 0.09, 'max_depth': 5, 'n_estimators': 100}
0.867579 (0.032191) with: {'learning_rate': 0.09, 'max_depth': 5, 'n_estimators': 150}
0.867328 (0.032260) with: {'learning_rate': 0.09, 'max_depth': 5, 'n_estimators': 200}
0.847872 (0.030395) with: {'learning_rate': 0.09, 'max_depth': 7, 'n_estimators': 50}
0.851244 (0.028736) with: {'learning_rate': 0.09, 'max_depth': 7, 'n_estimators': 100}
0.851237 (0.028451) with: {'learning_rate': 0.09, 'max_depth': 7, 'n_estimators': 150}
0.851150 (0.028505) with: {'learning_rate': 0.09, 'max_depth': 7, 'n_estimators': 200}
0.852037 (0.030096) with: {'learning_rate': 0.09, 'max_depth': 9, 'n_estimators': 50}
0.856354 (0.027161) with: {'learning_rate': 0.09, 'max_depth': 9, 'n_estimators': 100}
0.856581 (0.027075) with: {'learning_rate': 0.09, 'max_depth': 9, 'n_estimators': 150}
0.856585 (0.027095) with: {'learning_rate': 0.09, 'max_depth': 9, 'n_estimators': 200}
0.842612 (0.037117) with: {'learning_rate': 0.09, 'max_depth': 11, 'n_estimators': 50}
0.846502 (0.034153) with: {'learning_rate': 0.09, 'max_depth': 11, 'n_estimators': 100}
0.846631 (0.034112) with: {'learning_rate': 0.09, 'max_depth': 11, 'n_estimators': 150}
0.846628 (0.034114) with: {'learning_rate': 0.09, 'max_depth': 11, 'n_estimators': 200}
0.837185 (0.045250) with: {'learning_rate': 0.09, 'max_depth': 13, 'n_estimators': 50}
0.841045 (0.042592) with: {'learning_rate': 0.09, 'max_depth': 13, 'n_estimators': 100}
0.841290 (0.042421) with: {'learning_rate': 0.09, 'max_depth': 13, 'n_estimators': 150}
0.841292 (0.042423) with: {'learning_rate': 0.09, 'max_depth': 13, 'n_estimators': 200}
0.836856 (0.044501) with: {'learning_rate': 0.09, 'max_depth': 15, 'n_estimators': 50}
0.841215 (0.041712) with: {'learning_rate': 0.09, 'max_depth': 15, 'n_estimators': 100}
0.841468 (0.041614) with: {'learning_rate': 0.09, 'max_depth': 15, 'n_estimators': 150}
0.841467 (0.041616) with: {'learning_rate': 0.09, 'max_depth': 15, 'n_estimators': 200}
0.780448 (0.061299) with: {'learning_rate': 0.12, 'max_depth': 1, 'n_estimators': 50}
0.795945 (0.066888) with: {'learning_rate': 0.12, 'max_depth': 1, 'n_estimators': 100}
0.802161 (0.068522) with: {'learning_rate': 0.12, 'max_depth': 1, 'n_estimators': 150}
0.802621 (0.068183) with: {'learning_rate': 0.12, 'max_depth': 1, 'n_estimators': 200}
0.865637 (0.033886) with: {'learning_rate': 0.12, 'max_depth': 3, 'n_estimators': 50}
0.867696 (0.038014) with: {'learning_rate': 0.12, 'max_depth': 3, 'n_estimators': 100}
0.867815 (0.038860) with: {'learning_rate': 0.12, 'max_depth': 3, 'n_estimators': 150}
0.867725 (0.040073) with: {'learning_rate': 0.12, 'max_depth': 3, 'n_estimators': 200}
0.862285 (0.036140) with: {'learning_rate': 0.12, 'max_depth': 5, 'n_estimators': 50}
0.862022 (0.035454) with: {'learning_rate': 0.12, 'max_depth': 5, 'n_estimators': 100}
0.860983 (0.034947) with: {'learning_rate': 0.12, 'max_depth': 5, 'n_estimators': 150}
0.860190 (0.035108) with: {'learning_rate': 0.12, 'max_depth': 5, 'n_estimators': 200}
0.842677 (0.036587) with: {'learning_rate': 0.12, 'max_depth': 7, 'n_estimators': 50}
0.843950 (0.035671) with: {'learning_rate': 0.12, 'max_depth': 7, 'n_estimators': 100}
0.843875 (0.035644) with: {'learning_rate': 0.12, 'max_depth': 7, 'n_estimators': 150}
0.843844 (0.035605) with: {'learning_rate': 0.12, 'max_depth': 7, 'n_estimators': 200}
0.843541 (0.033950) with: {'learning_rate': 0.12, 'max_depth': 9, 'n_estimators': 50}
0.845166 (0.033044) with: {'learning_rate': 0.12, 'max_depth': 9, 'n_estimators': 100}
0.845168 (0.033025) with: {'learning_rate': 0.12, 'max_depth': 9, 'n_estimators': 150}
0.845168 (0.033025) with: {'learning_rate': 0.12, 'max_depth': 9, 'n_estimators': 200}
0.836159 (0.037345) with: {'learning_rate': 0.12, 'max_depth': 11, 'n_estimators': 50}
0.838014 (0.036395) with: {'learning_rate': 0.12, 'max_depth': 11, 'n_estimators': 100}
0.838049 (0.036371) with: {'learning_rate': 0.12, 'max_depth': 11, 'n_estimators': 150}
0.838049 (0.036371) with: {'learning_rate': 0.12, 'max_depth': 11, 'n_estimators': 200}
0.836390 (0.036978) with: {'learning_rate': 0.12, 'max_depth': 13, 'n_estimators': 50}
0.838276 (0.035834) with: {'learning_rate': 0.12, 'max_depth': 13, 'n_estimators': 100}
0.838287 (0.035842) with: {'learning_rate': 0.12, 'max_depth': 13, 'n_estimators': 150}
0.838287 (0.035842) with: {'learning_rate': 0.12, 'max_depth': 13, 'n_estimators': 200}
0.832744 (0.040432) with: {'learning_rate': 0.12, 'max_depth': 15, 'n_estimators': 50}
0.834029 (0.039399) with: {'learning_rate': 0.12, 'max_depth': 15, 'n_estimators': 100}
0.834041 (0.039407) with: {'learning_rate': 0.12, 'max_depth': 15, 'n_estimators': 150}
0.834041 (0.039407) with: {'learning_rate': 0.12, 'max_depth': 15, 'n_estimators': 200}
0.788286 (0.060777) with: {'learning_rate': 0.15, 'max_depth': 1, 'n_estimators': 50}
0.800992 (0.066420) with: {'learning_rate': 0.15, 'max_depth': 1, 'n_estimators': 100}
0.805570 (0.064051) with: {'learning_rate': 0.15, 'max_depth': 1, 'n_estimators': 150}
0.804252 (0.066082) with: {'learning_rate': 0.15, 'max_depth': 1, 'n_estimators': 200}
0.873263 (0.037228) with: {'learning_rate': 0.15, 'max_depth': 3, 'n_estimators': 50}
0.876110 (0.038150) with: {'learning_rate': 0.15, 'max_depth': 3, 'n_estimators': 100}
0.876937 (0.036679) with: {'learning_rate': 0.15, 'max_depth': 3, 'n_estimators': 150}
0.877158 (0.036059) with: {'learning_rate': 0.15, 'max_depth': 3, 'n_estimators': 200}
0.866913 (0.033984) with: {'learning_rate': 0.15, 'max_depth': 5, 'n_estimators': 50}
0.865987 (0.034375) with: {'learning_rate': 0.15, 'max_depth': 5, 'n_estimators': 100}
0.865887 (0.034338) with: {'learning_rate': 0.15, 'max_depth': 5, 'n_estimators': 150}
0.865612 (0.034281) with: {'learning_rate': 0.15, 'max_depth': 5, 'n_estimators': 200}
0.855167 (0.023013) with: {'learning_rate': 0.15, 'max_depth': 7, 'n_estimators': 50}
0.854927 (0.022918) with: {'learning_rate': 0.15, 'max_depth': 7, 'n_estimators': 100}
0.854869 (0.022988) with: {'learning_rate': 0.15, 'max_depth': 7, 'n_estimators': 150}
0.854869 (0.022989) with: {'learning_rate': 0.15, 'max_depth': 7, 'n_estimators': 200}
0.844406 (0.031283) with: {'learning_rate': 0.15, 'max_depth': 9, 'n_estimators': 50}
0.844863 (0.031062) with: {'learning_rate': 0.15, 'max_depth': 9, 'n_estimators': 100}
0.844860 (0.031057) with: {'learning_rate': 0.15, 'max_depth': 9, 'n_estimators': 150}
0.844860 (0.031057) with: {'learning_rate': 0.15, 'max_depth': 9, 'n_estimators': 200}
0.841634 (0.027276) with: {'learning_rate': 0.15, 'max_depth': 11, 'n_estimators': 50}
0.842250 (0.027120) with: {'learning_rate': 0.15, 'max_depth': 11, 'n_estimators': 100}
0.842250 (0.027120) with: {'learning_rate': 0.15, 'max_depth': 11, 'n_estimators': 150}
0.842250 (0.027120) with: {'learning_rate': 0.15, 'max_depth': 11, 'n_estimators': 200}
0.831977 (0.045021) with: {'learning_rate': 0.15, 'max_depth': 13, 'n_estimators': 50}
0.832695 (0.044631) with: {'learning_rate': 0.15, 'max_depth': 13, 'n_estimators': 100}
0.832695 (0.044631) with: {'learning_rate': 0.15, 'max_depth': 13, 'n_estimators': 150}
0.832695 (0.044631) with: {'learning_rate': 0.15, 'max_depth': 13, 'n_estimators': 200}
0.834018 (0.038130) with: {'learning_rate': 0.15, 'max_depth': 15, 'n_estimators': 50}
0.834701 (0.037810) with: {'learning_rate': 0.15, 'max_depth': 15, 'n_estimators': 100}
0.834701 (0.037809) with: {'learning_rate': 0.15, 'max_depth': 15, 'n_estimators': 150}
0.834701 (0.037809) with: {'learning_rate': 0.15, 'max_depth': 15, 'n_estimators': 200}
0.792071 (0.063119) with: {'learning_rate': 0.18, 'max_depth': 1, 'n_estimators': 50}
0.799122 (0.071840) with: {'learning_rate': 0.18, 'max_depth': 1, 'n_estimators': 100}
0.799956 (0.073676) with: {'learning_rate': 0.18, 'max_depth': 1, 'n_estimators': 150}
0.800800 (0.072044) with: {'learning_rate': 0.18, 'max_depth': 1, 'n_estimators': 200}
0.862375 (0.033146) with: {'learning_rate': 0.18, 'max_depth': 3, 'n_estimators': 50}
0.861233 (0.039972) with: {'learning_rate': 0.18, 'max_depth': 3, 'n_estimators': 100}
0.859582 (0.042319) with: {'learning_rate': 0.18, 'max_depth': 3, 'n_estimators': 150}
0.859903 (0.042120) with: {'learning_rate': 0.18, 'max_depth': 3, 'n_estimators': 200}
0.860906 (0.038278) with: {'learning_rate': 0.18, 'max_depth': 5, 'n_estimators': 50}
0.860003 (0.039017) with: {'learning_rate': 0.18, 'max_depth': 5, 'n_estimators': 100}
0.859676 (0.039497) with: {'learning_rate': 0.18, 'max_depth': 5, 'n_estimators': 150}
0.859539 (0.039609) with: {'learning_rate': 0.18, 'max_depth': 5, 'n_estimators': 200}
0.859172 (0.030006) with: {'learning_rate': 0.18, 'max_depth': 7, 'n_estimators': 50}
0.859255 (0.030341) with: {'learning_rate': 0.18, 'max_depth': 7, 'n_estimators': 100}
0.859227 (0.030337) with: {'learning_rate': 0.18, 'max_depth': 7, 'n_estimators': 150}
0.859227 (0.030337) with: {'learning_rate': 0.18, 'max_depth': 7, 'n_estimators': 200}
0.846028 (0.030136) with: {'learning_rate': 0.18, 'max_depth': 9, 'n_estimators': 50}
0.846116 (0.030054) with: {'learning_rate': 0.18, 'max_depth': 9, 'n_estimators': 100}
0.846116 (0.030054) with: {'learning_rate': 0.18, 'max_depth': 9, 'n_estimators': 150}
0.846116 (0.030054) with: {'learning_rate': 0.18, 'max_depth': 9, 'n_estimators': 200}
0.835031 (0.045618) with: {'learning_rate': 0.18, 'max_depth': 11, 'n_estimators': 50}
0.835256 (0.045504) with: {'learning_rate': 0.18, 'max_depth': 11, 'n_estimators': 100}
0.835256 (0.045504) with: {'learning_rate': 0.18, 'max_depth': 11, 'n_estimators': 150}
0.835256 (0.045504) with: {'learning_rate': 0.18, 'max_depth': 11, 'n_estimators': 200}
0.839579 (0.037195) with: {'learning_rate': 0.18, 'max_depth': 13, 'n_estimators': 50}
0.839839 (0.036966) with: {'learning_rate': 0.18, 'max_depth': 13, 'n_estimators': 100}
0.839839 (0.036966) with: {'learning_rate': 0.18, 'max_depth': 13, 'n_estimators': 150}
0.839839 (0.036966) with: {'learning_rate': 0.18, 'max_depth': 13, 'n_estimators': 200}
0.834138 (0.042687) with: {'learning_rate': 0.18, 'max_depth': 15, 'n_estimators': 50}
0.834406 (0.042569) with: {'learning_rate': 0.18, 'max_depth': 15, 'n_estimators': 100}
0.834406 (0.042569) with: {'learning_rate': 0.18, 'max_depth': 15, 'n_estimators': 150}
0.834406 (0.042569) with: {'learning_rate': 0.18, 'max_depth': 15, 'n_estimators': 200}
0.791549 (0.066137) with: {'learning_rate': 0.21, 'max_depth': 1, 'n_estimators': 50}
0.799056 (0.069836) with: {'learning_rate': 0.21, 'max_depth': 1, 'n_estimators': 100}
0.799127 (0.072385) with: {'learning_rate': 0.21, 'max_depth': 1, 'n_estimators': 150}
0.798508 (0.071937) with: {'learning_rate': 0.21, 'max_depth': 1, 'n_estimators': 200}
0.872043 (0.033671) with: {'learning_rate': 0.21, 'max_depth': 3, 'n_estimators': 50}
0.874572 (0.031613) with: {'learning_rate': 0.21, 'max_depth': 3, 'n_estimators': 100}
0.873857 (0.031410) with: {'learning_rate': 0.21, 'max_depth': 3, 'n_estimators': 150}
0.873438 (0.029881) with: {'learning_rate': 0.21, 'max_depth': 3, 'n_estimators': 200}
0.860836 (0.038659) with: {'learning_rate': 0.21, 'max_depth': 5, 'n_estimators': 50}
0.859716 (0.038468) with: {'learning_rate': 0.21, 'max_depth': 5, 'n_estimators': 100}
0.859700 (0.038961) with: {'learning_rate': 0.21, 'max_depth': 5, 'n_estimators': 150}
0.859774 (0.039022) with: {'learning_rate': 0.21, 'max_depth': 5, 'n_estimators': 200}
0.850274 (0.038069) with: {'learning_rate': 0.21, 'max_depth': 7, 'n_estimators': 50}
0.850067 (0.038088) with: {'learning_rate': 0.21, 'max_depth': 7, 'n_estimators': 100}
0.850058 (0.038076) with: {'learning_rate': 0.21, 'max_depth': 7, 'n_estimators': 150}
0.850058 (0.038076) with: {'learning_rate': 0.21, 'max_depth': 7, 'n_estimators': 200}
0.836878 (0.047811) with: {'learning_rate': 0.21, 'max_depth': 9, 'n_estimators': 50}
0.836854 (0.047828) with: {'learning_rate': 0.21, 'max_depth': 9, 'n_estimators': 100}
0.836854 (0.047828) with: {'learning_rate': 0.21, 'max_depth': 9, 'n_estimators': 150}
0.836854 (0.047828) with: {'learning_rate': 0.21, 'max_depth': 9, 'n_estimators': 200}
0.832230 (0.054081) with: {'learning_rate': 0.21, 'max_depth': 11, 'n_estimators': 50}
0.832294 (0.054084) with: {'learning_rate': 0.21, 'max_depth': 11, 'n_estimators': 100}
0.832294 (0.054084) with: {'learning_rate': 0.21, 'max_depth': 11, 'n_estimators': 150}
0.832294 (0.054084) with: {'learning_rate': 0.21, 'max_depth': 11, 'n_estimators': 200}
0.828600 (0.053761) with: {'learning_rate': 0.21, 'max_depth': 13, 'n_estimators': 50}
0.828676 (0.053745) with: {'learning_rate': 0.21, 'max_depth': 13, 'n_estimators': 100}
0.828676 (0.053745) with: {'learning_rate': 0.21, 'max_depth': 13, 'n_estimators': 150}
0.828676 (0.053745) with: {'learning_rate': 0.21, 'max_depth': 13, 'n_estimators': 200}
0.835965 (0.043150) with: {'learning_rate': 0.21, 'max_depth': 15, 'n_estimators': 50}
0.836031 (0.043121) with: {'learning_rate': 0.21, 'max_depth': 15, 'n_estimators': 100}
0.836031 (0.043121) with: {'learning_rate': 0.21, 'max_depth': 15, 'n_estimators': 150}
0.836031 (0.043121) with: {'learning_rate': 0.21, 'max_depth': 15, 'n_estimators': 200}
0.795481 (0.067871) with: {'learning_rate': 0.24, 'max_depth': 1, 'n_estimators': 50}
0.801605 (0.071016) with: {'learning_rate': 0.24, 'max_depth': 1, 'n_estimators': 100}
0.800496 (0.071460) with: {'learning_rate': 0.24, 'max_depth': 1, 'n_estimators': 150}
0.797624 (0.071779) with: {'learning_rate': 0.24, 'max_depth': 1, 'n_estimators': 200}
0.874398 (0.045566) with: {'learning_rate': 0.24, 'max_depth': 3, 'n_estimators': 50}
0.874511 (0.044248) with: {'learning_rate': 0.24, 'max_depth': 3, 'n_estimators': 100}
0.872990 (0.044873) with: {'learning_rate': 0.24, 'max_depth': 3, 'n_estimators': 150}
0.872426 (0.045030) with: {'learning_rate': 0.24, 'max_depth': 3, 'n_estimators': 200}
0.864891 (0.035698) with: {'learning_rate': 0.24, 'max_depth': 5, 'n_estimators': 50}
0.864877 (0.036296) with: {'learning_rate': 0.24, 'max_depth': 5, 'n_estimators': 100}
0.864924 (0.036331) with: {'learning_rate': 0.24, 'max_depth': 5, 'n_estimators': 150}
0.864914 (0.036352) with: {'learning_rate': 0.24, 'max_depth': 5, 'n_estimators': 200}
0.842421 (0.037213) with: {'learning_rate': 0.24, 'max_depth': 7, 'n_estimators': 50}
0.842429 (0.037197) with: {'learning_rate': 0.24, 'max_depth': 7, 'n_estimators': 100}
0.842429 (0.037197) with: {'learning_rate': 0.24, 'max_depth': 7, 'n_estimators': 150}
0.842429 (0.037197) with: {'learning_rate': 0.24, 'max_depth': 7, 'n_estimators': 200}
0.837901 (0.040525) with: {'learning_rate': 0.24, 'max_depth': 9, 'n_estimators': 50}
0.837940 (0.040483) with: {'learning_rate': 0.24, 'max_depth': 9, 'n_estimators': 100}
0.837940 (0.040483) with: {'learning_rate': 0.24, 'max_depth': 9, 'n_estimators': 150}
0.837940 (0.040483) with: {'learning_rate': 0.24, 'max_depth': 9, 'n_estimators': 200}
0.840851 (0.034598) with: {'learning_rate': 0.24, 'max_depth': 11, 'n_estimators': 50}
0.840865 (0.034607) with: {'learning_rate': 0.24, 'max_depth': 11, 'n_estimators': 100}
0.840865 (0.034607) with: {'learning_rate': 0.24, 'max_depth': 11, 'n_estimators': 150}
0.840865 (0.034607) with: {'learning_rate': 0.24, 'max_depth': 11, 'n_estimators': 200}
0.836298 (0.042239) with: {'learning_rate': 0.24, 'max_depth': 13, 'n_estimators': 50}
0.836310 (0.042240) with: {'learning_rate': 0.24, 'max_depth': 13, 'n_estimators': 100}
0.836310 (0.042240) with: {'learning_rate': 0.24, 'max_depth': 13, 'n_estimators': 150}
0.836310 (0.042240) with: {'learning_rate': 0.24, 'max_depth': 13, 'n_estimators': 200}
0.839400 (0.036339) with: {'learning_rate': 0.24, 'max_depth': 15, 'n_estimators': 50}
0.839409 (0.036336) with: {'learning_rate': 0.24, 'max_depth': 15, 'n_estimators': 100}
0.839409 (0.036336) with: {'learning_rate': 0.24, 'max_depth': 15, 'n_estimators': 150}
0.839409 (0.036336) with: {'learning_rate': 0.24, 'max_depth': 15, 'n_estimators': 200}
0.800111 (0.064232) with: {'learning_rate': 0.27, 'max_depth': 1, 'n_estimators': 50}
0.802720 (0.064531) with: {'learning_rate': 0.27, 'max_depth': 1, 'n_estimators': 100}
0.801777 (0.063193) with: {'learning_rate': 0.27, 'max_depth': 1, 'n_estimators': 150}
0.800700 (0.063971) with: {'learning_rate': 0.27, 'max_depth': 1, 'n_estimators': 200}
0.861053 (0.043753) with: {'learning_rate': 0.27, 'max_depth': 3, 'n_estimators': 50}
0.864884 (0.043096) with: {'learning_rate': 0.27, 'max_depth': 3, 'n_estimators': 100}
0.864313 (0.043066) with: {'learning_rate': 0.27, 'max_depth': 3, 'n_estimators': 150}
0.864089 (0.043224) with: {'learning_rate': 0.27, 'max_depth': 3, 'n_estimators': 200}
0.858039 (0.040074) with: {'learning_rate': 0.27, 'max_depth': 5, 'n_estimators': 50}
0.857603 (0.039677) with: {'learning_rate': 0.27, 'max_depth': 5, 'n_estimators': 100}
0.857465 (0.039709) with: {'learning_rate': 0.27, 'max_depth': 5, 'n_estimators': 150}
0.857458 (0.039712) with: {'learning_rate': 0.27, 'max_depth': 5, 'n_estimators': 200}
0.850983 (0.028739) with: {'learning_rate': 0.27, 'max_depth': 7, 'n_estimators': 50}
0.850913 (0.029035) with: {'learning_rate': 0.27, 'max_depth': 7, 'n_estimators': 100}
0.850913 (0.029035) with: {'learning_rate': 0.27, 'max_depth': 7, 'n_estimators': 150}
0.850913 (0.029035) with: {'learning_rate': 0.27, 'max_depth': 7, 'n_estimators': 200}
0.838340 (0.046207) with: {'learning_rate': 0.27, 'max_depth': 9, 'n_estimators': 50}
0.838347 (0.046212) with: {'learning_rate': 0.27, 'max_depth': 9, 'n_estimators': 100}
0.838347 (0.046212) with: {'learning_rate': 0.27, 'max_depth': 9, 'n_estimators': 150}
0.838347 (0.046212) with: {'learning_rate': 0.27, 'max_depth': 9, 'n_estimators': 200}
0.839129 (0.042315) with: {'learning_rate': 0.27, 'max_depth': 11, 'n_estimators': 50}
0.839128 (0.042315) with: {'learning_rate': 0.27, 'max_depth': 11, 'n_estimators': 100}
0.839128 (0.042315) with: {'learning_rate': 0.27, 'max_depth': 11, 'n_estimators': 150}
0.839128 (0.042315) with: {'learning_rate': 0.27, 'max_depth': 11, 'n_estimators': 200}
0.831859 (0.047889) with: {'learning_rate': 0.27, 'max_depth': 13, 'n_estimators': 50}
0.831858 (0.047888) with: {'learning_rate': 0.27, 'max_depth': 13, 'n_estimators': 100}
0.831858 (0.047888) with: {'learning_rate': 0.27, 'max_depth': 13, 'n_estimators': 150}
0.831858 (0.047888) with: {'learning_rate': 0.27, 'max_depth': 13, 'n_estimators': 200}
0.835551 (0.037876) with: {'learning_rate': 0.27, 'max_depth': 15, 'n_estimators': 50}
0.835550 (0.037876) with: {'learning_rate': 0.27, 'max_depth': 15, 'n_estimators': 100}
0.835550 (0.037876) with: {'learning_rate': 0.27, 'max_depth': 15, 'n_estimators': 150}
0.835550 (0.037876) with: {'learning_rate': 0.27, 'max_depth': 15, 'n_estimators': 200}
0.796646 (0.068806) with: {'learning_rate': 0.3, 'max_depth': 1, 'n_estimators': 50}
0.798677 (0.069044) with: {'learning_rate': 0.3, 'max_depth': 1, 'n_estimators': 100}
0.798088 (0.068661) with: {'learning_rate': 0.3, 'max_depth': 1, 'n_estimators': 150}
0.795781 (0.067476) with: {'learning_rate': 0.3, 'max_depth': 1, 'n_estimators': 200}
0.869378 (0.040670) with: {'learning_rate': 0.3, 'max_depth': 3, 'n_estimators': 50}
0.869182 (0.039476) with: {'learning_rate': 0.3, 'max_depth': 3, 'n_estimators': 100}
0.869342 (0.038240) with: {'learning_rate': 0.3, 'max_depth': 3, 'n_estimators': 150}
0.868400 (0.038308) with: {'learning_rate': 0.3, 'max_depth': 3, 'n_estimators': 200}
0.868980 (0.030734) with: {'learning_rate': 0.3, 'max_depth': 5, 'n_estimators': 50}
0.868601 (0.031693) with: {'learning_rate': 0.3, 'max_depth': 5, 'n_estimators': 100}
0.868620 (0.031606) with: {'learning_rate': 0.3, 'max_depth': 5, 'n_estimators': 150}
0.868620 (0.031606) with: {'learning_rate': 0.3, 'max_depth': 5, 'n_estimators': 200}
0.859642 (0.026923) with: {'learning_rate': 0.3, 'max_depth': 7, 'n_estimators': 50}
0.859655 (0.026917) with: {'learning_rate': 0.3, 'max_depth': 7, 'n_estimators': 100}
0.859655 (0.026917) with: {'learning_rate': 0.3, 'max_depth': 7, 'n_estimators': 150}
0.859655 (0.026917) with: {'learning_rate': 0.3, 'max_depth': 7, 'n_estimators': 200}
0.843922 (0.039863) with: {'learning_rate': 0.3, 'max_depth': 9, 'n_estimators': 50}
0.843921 (0.039864) with: {'learning_rate': 0.3, 'max_depth': 9, 'n_estimators': 100}
0.843921 (0.039864) with: {'learning_rate': 0.3, 'max_depth': 9, 'n_estimators': 150}
0.843921 (0.039864) with: {'learning_rate': 0.3, 'max_depth': 9, 'n_estimators': 200}
0.836648 (0.043075) with: {'learning_rate': 0.3, 'max_depth': 11, 'n_estimators': 50}
0.836648 (0.043075) with: {'learning_rate': 0.3, 'max_depth': 11, 'n_estimators': 100}
0.836648 (0.043075) with: {'learning_rate': 0.3, 'max_depth': 11, 'n_estimators': 150}
0.836648 (0.043075) with: {'learning_rate': 0.3, 'max_depth': 11, 'n_estimators': 200}
0.833262 (0.043352) with: {'learning_rate': 0.3, 'max_depth': 13, 'n_estimators': 50}
0.833262 (0.043352) with: {'learning_rate': 0.3, 'max_depth': 13, 'n_estimators': 100}
0.833262 (0.043352) with: {'learning_rate': 0.3, 'max_depth': 13, 'n_estimators': 150}
0.833262 (0.043352) with: {'learning_rate': 0.3, 'max_depth': 13, 'n_estimators': 200}
0.828890 (0.049491) with: {'learning_rate': 0.3, 'max_depth': 15, 'n_estimators': 50}
0.828890 (0.049491) with: {'learning_rate': 0.3, 'max_depth': 15, 'n_estimators': 100}
0.828890 (0.049491) with: {'learning_rate': 0.3, 'max_depth': 15, 'n_estimators': 150}
0.828890 (0.049491) with: {'learning_rate': 0.3, 'max_depth': 15, 'n_estimators': 200}