evalml.automl.AutoMLSearch.score_pipelines

AutoMLSearch.score_pipelines(pipelines, X_holdout, y_holdout, objectives)[source]

Score a list of pipelines on the given holdout data.

Parameters
  • pipelines (list(PipelineBase)) – List of pipelines to train.

  • X_holdout (ww.DataTable, pd.DataFrame) – Holdout features.

  • y_holdout (ww.DataTable, pd.DataFrame) – Holdout targets for scoring.

  • objectives (list(str), list(ObjectiveBase)) – Objectives used for scoring.

Returns

Dictionary keyed by pipeline name that maps to a dictionary of scores. Note that the any pipelines that error out during scoring will not be included in the dictionary but the exception and stacktrace will be displayed in the log.

Return type

Dict[str, Dict[str, float]]