qbiocode.learning.compute_xgb module#

Summary#

Functions:

compute_xgb

This function generates a model using an Extreme Gradient Boositing (xgb) Classifier method as implemented in xgboost.

compute_xgb_opt

This function generates a model using an Extreme Gradient Boositing (xgb) Classifier method as implemented in xgboost.

Reference#

compute_xgb(X_train, X_test, y_train, y_test, args, verbose=False, model='xgb', data_key='', n_estimators=100, *, criterion='gini', max_depth=None, subsample=0.5, learning_rate=0.5, colsample_bytree=1, min_child_weight=1, random_state=None)[source]#

This function generates a model using an Extreme Gradient Boositing (xgb) Classifier method as implemented in xgboost. It takes in parameter arguments specified in the config.yaml file, but will use the default parameters specified above if none are passed. The model is trained on the training dataset and validated on the test dataset. The function returns the evaluation of the model on the test dataset, including accuracy, AUC, F1 score, and the time taken to train and validate the model. This function is designed to be used in a supervised learning context, where the goal is to classify data points.

Parameters:

  • X_train (array-like) – Training data features.

  • X_test (array-like) – Test data features.

  • y_train (array-like) – Training data labels.

  • y_test (array-like) – Test data labels.

  • args (dict) – Additional arguments, typically from a configuration file.

  • verbose (bool) – If True, prints additional information during execution.

  • model (str) – Name of the model being used, default is ‘XGBoost’.

  • data_key (str) – Key for identifying the dataset, default is an empty string.

  • n_estimators (int) – Number of trees in the forest, default is 100.

  • max_depth (int or None) – Maximum depth of the tree, default is None.

  • subsample (float) – Subsample ratio of the training instances. Default 0.5

  • learning_rate (float) – Step size shrinkage used in update to prevent overfitting. Default is 0.5

  • colsample_bytree (float) – subsample ratio of columns when constructing each tree. Default is 1

  • min_child_weight (int) – Minimum sum of instance weight (hessian) needed in a child. Default is 1

  • random_state (int or None) – Seed for the estimator’s own randomness. QProfiler fills this in from the run’s seed so two runs at one seed agree; None leaves the estimator drawing from the global RNG.

Raises:

ImportError – If XGBoost is not properly installed or configured.

compute_xgb_opt(X_train, X_test, y_train, y_test, args, verbose=False, cv=5, model='xgb', bootstrap=None, max_depth=None, max_features=None, learning_rate=None, subsample=None, colsample_bytree=None, n_estimators=None, min_child_weight=None, random_state=None)[source]#

This function generates a model using an Extreme Gradient Boositing (xgb) Classifier method as implemented in xgboost. The difference here is that this function runs a grid search. The range of the grid search for each parameter is specified in the config.yaml file. The combination of parameters that led to the best performance is saved and returned as best_params, which can then be used on similar datasets, without having to run the grid search. The model is trained on the training dataset and validated on the test dataset. The function returns the evaluation of the model on the test dataset, including accuracy, AUC, F1 score, and the time taken to train and validate the model across the grid search. This function is designed to be used in a supervised learning context, where the goal is to classify data points.

Parameters:

  • X_train (array-like) – Training data features.

  • X_test (array-like) – Test data features.

  • y_train (array-like) – Training data labels.

  • y_test (array-like) – Test data labels.

  • args (dict) – Additional arguments, typically from a configuration file.

  • verbose (bool) – If True, prints additional information during execution.

  • cv (int) – Number of cross-validation folds, default is 5.

  • model (str) – Name of the model being used, default is ‘Random Forest’.

  • bootstrap (list) – List of bootstrap options for grid search.

  • max_depth (list) – List of maximum depth options for grid search.

  • subsample (list) – List of subsample ratio of the training instances options for grid search.

  • learning_rate (list) – List of step size shrinkage used in update to prevent overfitting options for grid search.

  • colsample_bytree (list) – List of subsample ratio of columns when constructing each tree options for grid search.

  • n_estimators (list) – List of number of estimators options for grid search.

  • min_child_weight (list) – List of minimum sum of instance weight (hessian) needed in a childoptions for grid search.

  • random_state (int or None) – Seed for the estimator’s own randomness. QProfiler fills this in from the run’s seed so two runs at one seed agree; None leaves the estimator drawing from the global RNG.

Returns:

A dictionary containing the evaluation metrics of the model, including accuracy, AUC, F1 score, and the time taken for training and validation.

Return type:

modeleval (dict)

Raises:

ImportError – If XGBoost is not properly installed or configured.