{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Permutation Importance Documentation\n", "\n", "`scikit-explain` includes [single-pass](https://christophm.github.io/interpretable-ml-book/feature-importance.html), [multi-pass](https://journals.ametsoc.org/view/journals/bams/100/11/bams-d-18-0195.1.xml), [second-order](https://www.mdpi.com/2076-3417/9/23/5191), and [grouped](https://arxiv.org/abs/2104.11688) permutation importance , respectively. In this notebook, we highlight how to compute these methods and plot their results. In the first set of examples, two tree-based models (random forest and gradient-boosting) and logistic regression from scikit-learn were trained on a portion of the road surface temperature data from [Handler et al. (2020)](https://journals.ametsoc.org/view/journals/wefo/35/5/wafD190159.xml). The goal is to predict whether road surface temperatures will be above or below freezing (32 F) in the next hour. This dataset has 100 K examples with a class skew of 39%.\n", "\n", "A regression-based example is also shown using the Californina housing dataset available in scikit-learn. " ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [], "source": [ "import sys, os \n", "sys.path.insert(0, os.path.dirname(os.getcwd()))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "