Comments (2)
There is no theoretic definition of "feature importance", so there is no "best" way. But maybe some methods might produce more informative results than others in your situation.
If you would know the groups, then you could:
- Use the permutation importance function in Christoph's "iml" package. There, you can pass a list of feature groups that should be permuted together. This is a feature that would be nice to have in "flashlight".
- Calculate SHAP importance of feature groups (row-wise summing up the SHAP values of each feature group, then take the mean absolute value per column). This has the disadvantages being an in-sample measure of importance, while 1. would produce an out-of-sample result if done on an independent data set.
If you do not know the groups, as an alternative to Christoph's approach, I think you could use a variable clustering algorithm to build the groups and then use any of above methods.
from flashlight.
Thanks @mayer79
I think I now know how to argue this problem. Appears there is no clean solution to this problem and requires a secondary analysis.
Thanks a lot for enlightening me.
from flashlight.
Related Issues (20)
- add approximate shap HOT 1
- add shap analyses HOT 1
- Add Murphy Diagram HOT 1
- Improve calibration of ALE curves
- Check if R 3.4 would suffice as requirement HOT 1
- tidyr >=1.0.0 required HOT 1
- use better defaults for light_interaction HOT 1
- H2O Models support HOT 4
- SHAP values for individual vs aggregate profiles HOT 3
- ALE yields error with pd_indice option HOT 1
- Not compatible with mlr pakage HOT 1
- Werid behaviour of ale and pdp plots HOT 2
- pairwise interaction in light_interaction by groups. HOT 2
- Ranger Classification HOT 1
- Ideas for new release
- trim_sd argument?
- [question] any way of using flashlight with tidymodels HOT 2
- Add tidymodels vignette
- binary classification error all(predicted == 0 | predicted == 1) is not TRUE HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from flashlight.