[关闭]
@lumincinta 2017-02-07T12:31:13.000000Z 字数 5523 阅读 314

R Package 'smbinning' V0.3: Optimal Binning for Scoring Modeling

R.Package

Reference

Scoring Modeling - Data, Analysis, and Scoring Modeling

Description

The package smbinning categorizes a numeric variable into bins or bands mapped to a binary target variable for its ulterior usage in scoring modeling. Its purpose is to automate the time consuming process of selecting the right cut points, quickly calculate metrics such as Weight of Evidence and Information Value (IV); and also document SQL codes, tables, and plots used throughout the development stage.

In its new Version 0.3, the package allows the user in one step (smbinning.eda) to see missing values and outliers for each characteristic in the dataset, along with basic statistics to better understand their distribution, and also in one step obtain the Information Value for each characteristic (smbinning.sumiv).

The desired outputs are basically the tables showed in the examples below, whose theory can be found in the following books:

More details on:

What's New on Version 0.3?

  1. # ----------------------------------------------------
  2. # Package : Optimal Binning for Scoring Modeling V0.3
  3. # Author  : Herman Jopia
  4. # Website : http://www.scoringmodeling.com
  5. # Twitter : @hjopia
  6. # ----------------------------------------------------
  8. # Load package and its data
  9. library(smbinning) 
  10. data(chileancredit)
  11. str(chileancredit) # Quick description of the data
  12. table(chileancredit$FlagGB) # Tabulate target variable
  13. table(chileancredit$FlagSample) # 2 random samples (1:75%, 0:25%) 
  15. # Training and testing samples
  16. chileancredit.train=subset(chileancredit,FlagSample==1)
  17. chileancredit.test=subset(chileancredit,FlagSample==0)
  19. # Optimal Binning ----------------------------------------------------------
  20. result=
  21.   smbinning(df=chileancredit.train,y="FlagGB",x="TOB",p=0.05) # Run and save
  22. result$ivtable # Tabulation and Information Value
  23. result$iv # Information value
  24. result$bands # Bins or bands
  25. result$ctree # Decision tree from partykit
  27. # Relevant plots (2x2 Page)
  28. par(mfrow=c(2,2))
  29. boxplot(chileancredit.train$TOB~chileancredit.train$FlagGB,
  30.         horizontal=T, frame=F, col="lightgray",main="Distribution")
  31. mtext("Time on Books (Months)",3)
  32. smbinning.plot(result,option="dist",sub="Time on Books (Months)")
  33. smbinning.plot(result,option="badrate",sub="Time on Books (Months)")
  34. smbinning.plot(result,option="WoE",sub="Time on Books (Months)")
  36. # SQL Code after binning a numeric variable ---------------------------------
  37. smbinning.sql(result)
  39. # Generate variable after binning -------------------------------------------
  40. chileancredit=smbinning.gen(chileancredit, result, chrname = "gTOB")
  42. # Customized Binning --------------------------------------------------------
  43. # Remove exclusions from chileancredit dataset
  44. TOB.train=
  45.   subset(chileancredit,(FlagSample==1 & (FlagGB==1 | FlagGB==0)), select=TOB)
  46. # Percentiles of 20%
  47. TOB.Pct20=quantile(TOB.train, probs=seq(0,1,0.2), na.rm=T)
  48. TOB.Pct20.Breaks=as.vector(quantile(TOB.train, probs=seq(0,1,0.2), na.rm=T))
  49. Cuts.TOB.Pct20=TOB.Pct20.Breaks[2:(length(TOB.Pct20.Breaks)-1)]
  50. # Package application and results
  51. result=
  52.   smbinning.custom(df=chileancredit.train,
  53.                    y="FlagGB",x="TOB",cuts=Cuts.TOB.Pct20) # Run and save
  54. result$ivtable # Tabulation and Information Value
  56. # Factor Variable Application -----------------------------------------------
  57. result=
  58.   smbinning.factor(df=chileancredit.train,y="FlagGB",x="IncomeLevel")
  59. result$ivtable
  61. # SQL Code after binning a factor variable ----------------------------------
  62. smbinning.sql(result)
  64. # Generate variable after binning factor ------------------------------------
  65. chileancredit=smbinning.factor.gen(chileancredit, result, chrname = "gInc")
  67. # Exploratory Data Analysis -------------------------------------------------
  68. smbinning.eda(df=chileancredit.train)$eda # Table with basic statistics
  69. smbinning.eda(df=chileancredit.train)$edapct # Table with basic percentages
  71. # Information Value for all variables in one step ---------------------------
  72. smbinning.sumiv(df=chileancredit.train,y="FlagGB") # IV for eache variable
  74. # Plot IV for all variables -------------------------------------------------
  75. sumivt=smbinning.sumiv(chileancredit.train,y="FlagGB")
  76. sumivt # Display table with IV by characteristic
  77. par(mfrow=c(1,1))
  78. smbinning.sumiv.plot(sumivt,cex=1) # Plot IV summary table

Table 1

Table 1. Time on Books and Credit Performance via Optimal Binning. Plots from this output are shown in Figure 1 (Below).

Table 2
Table 2. Time on Books and Credit Performance utilizing customized cutpoints.

Table 3
Table 3. Income Levels and Credit Performance. The package allows users to take advantage of its functionalities to analyze factor variables.

Figure 1

Figure 1. Time on Books and Credit Performance plots after Optimal Binning (Table 1).

Table 4

Table 4. Basic statistics to better understand each variable.

Table 5

Table 5. Basic percentages that gives a different perspective of the numbers.

Table 6

Table 6. IV for each characteristic of the dataset.

Figure 2

Figure 2. Plot the IV for each characteristic of the dataset.

Package History

添加新批注
在作者公开此批注前，只有你和作者可见。
回复批注