From cfcd3abd2ab9e5d988160844c964bbccc89168f0 Mon Sep 17 00:00:00 2001 From: bcjaeger Date: Wed, 22 Nov 2023 04:42:10 +0000 Subject: [PATCH] =?UTF-8?q?Deploying=20to=20gh-pages=20from=20@=20ropensci?= =?UTF-8?q?/aorsf@9429f776c8e83943ad5c0c65039cb159981d6234=20=F0=9F=9A=80?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- articles/aorsf.html | 38 +++++++++--------- articles/fast.html | 10 ++--- articles/oobag.html | 6 +-- .../figure-html/unnamed-chunk-2-1.png | Bin 28859 -> 28858 bytes pkgdown.yml | 2 +- reference/as.data.table.orsf_summary_uni.html | 22 +++++----- reference/orsf_summarize_uni.html | 32 +++++++-------- reference/orsf_time_to_train.html | 6 +-- reference/orsf_vs.html | 10 ++--- reference/print.ObliqueForest.html | 4 +- reference/print.orsf_summary_uni.html | 18 ++++----- search.json | 2 +- 12 files changed, 75 insertions(+), 75 deletions(-) diff --git a/articles/aorsf.html b/articles/aorsf.html index 3ae47d43..017fcb65 100644 --- a/articles/aorsf.html +++ b/articles/aorsf.html @@ -134,10 +134,10 @@

Oblique RFs for #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 -#> Average leaves per tree: 21 +#> Average leaves per tree: 21.4 #> Min observations in leaf: 5 #> Min events in leaf: 1 -#> OOB stat value: 0.76 +#> OOB stat value: 0.77 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> @@ -160,9 +160,9 @@

Oblique RFs for #> N trees: 5 #> N predictors total: 7 #> N predictors per node: 3 -#> Average leaves per tree: 5.8 +#> Average leaves per tree: 4.4 #> Min observations in leaf: 5 -#> OOB stat value: 0.99 +#> OOB stat value: 1.00 #> OOB stat type: AUC-ROC #> Variable importance: anova #> @@ -184,9 +184,9 @@

Oblique RFs for #> N trees: 5 #> N predictors total: 7 #> N predictors per node: 3 -#> Average leaves per tree: 50.8 +#> Average leaves per tree: 49.8 #> Min observations in leaf: 5 -#> OOB stat value: 0.78 +#> OOB stat value: 0.67 #> OOB stat type: RSQ #> Variable importance: anova #> @@ -224,12 +224,12 @@

Variable importance
 
 orsf_vi_negate(pbc_fit)
-#>       copper         bili          ast        stage      albumin      protime 
-#>  0.116520792  0.048724909  0.035613213  0.024345471  0.021060515  0.020984542 
-#>          sex      spiders          age        edema      ascites         chol 
-#>  0.020266760  0.017507511  0.014007382  0.010108835  0.006596406  0.005373518 
-#>         trig       hepato     platelet     alk.phos          trt 
-#>  0.002588621  0.001477129 -0.002477502 -0.003196011 -0.015360657
+#> bili copper ast chol hepato albumin +#> 0.153044558 0.048633020 0.019486232 0.019382451 0.017980303 0.016826295 +#> spiders ascites edema age protime platelet +#> 0.015089265 0.014709375 0.008961668 0.007569484 0.007190698 0.004158973 +#> stage trig alk.phos sex trt +#> -0.000138520 -0.001763304 -0.001830513 -0.002521630 -0.004025097

  • You can also compute variable importance using @@ -239,10 +239,10 @@

    Variable importance
     
 orsf_vi_permute(penguin_fit)
-#>    bill_length_mm       body_mass_g     bill_depth_mm flipper_length_mm 
-#>       0.266091492       0.096949736       0.070062245       0.039317030 
+#>    bill_length_mm flipper_length_mm     bill_depth_mm       body_mass_g 
+#>       0.270966910       0.101162687       0.060985675       0.054666181 
 #>            island               sex              year 
-#>       0.026172875       0.013229418      -0.001438192
    +#> 0.021916929 0.015026701 -0.002657129

  • A faster alternative to permutation and negation importance is @@ -251,10 +251,10 @@

    Variable importance
     
 orsf_vi_anova(bill_fit)
-#>           species               sex            island       body_mass_g 
-#>        0.36990596        0.20408163        0.17790702        0.10084034 
-#> flipper_length_mm     bill_depth_mm              year 
-#>        0.08943089        0.04687500        0.02654867
    +#> species sex flipper_length_mm island +#> 0.43631719 0.12500000 0.08527132 0.08147441 +#> body_mass_g bill_depth_mm year +#> 0.06034483 0.05000000 0.00000000

    • diff --git a/articles/fast.html b/articles/fast.html index 39233fe9..7cb8af35 100644 --- a/articles/fast.html +++ b/articles/fast.html @@ -126,8 +126,8 @@

    Don’t specify a control# control_fast() is much faster time_net['elapsed'] / time_fast['elapsed'] -#> elapsed -#> 49.28571 +#> elapsed +#> 50.8

    Use n_thread @@ -155,10 +155,10 @@

    Use n_thread#> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 -#> Average leaves per tree: 19.8 +#> Average leaves per tree: 21.2 #> Min observations in leaf: 5 #> Min events in leaf: 1 -#> OOB stat value: 0.77 +#> OOB stat value: 0.78 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> @@ -206,7 +206,7 @@

    Do less#> N trees: 5 #> N predictors total: 18 #> N predictors per node: 5 -#> Average leaves per tree: 6.2 +#> Average leaves per tree: 5.8 #> Min observations in leaf: 5 #> Min events in leaf: 10 #> OOB stat value: none diff --git a/articles/oobag.html b/articles/oobag.html index 2bc7ca96..ec32cf73 100644 --- a/articles/oobag.html +++ b/articles/oobag.html @@ -139,10 +139,10 @@

    Out-of-bag predictions and error # what is the output from this function? fit$eval_oobag$stat_values -#> [,1] -#> [1,] 0.77541

    +#> [,1] +#> [1,] 0.7436977

    The out-of-bag estimate of 1 (the default method to evaluate -out-of-bag predictions) is 0.77541.

    +out-of-bag predictions) is 0.7436977.

    Monitoring out-of-bag error diff --git a/articles/oobag_files/figure-html/unnamed-chunk-2-1.png b/articles/oobag_files/figure-html/unnamed-chunk-2-1.png index fbc2ea3362e2489a7afad48e3b5f12ade9a8ddc5..65dc18825cbdcf288cfd2911a14915db2329a953 100644 GIT binary patch literal 28858 zcmeFYcU05a*DoBqjBOl8Q4pBX0D~e3Ql#TxAqYfjXaN-Iy#xdd!3LuUXcFm75fB0i z(g`IfBTPU#Awqzt1OlN%LQe>}-^5>;_j#Y^{o`GCt$XjfPu61MobNvSd-gtie|9-1 zk8hY?JMe?V4tF z`%n-_Dqi@vEqQX$9R&IX1i5_4`cBr|Sj6Tz8>I4PkHXK}4xjz;7rP&yd&nRA^Vq&m z(r%|zV7X~_A%tCyArB_s?mXRgP1fgU^|i0+&2zF(j;bHC{(12Dm7UiWEq0#WyFEUn zJ95j8x0cnFtXE0_2E4}OF;42Y zF8b^A?3)TUM0?6_*r9X5^{Q0D}t0`*(j@3Xo$JVH~)Br)UnfKU(DTelW{RL;!~YDG-Dat@~!)b(ozey zwr=6Vm(7H~e7g>VcDbIg$$nGnc>AS8I03xo9QG?H&&c;}bCFcS*12=q0{7rMXe)8} zAG_zD_0J9JdDw*;bzr8iDcyATMT33=DaIQR(!+DXI)z!63HwpKS6+fZu0NpC80A;Q zU;QdbW2}Z2E|S5Tb`_07;B7ZRb_Z=D{0wp!l@R;_{x=Y)^d=j^d4@F)4>x}-C4 z4_-6ltf+L-NtAxXL<@EbbhTcQtTJ2^uzH>I?nz{Xc}V|Hle<37^c4qS*CO{Rig!Zg zjZ4EZ)-q7(s+N%I`G^zzY?tv%EutcNGI1AW@-v&NCWBh?_-(YJShqB)>Q^6aNXtw-@IXX~QE8?3#)+%M= zodThH>k^tS^IA}e?U-CrXfhIbbW}iZ!O{8XO&c^%c37RPiEh*@;Bes|RM$*6e`2Yj zfoTi_%%&q+kj=x zI~zbbFTgHloab2j%xd`Cs{H{u0aW&>q?a}spAJzAboGK<(GSokwbvU0(M^`-L;_?O z)%+qvapQ7_$|mPTXOj|n%ram|3d2}KJ3V7ufS5x^?TXRV0>9c=Dxc;A@2I-fQ!HkR)@h-A>Ocq{p)uo%T7}yxj`zxCZ%pw~jzW zE!H`ml*MV-bT!$imDlXK)svgi7-OFj<$g|vT64_+QvXi%aTjDuiR^uJfZ+G~^1$$@ zt3!iqr1gg?=o-uG%+v7BV0VYjN8OcMnf0T-)3w=vKcB@DGUYbbR3`62 z(b;mp(d*ZI`r9kt2$JqxV=TRkYcsvU1M3sCf)W*eI@j zuvyXz@fuNAcOQ4MO4%W|uC(M8#UDRKRYJiX@|)RT4#daelKL(FBhI5 z(Q}^rLv=QhB`7z4ul%H$Te(si_<-?q1!g4{^e=&yN*%b4XsXI2JoxSh4#}kcb8cbd zS)vjQ#=DvdjZJc-nn^oO@uh5MUMaDgKKu zJw7QkyUNk@>(9h{WAWSb5c2bq=*IlQleqW>(`WRhLgT;@%pWTdXFWG!syk==ONq1D zdYFmiuk^I@Jug-e16Z9+jACe1TdlfNtr;xpeP&pb?yaOoR#qwolrd#eb0 zB+VfER{C0DjLgN~$k(S7tP>Fm@;dEZb(=~G_qrmZ?u~0r{vOf)OGmq<^G&S_nCg8P ztPbT+X0sQhLjxJzF>8Z~LZOX3J`y@q{czf|R?hXj1g-u%h88w!$~L?6~4-YFxJTwM%&Q= z^AnYG7dsvB7II^nDVI{)Q@ms1&k{>`5zr7@Ig;_1rn_VWBFkYh&YHcChI4;I&uosF zacip3lcEmYUs34Fk$O=9Ux2I7L#=YK3nOr=`;T3q-rZj+zy>DuQ+oOZVsQ}Eb;QcR zBexWOa)vig@ghOJ>)ylWx@fc@y2CxjVDdA3a^`5RAhZLA(g} zwp7Y08QEC(>k!*Is1Wh!ka4l=)s4#@q{`4*Y|S@0#00kHUVw_bJ|QP$>u3a&(|$p5 zZ5+EVwNSCOrex_MR)ai+h<}Pw^~1{1M(nR9IFk~FrefA{Sb3Wy1ELyoqxE z$@fd$5H`V*-?7=)8egQ?2{Gynkls&%aO$5P9Pu~Ta?ZNwu5VV4>`27XKT%hDHGoW#=zQIBrBuiKc&>+2lo zuaE3FVra8Os*xk)CZ!2H)93z-W@D+v3mUgZ7K#Jpr%s>X^EC^JU0s+qYym!^x$MDA ztpuaNs)IaGM^(o|I4E~oR5Kh+ANuIB_WFIDKX(jEMTVQ&uW6Fk!_f-{?#?y@V?e{c zLqv6`Ps(scKac0rE>gAsm^Aj0w0yGe#)54t#4_JjZ-uNEtAzd zk)^lNyNdP6#l#7I6&8cG=X+iuPMmpt;Ap4684`*`Z0jwVWJyp3Yfs!)OYEoKs!!r* zg$VimvzW~ak6{bFUTF0F(UqEvp=2LUy+v1uPLcJS{FDaOeA@504o@d}&&r)v0hSp0 zgEj{BwG0KDPhM$w#k#!UzJyGC99A!5j$7zne}1$x3sz}5HftC^q*#mSX1{fCM40yT z^&QuEkv&*<0_)9`%F!iK)2%I7_l=v@_I1mvl5dDM{`MX<>)1QuYF=EX5rJVpmBGclX64^{TjCk&dtF3AijE^(jqpx~7sUuVme*+!_; z$dWUC3fX#YIcHP+9m{I0N^%=7o-RP>)%cyFSp=Ojjn#49FzD#iamTj34bbKY{resVOV_3n=XzUkS2L98zg44w0 zB>OE&{X)zQsxuc%$DL_@=CoGat+eE@lrkT?r;@0+BL6_V>)Dh*;sQTK0UFbIra-D3 z$fepih2V%%I}bv}vUBF*y97GHE<8oLP1$4xUO+_HQ*K0!y^Bt9>w2UxTiI=|K2TyF zAYW}t^BLiog;-b~-846$Sz#QeK+|p5Bk_DfApfqi* z@oC_mPzQJlt_wEIP~R@?c}@{yN2x-!nxLO6pdovZJ#F~0>o=Va>ZOv6knXk{#BZCX5uQFN36;U~G{1~ryCOWf``$=lbXCYy zOY>LZaP_8=vhvq+$rJa*ZCDb{1k1HCmbre6{bJ-mJ4VLzJk-V>J)Elze=E`%KkWXb z@|$$qh?_OGcBCtkyf0iZ>P1N3+6uPFQlKbn7*vUc?T=q8AnMTaM-G)ncM(`Kr8j{E zX%;7Hdkk-0EI82M?UcjlIyzvx)&ZwX1XBhwmZo1h`LiWEUw3N9Wc<^#BpwrH2{T83*Ed{o%2?GI*GbGs!54naDOVDCc zz1kU&Lxf&quxSheG00l_D72%UhBLp5Lo=PUJ)*`29^2p{A(u;Bd>Tj~w1(HpDh_At}XgV_ z_*-@I^|OU~0pHdLXA7x%UsMP+9TZCQThn9kcG!%_pT{EZhm8B)kDRipRoVj6*tGpL zE53fR((DV1p|61Sn3`Gr&fYd|cI}Z|{NR|A1fsQQp)65{YD#%x_BW6CIOGs@Wkhr)@GR}WSa zx=Cg_;7Hf5WtZw_%s6mQ=enkYEp8S&a~43;*+1AlzJ+6Wj}gZ+`fOE#x*6!_jKxmt zh=6k9DFRWF`==@W+d3ZNtU9Sm!(gn;HLgYamAHtl-(f`$W)4;a;)pu4gp%~tP3v5> zMx}gOtX|Qrtv$EHXdXI6jZx|eB`s#E$R5(tbO>LmvT(IklFG1H;|}Wi6xu|(2?O%_ zP_li%^TJ{`+pzkcnlG=wG7^g$_~MvH?1xqK#_N)ktPr}LTmpUq2UH4FslYAzlOAfp z@>TkaREjB&`V`fKhzFw_FCZ;enz+cCD0d0C%s(pg%%IyH!FYUr`OR6&)dJ$gEqHtc z_4*2qi_mOAhdA*g(e1Y@iX3vEaWm~alh)_Z)&}Vt@h7D2I^{Ab>Kl!fUze1Ywo81Q z#$tFDt)UVhnG;7N??!zLff5v4D3_M%z-v8>r_( zm$8vHWeNCNN>zZ9Ma_#ZQVR1A%NlK~JUbp)jj8VOsG?F7mp=G4>>YX5f2=FgjdKF= z>g_GJt`Gxbt><%JcRQ!fYAO(lpE?vSY_C#)&&BT<{K#WG34t3-?yU8xKXN98*QDak zqt}NIY^ycp6svUlmHp*w>rYWROC0s|EX!=KXQru^Nz2XOb{pqt!0}3JiLaaH)yto+5cO%=Je|`NI?zZ? zeoAIXsdwrZd(}k@{_9<&|AcdZh^uiOD2Hio+jF%N8mC1*^wa|GJSGdV(KFS8O^@h4#+U0_vUO`@& zD%0T^k3I5sk8I>@$p%jvlpVhATmn7svB3|kFY{O&%;1>mWLaZ+kP;s~eOV6_Ae`JI zuY=8Mq%JsX$~D;|s$(#d2V*tf$}FU@^4{Ahv}eyAm>N@URQOhLpH_@t`L_}YG*6|X+Zb_ntt=rC))PF#K_NqXF%HQ zAV6Z>f_u7n6TVen!e9H+TI)d5RjsPK44EgC{+gEGHB{jAv-(^7PD6s;VD%%_PIghJ zzk0$7#N0Q}k8ZMp`vbBeCGhJ|GjOu10je~nX*!kc)}Ltuo7J3wfvS8AbiL!MwwgU0 z#y<2er0W`2t7c`+?pBVAmjk*0A|ZDV=IGoUX6s+cFvAKZtPd0xEl*8X)h1XkXSAD5 zUjn@qyea#$J+ski8hud^K>Uop1SX0<&`wg0%;>8QOT6k!4 z(;gkD=9J`4w{^7KK4c>mYWj5;KQn8Qf+|F zS*YdM#-G2jjXAFrmRy1%=+kH?{V$v1g;jb(w#+kTIGh`LVQsj^wEqvm6-e`F_$6C! zq7!^UveVTHeXU^GTCZ4xwSETJP;vQs-?lwsu+3AG7ZEYOvP68D0--W_pMIB*#R}hn zK)-eZMli+A0>IrPC7vy)SeLPHE^@pUdDFy7cETy0p_Gnqc6cjGeqfbhpK%$8TafK} zy-CTht5!Iz8Ic-A%M#JXtmqgVrwdDk1?aU_&>oz%GS8CES`^=%3a)pY(s^7~IY(o$ zu=`r0UvFvFju0@qx&=&Tr(Bv~NkQt3pTq^aL6Ki=r1^Gbh?W@Xc9L2~KZOgwYQ~Pw zw2UI_BkwmtO=kAG=j?mSeqH5aL;1D$2|->S2v_%C6#S7iqy0?jo3`; z0N2<=vKpl+mwS_Rz21JM)HDXaJPg)^a{6YTP`#afyTN)M?;KVJvDEViCHBV`WUbHV z_J?=l6_P&-G5RMRvk8DFcg&c*`uF{e6ZUXAwYNzJHE>$GRgdao zG#BVqN<-`lpAdt_i{vKD)$I1yRZU?*Cg&NWSm_#pEKTYCRFge#2|KZ-XO-a_Y1|>k z-38Id^#9t=tnhb~vVGo7ol%|n3aY#S5h(_j;E)DG&+PSPZ*d+HgT>hAl{8x4Sjg2(EcL9 zGNW_d+QgODex$Hrn%k_r5)E7FP$TLCwRvq7;H<$89l=cC=;>-4%0QD`L+_D=H0OqV z?+c>`c&v--X|R7daz9ujcjH-Y|x3g;}w+`DfxSl7)` zGqk_C7$+x-(X8M?qwj+FYxEs z`Sv5K#F(_g4e2x!nT3-(Kx!`+Uh|ByUu*~E(YJ2@=~?8tIgkqiwVdfO4QU^&y-@u% z4-4a5)l2-gROh|F^4reeK)Cs5vqSqbF>}>_{oaQ%pV}7NOf)i~Wi#a>Z<){_4YwT) zm!lNs7n*LJ?@2m3qkASHF!~TE@6bVs#o^%eGON=dkloUjEX6;{Tsx~bviPNe?zSIV ze0n}s&pr%nYmE#uRQ?76jmS z1)HLr^;@Oz1p`;I7q9kMEj{L zP6oN78*Br$xvmqh_6f&(Ln9z)$+79H2}*m6lp5wLoFXS*=*Vg5l2gUu(j%t{khw_6#W#g)BfIf8e}Y_#Jf}^t14L`W$ei41DrxcNz-c z9y|Wi|IP#&N<`3YI650MhrVru?t&;mD-_5>yHZ37s)^p7H|Chi=mw5ZIe&rUsUM@m z(QCrH4FvFTf7Faf&TBgj8&-P31ZV~O;gXETapyGP0zJteq5eQe`gVJ14#`G_ zqOGi?HXGH*%DYk506&XHH(scb6jGR8{-sP(*^E>7QlMT^AuZT0Mk7~KI@>YBAl@t3-aQvLP9os1g!POXIp319GOTr4(xq7ovV#Tnt6Tr;jU=4>hq45JyJz(wk|szQ=! z6+%k{GanL=!FcG@;JFTQ%4WDjR!uqMah)QQZkiP94S-`AyA&?M77jGY&nceVqP`qs=Rg z%WWA|yQV!56^YI*!lInlj6)j0OwDJh&I?u&wv3gvlWx<(ZkC#mJ(AiMePFYfUlyxT3)sxNzKcC$OLBx@scYeZ8rp>#P1IAz|pA{aYj?Iux^co=gM6YQI+h2jB=g5wdDr z0W)b?>Vq7#dog8%aT*VQCzRJUS{^i#*drGi)ZsgOR!VH_6nUx0)bl#p4U;uwM;5Li zuN^qm%LejCZ}bt%sJPrV3dA|(b`O~CUng?YXP)SI}#vpCQLU z!p$Syw>H7_>mkl)<^5acl4?S8k5z|)!c_3)A>FP*<{*c!NAC!~{}UjW%%kNt$k}Ti z7xbUnw_QloX$}hGg+`&Jc2CT*Jaz&jvDMvYfpi4GfIzWW5lxe9rQ#1@|wGpi| zVh%ztZ+Qry%-V$CY}H;N`Si0QF%kHTb9Q>wc3-b>?^Zh)@ah-gv+`qm0XS&{#~)~8 zr!k&r4K$o_E*7de_VJxv&B$CS33{N#BOzsMwJ`ulo(B`@;WrCJ1L~rILy7drzYiEl zNErD1Yl^(_d;^%Azk7nJ_H4ZSz-!?;K)wJ}X^s!LIyg%F1M9l}OTmDQ3i$LoZqE~b z|0k0FH-S(w%PId0^-vw$x9gW#^jy~MRInu4&pad&Z3d}PDi^s-`PdQA{5TN|+-VC# zUz5{n^cb(iG#ZfG(RXFZDMQ!4`!oPFW$|*6NHkJDOHlsq+k3D$SWAh_`$`t2K52hw z7&g3BB4=WK0M}F7y~pl&quUSgQ8$6xl3Hry00r93 zHE{I7ExgR#7-O{OYXA?wT0orpq8ho(>qz000*!=&u5LU%Jn34LYJXhL2-GS~#l9{7Z2{0WvnfL#4k>mT6_0GNNl zukCA59Dn)?FlH3rrkr)5%;oQ6xVSdWkLg3-R!7u49fTtE0=dz=4$^D$nbrVtzIUC; z{Cg%Kgv;CQCkBRZmT$iKcQUcI>K6^?AB1$9hV){+Po^=Rg0BIvs7-d1RFD#KUH;T| zMcnnkCoE$coO@yu#RD_tHg2M8Wwp*0guYI&+MX$inR|YlfQ@D5V@{Tz>57-DZ=Am` z!jV;TP?cn^8Rs*WIt0`Hop=S!gr;|=fZOG?%HE=dN;FK4+|{fjV-_+1mS>FUwL-tL zz{=MvJke_!PNKAA`W!SieD)Ps*;wqpbQ}Zpa-prib1nwwUo)?yHQ04 zGK4B_$&d#TkHh4(JkR?b(g15IcIm3zt=!!&6eRZX-dNSgnz9?6aRa(_UzUYqpS5=y zrvE9AKAGb$b+OAW7h7bA8aEVa^Tu^hSp9rfMWWL63dFt1J5*s1g5*4BP!AM{Z0^PK zc6ym4aFmGll+)56n_c}_`78Mda1V=o6ryAnVuntZ*DA@pCE9s|JKL*tdQ3PShjR_| z$iBNLbmTVfqEFj)RqB&>>}hqx=qiy@Y)wQ#Q|~K~jF%Pim}3JDC(+!}&{RL?A>pN6TJdK@F|F>(pze2GJCO zOEJXv&W4V4w}=V&FlhdLv(W@eQUy6sB2Xp(566)nN{59zPbIRSQ_waI(Xqh*hDg(d}(>$eW#3_;9|LpFLn4?#n&qFum| zQD{j`tf(Syxt#Gs?AAr{KJ@4>WIp=tVeY zrOHKKNAIxQ{<1Y3%BcXt*v9X`1?bY*3Q-YdND7kzjr~f?S>H5JUjlBgGtpVujALb~ zqQZ8%0Jx4?YZ^&hics*6kyclmPk=~2yIlm12Wz=|jr-dR}y zxoXjyo+i8;or8t&9L5L8s#(ZwG*qts47nDgt54p7G;5_rw7NPAml#{DCIy10GQNQY zS)3}Sj#bWAr{JsTJ+k$e(BiUMq*K`f6HfU{flObJmdG;IUEPdk=AHwzOIA6olQjzD zv*< z1!#1$3N_|_sI4qLJIFoZ(R~r#OkX0QBYG? z@4CB{V#J5u^>+teh-~&3Na(g+y|}ho)3>8TFBc`%{>B8QqSid{bLaedwHSzzyJ+#o z{Z63e>qZl`Ik)N^_a~z2Uw$_!u(uM3OMbaXO21X_c_hI&tFBgFb>v7+GA(H_y z5|Hx${xB0Pzn?F74wjdzU;HC75X-m%+47&Rgvr&H|C0=&p^-Ku1_8n?Q2e(aira_2 zd%7TEohCc%NeOYe&dJ){DO%jK*Y)y-7zPWxW*X8_(z9mH$-`2=!uA-@vl!A3z6&5h zxeZc-;7vH|;63t@X6VkVA47*-NBl9H?&!0UN}_!+M0>d0lL-$%7afX&W9IbNH_=ZI zJ`n+?8omrPUEXf_?ckk!1GPjx8NOC6%F9wXSYMqoftn8VXzmzI(FU}0HGbB z^Pic@=teLZhH;X(*LZUlJ*q|S6ZO_JB74k*zcIKDIJTpM^7m}X7?@PFKQT9*@dgZ2 z$A;(Xs*z`{My_W6dGo=SM-V0B5GVB76~hz4wE;M#{O!<52|?%H7<|pYvr`3Vx3hx^ zk_`ra_0g?XE6Pvvs2M-Jo;Oh28jI_n!vG*L+A9#3iws8_VdhdQq{5*U%+GA@J7zpM z@@mIG?pf&ZbfeV)N^E3{fg<(`Ut-V++d(cD5 zW>6k%5|~$PG|`|A%+vkesp?+7^z|IX+%%-W*Atpm`8^$pHrr)L z*HDYGHu7Hmpkg$koPMF~$l320ebws>h)V$rJkM{D&~yDah{&M-*uKh`Gusq{jOX4a zfPo(vmG2%H&w;C}HQ(&6imRm-Y7K~XW1RNshBjN`b@l9L0S&z2fld%s>@R!3(!)0* zQ^@~G-#{pOxt!Wj5b`ow>gwH?R))ZhJwBnRGpkKUY0n(|_17OS2OQap{v~zi$%}g~ z?ZGDeu>I9@P zV`H7%PSt{)(9fPNZ@A6pIFHTX@hk@$U+TgdZ^eNSwTkyN=pi($mNc!^4mm&%WqT!M zv#RG08M;^^t@cPCB|1kROO{C%CHbW{JFGryRi)Mn!d9Yf*l!ky?^G6?nwp3`UstOs z*X4^vwru;!`dVy`YTrfNG>dhUk||!xwuf6ItD@{%Ww$GpDFyD;h=3JoI9*@Sr%d2< zq|~NPECiA&yYrhs88Ug%3EX-lVJF2sC(SC)(9Q1;Vx{ zT-<4`_Aksy-(>?5ck~tiz7O?b_4zVMm}beUY59C~x0H;K*zaxe_FnjbYe6~0I({50 z*IG01;u!Bn^GMLSj}qqbq@K&wrB5=|o#dC55>~TvC_(l2CC$p4TvevpYjC1=OA_2_ zR~~(E3$&z1IbCvnXtB;fvYHg}$|1Z0PRYk5tDV&2y^GuROv&Xga{X=r!oT%*)66kE zZQ;ETB`=1X9gW@k_J(g&X29Sw-XH~!ee5+fOSWjYqTfmIlL%YBE7vF|;@7v}B~%!y zw<=Xs_r$(Xw|TbOV!_kfgA6RAj1eTN*;*FoI;S#m@k%v<>Z_!s61LWK^S*{JCW{86 z<-dut>7bp!Qe8BCT##6|tc#bVI=$|Wa0L-*`b9PdIz;{}7K1g%TA)BEsN+aMJ>{HS zsc4#QzxB51)T{G}r3=V>3*N*LN`;^Fc^}l*^GIn;9}=ERW_9!-VK&e*XLTYw3sNG4 z?bxFlHXtrFfA!rpIcHMaMEA*Ry1sCQ-TA9F@iR-=`Ku(jTdB**Y8k}fQK2eYRBn}k zmJ{<=uiBnLeSO2{3N;aZbsio+6H2h)8Tme4S<7E-N+zBHh(Q;xnjVd94jGJzL16mk zTcx%|*{)zMa%~P68mRinED*CNW^r%Mke+GoqU=s{JGauszSpTI5m$tBgPx|H0hLAB@(2?f zE0jkR1C3JG<{lTd(w_wJ^Dc@r=P3K+OWlSysTMpU`q7DR7gT*ni{(v1 z7O_4fpk*9o2TuIyLIdRzvbk&r>@mt><=H{q>S#)16CVeZRx5Oz)j`%$2g@p9H86bI z_t8R03^I&o6F)7Ag-=aS#0~}VJLF-W);(oPI+t_LO5X2jurU}Op*A}0ipE__3ZNH# zSzbYn1=Yt&Y#myF!yS;mh#16dpId-^Qz^fw7j@>EsK3{8*i0&RVX2QLjw2KYIE~e4 zml3@YAx7Ue?w!ksKG8(te(9UX-~_!t{^(+@NBDJg^F`eG8;=lPGlmOK=e{bj`%x8wZzP#63#dGD3JDdg5kZju(Fk z+2-P1cXgT$V9B@@GA6}D$j&uB^9-m77VlhtH-B93-Eo}{NFXN7sB0Q0s+NA1G}Qu=ul@p9IVj zCd|Nw@3q3FeJYt2J_21+qbhu(+CuT;c1Zt~?o#9L6_sDNZ|p)@j7Oh-zP4wZs7DZc zRBi2)u?%407aT-Cd$}dWxGzq z#=sF<)2qH7BDVtBSv1H?Fd>x1+38vwH-mMFvg6vCixq$2aG(-xNuaa7C0Cv`7q1YuqpG%|652)ix9vwj zi7vL$auTyaHQKJC{MPoV)n}0jyif;BAlduk?@O7uT*)!P5DP((FKMF8P+D<&61lpl zK9O2oErAV0S&lVxdlG0U8@(Fh`j1Fd6VZRABJP)E2!(Bp`j>!VMJ@Ce)LV5ed!eJBti1{!>d~+osn5 z{g1UwY=sZT4E{~2bZsA(%6sid#NbxSV;_-b-W2XLY)??|XE@}@CyhkQ{p}UJH++A| zJEJ?U&exh-i-NeJIvm91SnveJ%^p(8z%`YMzImAG-<~~T4J51*1I0p~C%jy>1%0b6P(dSF2bfQ)-SkFAleHDQ&L$jz#4KHK#yQw4d2l1OL1WK>P7d zjCTT4q@22Y#nA5uYIYKih@I2+6t|K+YEDO%+Y)$zs;tm>*262jR;_cQ(kkuK;I`>= z62}ap{?g`-6QYJ+@y95$a(K}~FSeOQ{;*jlk;FI|pPNeP6Kt|V6IS<09D@k+2*5r8 zJHyAFz6gbn#u%+YOEO_p=_wVLvYbjU`b#1Z!G%;Hp=11KVOsRCWM+G>jC3`sgcy*W z%=;dO|Fy+37kx;~Ja$<%k!O>?s`ocb;u9@+to)M`e~Ph0Y}V<*G)m1!hIFre%xiFK z{crC^>G{yV=CR@bj)kHr6u{ynug%8?eh!A7takagH3I;2ZJr6!JTay}dKk!)peI%i zfA=;_#u*UbbcKCv-U=51i_kHpk5MK{){+-^GpvLo6p>PHn2E>Q>f!j*#Z4~jJxd0M zxr*F+b@Ro#fuG}()=v3f0*gSLD?K^D;z;z>k^?{tkktt3ctHg)kKT|VX;-a;gEKGzy8v>Xi z$d4L(#m^1-`8OTf1Kbg&(tRUseAK7WD?*k!?bf&!m>!Wkz@p*y;bibz628kpM-D2(LFM^p47AwvwCY_9jH;hzwW;l1g?-8#1q6Dxky5qdopZs>%nuFi| zaGSM&i-~J}6wT7UwLlzIO;L3Pzq;q6aD^?}rjbABUR(W(b%ioNG%S!#m`|t3QZP6e z^Dj}?!!8w2p_QD3r_FqcvnBs831su9a?X09&a!~%kAvATVaYvxc|uk}mx1@Xq8|_{$uZqe0}C##w#Nb%EbN)=TE}H%9~u9#I0%aRu+Ec~Jko*MwUetA4WUa2|=i zwJX^GmCwqO|C~b})t2=3lfDkpTeOf24awLTuUGoKIqi|(!~f_k0kS~v zIz03LS!ro*l8|{(w6C-37Y0Q_>SS1bW(NBs-rb^!H5Wyh3@BzGroPU0$sZRz9tu<2 zHqA@o1kX7o!P^~#`KYRx678bw(B-qj_2{IX z)=H%r1fr(b(I;ltO^DT~&sm zs6YN8LLf&&5U~kgw&jlqUwIj4xXh;nT5D#!6;)<-knO#ZPIhBuQ6pbhp)eU-b0q%0 zP+6`=#SEFD@D;XX(spEEtI1*@A%>(K+4hgpd9NXJ?JY}Cnqv)j;Tx|Uq8M?OL>^^! zxcprFERJ3l0OQ*r23Q9ui=oFvaZx85ID>MsL|$LnabTaE2w5}BqZhW<-D{$B;smy1 zo>QVc)b-ktSS3P_=EFSUI$A9LrN*7#2mY1CUH^XGU#j?DrFs8NAlm=4|7YuAL@#1n z6;AuDHW06fcwz;SIHKeBz3!S2GpwcKS>u$}l4~$}`Bgfp%-M=>zk+9R&k??Nnf?HU zMe9{WSs)q^tEBc@(H;oM3WG(_QWaH!Lm$))YuoXxH5@g3{o7IkrAXZ6&}0n-R{~=& zMNT+-%9tkIQxdgZ zo|>i0&4;NlrVUAp$bOtzDuO#vEYQ0)zmHUb><%D5Tz z`?lH1Z3o~Hu~N?JN}#QkDwXJu{OHqMc{BKRr{w*vF-kGTzl5juupmO)>*Fg%$QY7VYKspm^6MT!(w16Nq z&o(ssE;t;I><-Pj5Fr+13W$(vP!?dXSIynf2tU{Bi=*55R7qJn zNMuVMqgCQ$0`?khi>0h`S=jo7&*k{PqE!JKI0c0EWOm#a=BFIiAzZw*fis*W1)R55 zUMygVLGQdDMV#l<)HanJiuv}yMl-tsSa+c;5S}zkVgkc>Us>%Xg8KFGS{su6*eh-y zOO7(})BWu&Cea;MIjRw2Po0849OZ2XQa#&`!J*LW^buNIy9ICG?6hEsvQK?pvv)^VfTpMcLE28QjHvxm9n`|WH!PrXtCkX_qWVmxLXoZ2%T%7e1n4seSkIaP zj%{BRNN*djLsoOUSp;0PO;1J@(2OqOw(QX_Cu~e4Bu;YZCGlPGouKjy0DO%%T%C`$ zWsiTJAPGZb&Z-RL2jI>czM0D^=>{?zjbm z|4^B8$j@$f>%WAR3T(y#p1cBq>RyI+YZU>1o(rmWb>H6aTicZf^nuI(#84`0M)fs& z9GP(H19A@1aG0pR2zn|6jwXtXx!RDYr&=`96xjvx1wna)>;_P*J6Nb2S0jDFMi1L}9MP=}a@E_J z2h2YCVyRn)aH0F68(>v;zU*`PNw$<)o1UStqv5UqjMgbnGHK* z3vU1Im7fmdNn2cG7lE+F177F_)Uob}vC&5W^OiKw&z}zKFFuCO`Q}*a-D$JDShWYH zj33vD_!W43UJkS?{2>zP{>5--^d?U9q}5COkM6!aD#`TipH|0Ao2L0@?$f4UC(W$P z6>XW(%+zw<(aaThLUTcEDxE2pNlkMlb16Z=-4qdv)Nz9>aYr;w3`8^q6a?Of=KY@c zpZ7h#^_=&2e$PK}IPl!}eQ`gZ>$*PIa`z-}p?#j9zByDikADhJG;0++8D`sHP}M6ww2C=K)JNv%V_dK9 ziUmI58fh3MEcO%$@?52a2Iv%^9J&AU>&q{q{&T;+cBRhXTfn=EDaACc^hrHzDXs2< z(9#Q1;woBP>ePy8_}lS`KYVF2;ebXnG9bslWDGFkI-^mYeQTqvKuKR60~AU?oAev7{H_b`g6~83BvqTl51V(+1(S!y zb8Y08hCN6Z0}ek#GV{|f&!{V*!Un@U4doFzsuUDc&gdEwx%wAI3% zLB<0nmfDNf8}!^K(>DK!WffHW+kIM-pq;r(o~E%73{Sx=8z1HKg~I?4m;9Im}O?oNwRQyx_cYsazO+0nZ z0QLdb{|%$ye;TO%g=94}U=}t@=VTCjMq45wTgx@hU1UGVJ?>O1@h)U9Yrb)RSUO^_ zQDBJ|_?1cW%4OfQ*Kjz!?Qx3Q!s*BIZYbe}j!}?RY!WG`0MHD(W4}X5q|*IwzGBgb zFdDVu*Mcx^B~y)h4l{+D?Wl8~;!e|?X;lfqT${&RVr=^hK@9v7SB4s=7y4U3vks9H z=_I-W9}32^FOUzg^!efjj39`*j^^tu62oqi*3mKs%Qkg7i<3c_7#ib&@6Uyr(i{luKJVtSZiVZ_cIy{{v~@0QKrdw3j`nf-9;AH+Y1=evwK zOG4!q(=rmAtdcutBIFn-Ay?k02VB8TJEa%i4zYv{$rUxzD71{-&xI|J@rB|ul>q_- zk}~WymOi=jMqc-{aDX4_o4n(n1HM?q;$W&T>^O&#ocy9~E*OY3l0|~Os`Ga2t^+9? zj5sUQp7cevm7QwUZx$*;kt;Ijh4B-W?aBo8-CnIVc5Z{Mn7Q+LR?hjV=Q$Ha#fnvR z*NGgylLlmP4X0vf|Ks1Q>Eu4Ix9}9*AhF1uW5qdWyp!Zb!rB8EY4{lo72g{?h*7rt zLU0!HpB6dsAtUEYC3%O24p_}Up+a1UA6AtBFFC_>HNO2HJC>$#ksy(S5c#HqNP-M} zQM3|?%jWV&?1~jHKnqZK!w}@_#@4y^=Vw|2CWDgW^~HOrYqA&J&0#BgTIapyVf5F? z9M<86Z9t?ECd!eKB<_y~g6z3ZZqi|f#)e@J`Ay9`md+A1c4uC~o308}plZ6YUfk-N zbm2-@ykBGNTNwXMxv}0l9OiJ22=X+cTPBmB#!6)ASy} zf{DN)WJD75?dG-nFEWx5{>MH9$2Q<1C69(t!A8dxqp*=~YcQ16^1lY4mGi2n&TFXx z9bwM(x*{8bE${-oY;S7yU>k86U8>(M+F(Ai&6M>FCnEwokY2=0aiSF)IleGm_fcm+ zcxm!b8s+Ol#DP#if>_MxPhMW?EP@=z@ z$Rhf^e^#t>OWWeZp-EW^O(ts+H=VlWt2>u&>f*I|5D6+2FCLI}4(w^(izN=7V>QaPt5>8{=cK!B#e zMkr3YAwj^pW#(=b|uv_D@JwP z4%XR|6fh#rNIm{Sf)@02tM(e~HVkq_o@EMuPi3jURb5Pm@D@_X3J|KjN>i#Gvn zU=GV+?w|@4MaU*U;tz{aH3f-~Jxk4Oi<)h7))Eo3%bsBr&t9=H)C(JJ0LR4v?3}X1 zSw6De&mEXSG5+qhqOy64dZy#7yCyJ!;<)#2xDfU(a58j+?{B;>H-4~~iI#uq z01k*2ZYy|Y{FwJfRXA8JZ-p4Gvrqc+&z=&wR}~6E>)CH++v<2CO$3=@{}C}V0--#F_>ZitjCK& zD~g>>`^Y%CeLKi)k$o0@Tv+}8#@i4HFL~aXgJ-)9MK%G|DRCtDK7NLfK?P4rj&e6sS&QPi zOY2C!i6p%4AAowX3wwQdrBk1HLv#ba&XcUozGHS$O%)0ymsB?SZ(@xnK_d*Lua%Od zTXJ;@<0O@-k31#6J&{0klNZcxAcwb=e)(IGzv7=aAXJGlYpxx(^{ z<#R!?vmuYHCVg7UkV;`0ZM=fCFy9%()PSKN>;4~X=6jS<=7#&cI8BMdkof;jigw?F z{18<(2hDoV*+cbLPCm+BknXqS74;Cme3I_hov?yL)V-4109GHDw~9|rQbV9-qTZ&-CN z0%SlMQuEQ!!&7)5*<*f5?AY?Ul=e6yBmNg5(vpvA%QG&1FGfnBfk0l3ufq(`6-AXG z;}mH;$nW7aX5x4?`eZEg)MFk%wTHK#y%6dO{0zUSbK6oV7MULhD1+`I6;Mif%Oap6Tg@{Kr;+CIw@YGYBck{Y^8bZNpj_OG2>J+ z&x>NXrOX0q?dTC!)VwpTRgl5_E%oCDE<{qfTOsx_Q%fS@t$-~X(Bxg4t%-&A{Gu;? zZ>9R=AHT}}jD3W;`BPZbn9Qp;K_jo$2(sqKR(ggC!v?WgM<5d-QjpiNp3QxG)Aw24 z|8z=!GfnTot6vWOa`T-LdHlsL0ccgbBgUD{u zNhi(&k%im~Z%=9^ zq84TxL*>E$JULCfJ})ihs0#?o18p=hx5l!#^;w_|^z{S8)ZWLYqxf5wGX&?{uYGOK z9P_a*xOq3pMgu4}uu4+~x^vVD5T*Afz>a}Bu?VDw$4lt|AHX1QrH-s}t&wZeGa|;y zMiT%s4sf{hxZCMF^Lnp`Bt}zt5%M@a7aZi{9FQ2yhMePhXzW;8b+ZGyOL=}#+#9Z5 z8Z&^TVM7iFIufRGy#D;*PVj~r7)k%l`@l2UC`(jvag=EdXUv~?qQ4Hhfx>w3+ z)A|0{X2yN;&L#Zj5v5K#v{8WH7|ER=k=D$PV~C31sNocYyAhT<2Fk0NL{ZchZBPkZ zakCuF8`GL_A&k0$+KX?y+DwI8n?ssK7t<1m{ToWjTF&gqtFkkbI+@(Lqy9LQGl3_} z_3SRvIoW2yI`j-ktnBGL@v^DO^Xk`?8u4<^Sl@D^%LmD3Tr(JRW$C!*WQk+*R`|8& zlcTMAfry?%fCznUrv3t**DmVcPuX(0_7}`eAa@aBQYor;SL@QXt>#nI1gj8d;o8N< zJ~CQV)axU>%AMTf$SnSoD?2F0wfA7En!K+~Y=(@B-@s~~ZdiyL?|M12mh&!X)J_%~ zR?e)sqt>L*KmOr@35ej?PoAD{6|UIC!1`+k_>?fy$}xD4p=M}I2vyu9%U!uH8}w2s z^-e3C6_b5dCF*1V?Y#$q$KWZzvHjb-8i8KeIf1PTgqBbX^%$P}sV~UwplB~=#%JB| z)cFZ6exq^_X|^Nf{x4$|zwZEzdx@Vl9OogmwxHbYmR!$#i@b%G*2(z`kj8|Un;{W) z6ITNZPoaCYY=h(2ZW=|Zr47~g4m;}!_xAyN~0&iOEnAZN1Qtgss-itgM5GFo;GPgrpm^D}HEEF1!9MPbJ&?|x3zO)OV zuA`TMute0V0G2JeULcm_OZAy{$u8v?4e28NZIJ7;JH=c zj~i-Fen^qeBBA|*t+=mC37hi@V|M*vlkw;vvCr6AG2JQ4zSyx=6Okdo=5oQrq6J-R zb<~3S1ad#iAgpK<1paevyL&?u)K&KP==kG(V>v(*^~EW}oZ{kzx9PtDp?dBzcPkRgN3JMiT_ouoJ5pBQTKXHKVhKXbumjYo(X?STo zfp-FETE(y0U4~LJBcAGOQzKh6&%>EYmBf{4d>~hM3}P=k5@_7gI+Ebq%aYLU-AULB zN3~<~<0;H&@Z%PWhppg<#PD{LqcFp|)HoRF)Spi2PVZTHtvyyvkDQ9&=Lq(KR6j`x zwjvuk5=ARmprh#;Q**__sv5kJEum3J3H;)8pP2eY;VJ|(<;KA-Eq7|=kzlt%Ht@vk^RAD8c!ok z$&^ItCi)$Sg!#@>{oZGey2xN>cE1YA=+?AHeHG|yHwv$6;h`;>(PBzvL1o-yO>EqSQR2**v< zR6KAo^_)CiHSJ;%mKc4d2ixFR1k{4QXL8}Y(3`%tKTiZCt2Au;_AbLdG?rsQ(}X6=csE1Hxp#O63$(ppJtb1w4yAf^xB z${uJi{~OIKxoRoN4WTeUP0DVtZl6q!nQ;K0Ey$a-ao9;9<(QcSEPAQ!Riit=%s?us zzKXZ+m~OPZX~wBTTcOto*d4*y9a=(}TQB8jDDN|K>oyFu@6BA}L0V&u_BA_~Oy!tq zms8-{eWdIp{2YRE>Wt?R{7g*$a_?N+E&Y>!)e_}SS(8!Uz?RsNAYz_)8T8|W2%CvN z#J2KdVR9E09Rmv#rf7u=sBBgJy9n*iK$VBV$dBJ5N2)2EyWX!iBBL6!V}t^T!*4ZZ zA5|vVwqNJpP^wH$S)VR^-)jOAUdzU4j#OvKnT`|zId9j#e$E`jW>sY*+L41bKUMe} z_nBho45eo!f8LHuGndcGszQwM%%NPc*p@!rGM_=6Zvl{0#e+6cHWTAQNic7${#Kip z0|@T4=2qb3l@c3FOXC9@()Zkef-tkX>C(lCJKVKLO3a~K`hA#>y36hQeIGxlFP9X? z$R$l}C1#ubgxR$ePdPGOuuv$AP*#upYvc3x0yLGssnus=vcb~U9yoMI_F_(h&RdSw z$W+PMQp&5+#D&~K0B}L)mrOyn*Di8%rROBA*C>EkpgTtccyz~{4&8tuii+dg4nJX$ zW8gMeix#^Pu}??QF+zoC)Q58jbo7y8$qE9*4TL-O2VMobPx?iPz}lDAfd5I8HfjSl zJDDzY=wI#vYojKJw>Ktgf|t>BeRC z1LuClWL+vM{|E-z_MhFWXJ4S5WYvGy=gGoTr3}We&O?VxdH(?Bo^rpdw^5>b)qCTh z+uOjKdgW0Id-(w1_(CWAfGDkRW1DL~cFp>0`3dA?S0{iCDbi;Z>OQfg(6!e@CqVX( zGJd3!6)0us3V^$H&EH*|K*v@*C}LFB+`}VQw=egbyZ|~}hFC&hiwy!q-k{mt_WkYO04-k&PXGV_ literal 28859 zcmeFZ2UOEp+by(6Z$@JO+GybH~K!SKu4?>>4)40AEM$ z-?R?_fh6L2e*}`});&O=A3=~`uUS9HUY-h{yaYoiaR%kS7dRzy;NZ7setlkG_s5|q zh5Q9o8L<$CsIbXut=kaAAtu%B&j*(*+)Y+HeBa(te<~thP+(VSE6{e@*-< z(LiVq9-9wxLwU*U-a|>rHe4L#P9a~m?JtX$OZ&2!EhEGjseR`gf$g|1h0#%e@+kdK zLX9CxTXuH|Og9cjqI%Iz8I%IBm$asIcMK%B5xgX7)i@Oq<{dUxrMnc;~Dm&*y_;E0$TT&V3yFZFah;!*A0 z3hwmi9+Unkt%wj%I{dH2?@xg7<_(H@l;}{8x8QCowBK@RcG_Le+ji}ezXB1)t?NCe zb$YpoLb4 z3cB}nL5xYl08#ERSW`)Qr>-5-yZV9xhqR;y8xsAUJ0-#(!Jfu$52#1dBHVf$otPQ- zIoBz*^WVk_zJ7*+w(}Kjpir`D`||EGvpvJqj%QMt2zH#c^zW9apD)}11+ z2C}$iGdk0nKP9Kk{B>#*Zyxcu*(XCc4UAVc@lp=G-7B~;sop({*3p>@=n;Xmq*Gkc zP4aV!Jt}Ho&5LtEoW|oHCcV~nJs`+bN))6ehcXGKp5zeydamkg%+-#N%{QVRZN+3- zHbg5Hg)g|8*>6M2O@ar(F&PvjB+P6h5nNJi?Lw@un|Fcarf)>9CZhKpQRdRSd61T| z`)32uRc2DzlvIeK*+w^*ZnDt^9#zYB&AA?cgG}noC9POIx=qBaFsi|>kPQ-83c8yU z5GZQW`+0sbjIH?P2Zy33?EB6=!v_vaYie}genezRk7>^pvc@rN>LkX!yUQwR#j7JBq|-@(8GCmXFJj3y@!PU z68-fGA;#IbF)$e#Y}#|>a{-32mI`+5+4wl7Zmj7tb*Wpz5{YXp+UnUa!jR_Fx#f2&F>&pd0lNC_WttyC9u8F#pZ)_@(X(^2G?9S9!5h zD9WN-SAqox+^w&up_DHGH;>gTX^Ymwyl-BrIQL*wR`X4`SuI05)i_vkj#=7FZEZ?5s z&j-mKl4f|aBZV-BH}U<*)GcVEkIW%=MBP7>i9`FgbQ7i(W|(ywl&|;PVE7N*(1S$ zq-rY9PKZ@b6wB+*m=Rng^^9ELgmIhd@$`-FC(4P#!&WiBHB@?z33p*unnijmDlyy# zNgMd%^^#Vp_O-RhKux1e$6;qs%_94LZo1F7wX{%c+{y(op8jdVFdftSj`* z;0YXyJ^ABAZmO7S`N3Q)(jDFOOTD7>O*NlgZg|f|<%mZEVO%}6XfZ=^X$KM$-%h}? z0+rKaP@yr|rw`^ZG*p-BT+=8G!l^-w*L(98;tX~<8Mm@o0_hpuVwhx&Dpudyd|S5= z(si9mytib<{jT5T5|tbVs#)EM$-2^;>s-C8cx=GeZ1~7c%gBYkri^ zl2kaIMj1N0iK{w3fgRYx*sgM-lT;+12cIIiUy!Dy)wUqhJoL}i1@_>IX9sSFnM7Q= zH!Amm9X+mp+x5MtM72T~G(!CI=gbJ3x>+*JG^X#z9IbfS2JemehbPHX!m6Yfv0ZtV$SvQ8>Ses|KVELW=wAngfo7M%qDl5)+1D|+6@>fQ zQ2Q?PO>L+5uqkd2#$PM3eRwM9q8xs=j(u_ICj~?H^cJJHfR+L&e?048r3hijZ*HED z%B)hrOFD#Yy6wPFgPx&70UUkc?my?a)y0-UDwx`nKgh=;+u?bk8}Al_L!pPu1O zPT(@sDs`u&Moh&;Fw0kY!4BUV*dKa$p3oXik_XGTD_Lo+k9j{I=(oxRVKcdK)d=?8 zKlkPG3?Ye%ESSu=)~xtSRhndLp}`Z4BI=G^vK ztGbgV<=m76yy4X`+*>mrToQyZ<`tjFV*8mjoDDOmTTxPnmKjMZV+Q0erdIfN1-cs> z9eb4;^%rKY0(*>b(N>goqv{;KwLZwtn-=~FHbtbTSGB0m>4eQ`z;78FAaiFw)=VJl zt+`3Ianz#nVF}B+8K@j%om}YjR%up#%{fOuQJ&m0^bv4xMo;;;PUWS&$u|}Ivi=0G z)ERdxWY;J(eKiG=o4pvg(C0qQ2z9{bO;3CGRn2afaV@Kt^DbRh%0E9Vm_K~H`Wpkh zX~V0x;{j!QFLa4NaOZ~O=ls&fhdn1kB!>RCcB?@UX33n_?t<>)NN@2lSginje`b_*x3@cL>P>j zcMCnJt-PmEt2g^7A6`7Q4PQ~`Xi2Zxd!>EUKQdyC&|hKF2uS*uy`q)KBKc~`(KCqE zPj@*J?x0ZL9`ql{#^Hfy)!*dmWxi*zR#khSMati;?HW;tc_+9jC{}e`U`TdUf%*Qa zhg!)VxP+F(9JYiSdolt=7L#z#)vOijRT;V#BZmxdsW@LJF4tP2I=ugCa)q4hlv;)M zZM!^*sA_K#?IChpm{M6!szKVJ2hDs^Cp3$Gk*J-7ot--40Mnb*(#(=huktcOo)km7 zqLFr1Niw7Kr&!^Jw0@?l%!fIoMg>88*2q>NHTqvMHSl73w62_Pz3nA#`JwsRdG7-ly$G-V8mz3Yt&6oFDhshBNBk9T6*EA>NLb|}CFj1>2w$eZt0K|O zT!;!-7w-?-NGIQS0dfMXYH^CcwS}8{zq|d>G0uO-0_9b#A_RZs=S#R#k4ak4yXv_+ zO4(ywbBN8_Ov>N+-`yJ~JNcPb-KIR>FxoVinb?@79EY{gw$6~@-k*E!^ zUVZ5X!;Y&_qlHYuvy(3SE*(|XTbGd#Ed3&>q8A(YVd=zl^*LWfsC^#1#Ywq>MhUa* zt*I!!Ll$!O-wx&jt)b5zS$kL<|Q zT68I7Nfp)HR!@{iH5J_%r@1uXB6TVw9YQ3X`RO?0YdT)WuHv<7_TWHY^7;7bLx z?mt)B{v{&!=Bm^rUqrp?+>xmSE3KoA&NQ;mgP`$5bv6}D?z^k*&bh)+PrGr*V5u@* zJ*gXCndE@T9rJMU%?17Jyzs>vO@5Z)!VJBW;)_0)LK}s2HkkM1ltCh0vPTt_6+*7} z*AV<|;AuXmy3mB9_ymStf_)uKJkuc@E{lbP=|IPaFFJq&tY-Gh_$eRVno z+<+^|JOjYkhC%3Q(;wz)Me_8OCtB!|WdV;~)4cm5YV9kp)5UvB%VrnKiS06~&dfl( zx$E{dG$U$wRH-*?<;&ZVKu4?G?xc6HhaN*NQB@10w!0Nt2s=5((Kx^6eN$-b=Mq!y(~M3Zko0k6<=yf-d7r~ z6Dz9Bc?W^2(Omp-zFeQ$pysn=pQkmc-Bsn}>%Nit(Z;A*Po;rhk&enM;j(s|d7%{d z(`KVr&cLK%@Em=9NP50hFS z6ZM_P`x;+>B$a2VUHqA+s!Y(&rt>&RE++VJ3>_n!&?UPY|11VEciwPTbhM8dpV546 zNk&V|UX4}UbjFH0pgN3H@#6HhRM2|D=|@uWOOTLEc=&9lw>G$8<$G^c|2)$cXU-DV zBh7;iy^~AVgrZq9dtfDe26IfVtt+L@*tSP!m6S)KDH_lU(=+kw&`qQ9YtfZSD5~B zD`m($qcld(&%Wz#M=+2Hc%H{SclN-<6LTQ3D<%?Vte7L6IX=ZJx0KmSXAuX=djWhc za4UUa1oKTJ@%e^I*Ad7GhAu^$7)4; z(0N@;F7`bXA_=>)lIcX8s!dUgxuN-1CNFB#Gz(@c>f~HW_89$$v=d$1350O;CdO&v z$cvs%&+pdyqN5w{j7wNafpi}9ZPoQVb{#LNR$wicPrIz|4qN8don!p|;j!Gx!`iaM zV0dkyLe}+>br^8)!kcY0KlL^Ok5zk)IToK29uI?IleJl%`$9z#wJ~qLWO)Xs_squRb4tWn?u}j_c+ORX$DdwsiFLMpf6WBRG|IPw>O5at zd?fZ4W#kLmfRK$X1r~0Ym%b=2NmlJPDR%OV+UUff`z<81XtsiSse6(PncC$E?CQWC z&Zk&cpCl`UA6!s#8^on^1

    @jSa}*UHS_y-bb5~H|aVACt`1T8GEf*HR5Bl9-Nu! z4V&hrgd;5s_f*G1Z(6#D^J=v}P|Q1Q6y4&Bb)C_^vZ7A^aHD}Rsh-+hu(WfLpZBu3 zfOH6$>4nCPs!VTg<~qK9^*O~}byyTe#*w{nw#DxmLH_TlNk9qjh*8NoDoyLCc%7n$ zD^^=^1pXlWku?$P8h$`Qu8Wi>9bqaHg=HKmBR+v||1qd&!a!%lJb&NT#ele20od)L z9-VhwNQP=QNU7@Z$|E)}x=Okfm|K|}FbS1p^I)ziXMxjmXn-~&f}5YXFb8{Rv5EX~ zR=f13G5zHrwCu;uTJ^2nr%kkxF~f_gW0`mHPd&oQ?TfKSlZBC4mB*>Y=eBG|dJ`>M zqNc8PnP%9M2n&&pW=q8)9*$?Hb3Z^o_4rXLth=y^+~d>H+vt)`t${1GoMr^U9w`g{+|WajDvG?lh1k ztm?QKOKKALd%=0KOSAE0XUmjZ|9Xu;&0;}b5! z6cXi)hm*@N5)Y(Mw)}?OS&sCaU0ratmfLf#PFI=t==;^N?cb+MXU4&UKVU+NT&B~5 zqjxtklEYn$0H>5~6$ZP8j9cP^x4NYi?@$B}yv-JD2EKb#Rnb>cqyi7>#ek?iR^?08 z71hLQOLk7Z%R)5?IW>yADaF9gVTx* z%Gz$%BRVN?pQ)Y&4J9`yTwtgoqvhc|R@>b98w0Y2^|pFR_I<8PrQ?xu6YoNREnS0<~1A-FBnd3s2!We}a?qs(9~rAYFO1 zZvWfJdxRwX2jJLggiU6{+7D&0ff`c8kj}&LAV7{ZmVJwD8Y5~{U??Jv00c8<$x&1X zzup#+cq|sGtmE<9e(HJ99#a?-Qi9oRkJ!kl5n5E-bU>%FulRk+bXjd+}i-4Nhb~*p%{d~{de!1pO$;`c6GB#Ryj*;Rx_x(OZGhiOIGzq_g#iJ2|> zuoYhwGuzGNn(yXmUYo{47r*t$J@zKBq{bCSIzRLjFRQ6A2dS8npU+S+c>fpz$OAC( zOQJHnU(zF>#>|{#m9OS~A7&hdoy|OQuaU3&n1G%j+Jtan_&wvP54D#dF3&9o%+20R z0;TB@t%P#=XfV5FypYkOLeS$C7lPjJDt$=B`0q4Ard4LH!d3!g<~mJM`sK`$bd=`i z88v#@A8xFWle)b=1zH8z=w3kQ$>+SF%tQ39I`}SuPb}885fbyVNXWOHhHHu~>LR#hOb+7kJy-qhYTToMyb#Gs$$ z6*>KhP@RK~hA2mL5Wfh^5xGV(yX_d^<|)f@-8}>22~~2&W>oo(PY(fk52bIsSUNYK z(GXb zR}4j2PU0to+C&{`Mr1MCe;~Mg1ST;&r#F$BR@kEa*otuRuZw1BxFw(n=V!d}2iT~v zrZK{=2f4Ns>e^+ySg=aG|9raHGRdl|I5arOqDODP4l_$Ch&s!?*0YqN4k#{Z|Gi7G0<6Cl6aCX&)|9QNOy+8dIJ?>ZeKX zy7XM3FUhslhbVJAmwZ?@(MUKdJkfqz7UGf_{AxWGGrQr8n)JNIK^*pIR_WG!G&3yM zwqu_Kp2$8;LAaw>#WioDLVL_AbF6ZQxRyP8J8tuh8ABc}AW-==?IMC%k>dEB$1RIh z%@&|KDf7P;_HJj+N4Z@@ybU=H8v31pUOgFRa}*SdWX+z+%gIk?vMZI`jz|HPE07Ag;8c*aykl>?FCI^AZ_=g>OTud{Jf)BoN*p117+=mMb)PPOyh})&F1j zakJk%|My#f|GHKF|2*?8|EYpwybTV8h@+Mp7Jj+>VGe?9T=<38*1Emi3#k)J4SsvE z+Zn4afp{JC{t&NYp+Q@=+bkd$eLd~b`7~E#L?wZSl|Y|+K`}{CJh^fTuo{4<)k~i> zc3t%0c_rj}!e%bB$?JVb{(&V?XWkT`*gD|8n)jDxX%OE^wo-vBW#BX9D45UtHV8cO zf1F^X6R_WMld2GuGs^E~m1egHL``~(&>AcNEZ7=m4yuV-LQTqbUx7%zp!|^;F$mdc z0ZW-}q<|eAlq7guZT$hdSD$3E5eH_OX>eyA%{+!E8V5(Cn4RdCy#C9l{A0u1ol*5* z%}b=VK{9xE_cQ%x7C0gt75-<~0e~X*$+v~@*&>Lf`WCkXlAA$!4Q?#*i=RR-tL`)+ z*LGh*I2Y#@2St)iH=d4|9Oq4{`y*()1%cLyTHuNn=^Wa_f~nFCI-@Z~h^5b)fzlEE zZXD_fGyU`30xRE(@&@b~f@%=SQerXgDAAIwExp7`5UBA6?d4#uhF1fRAfI{AU?O~Z zXvbvUbgA%ZC~yCqMfImX|~P z@x+*bftr8MIzF`14GGJ>k|Xg=Z?Z9;pC7IP^d+7XOEe=HP3`VBtKy(rsA|+X)g5jo zxJ1QLi#K}VO=5y#tJrIv`1O=`xZ98c^NmN~K$DF*%)kppvm<^1rd39$W-Gy5;BNXe zRwdaa`1-`5!#vhkazOXg2W|qeWOT$<>leax6xBRqAQhZ!931H`%@@1m=F#YIJruBUzpRU`Cb5uG!f5Fs8=l7 zeD$}<0U^`h*^RFTw?NH4wEQy%vr^pqjM1 zweK|YE&JDl9|-Foz{%o!+%Mok(_lN)lx1D}Dr8%1-&ucWe+V3tvav;dY9teJeMy@4 z7%NutJCHxQ1(K_~#Z9ox6-2;Ln<%H;CE|w`_}Xqgs>$;*Hzd9|?>Qwl>?z+Q*yjNo z?K+uAywaUu6&ab=nF^Mbj$jOVnP*pjm2Z^RH6QXD!&#*ao2}MuByPNfd_=@)BYE*CwsY}d8KOieF)#aW*V*B*+pqUa|KT1!bNSN8!lO|dl!OyPVtAdWPi~7P$c)T zKM}Hhvnt%Ub@M&sgj33V5Tx>6<7Xa+ubYKIE1hQ{lGz*Md&Wk;)Zg6Lmm3~KQ7j

    )TBc96TmvnXEVV{CRMg5rizmyuYci^d2HAc3aoVV$ZwJu3Q!%K z2~4@m1#6cyU5&YoqRTY=*iAhgQzDef+h}X1EQs*KC|EP_GH)>G()v*y-uM3+e~W~M zRtB9><>Jp`f?gcrTek-=maVDWed5tN9Init&Vl-W;{huZB{N$GD|lnwei6)HVOi9{ z9S-uA3;k>Ociy)_V1!_eqbPXns+U;3f5DHuw%2FAjjf~q297`3Nq)O|{I zGZ#%kK=d*x@{qb3m#>NHl)zAcL>fg1vYmCG(|)-97}^O#*#XlNWexcj{?j<%$^>vA zB-jD_D31u)*lZ(PY(q9y!Sp{?c;OW!eCp;>rwQ<6VS$@~)=}=h4GA+DJJBdR=DQZo z{=8|3-iP%J=gCWEP(&)ye&EZ{0El)hnTYKnu99)Y(JdGNvx6flxyG!KHY(Y8BeQLP zP$Cog3+lkQ96uUt#RCCUQeTDB308tGE+WK${D7g54D)n@2Kac#fPMt#r{ev#>Jnr?&^#rQvlITC%XfM}=LW)(Jn$`L<&hRL=07#Q{|*U{)@4Rqbe*romyTMp$^DH7RtvK&FT9e}zT$Is)SrCa9(#rN525g?eQb8ApVn*y!c#jh_9-kd`dUZ{R$s z{T#J>e8>u1D=pk{LQ|UBUhBSfM9CIr$i~rib{c&Td=&){7i5B>jVE52IZVCb=PVT{ z2m?8nM`<4$c{r>inFBme9q|A05^w9J(jdZQ7yI> zj~QL$X9+PN(ns0VRZv4v=P;+gV|Rh;%>dQwqMBmv<+6$o8r2_bWU@F~#BJEY+(QQ`_>7|X?%LVO=gBfJz(@m4551u)g^6Uzx0zNk9>7roFt75RJ+=+ob+nQ7D87@Z6Y_*Nty>}w zFh#|8lG7US2u{HB*iZtwzgs=b)BfP-Gy;9E$#pK4uS?eskj!*hqFv6~Hk7 zx^BbBUgsFnrM(~CNe7Hs6HG`CW_n!2VAsfI8trrwFWOe)(J~>F(`=Um~5?EHI z;m$&JJP%F|qIGn;&BS~7pxW&xppYJep&Wt)V1TE^dYURL#SqTSJ-&;9Et058iI#qZRgG;0h( z*%mfQa^HZN##Jvns`zBSw?y#;fe_%p8mjN+U0yK4gB6nxsRdsVpx7!Py zji#KbNaKgjg`!Hq{Cd*}!e+gkKXN+c-nb}A=f`d+^40_y!LCHM(VNxsbC9gBK zwxSHQ@Dyj2yB!@;$vQ|aZ`$MMroM8Z-4@lP(%q#zF`NsVCc8QC2DFL|1NO5j#6LWM zhSH0p9`YU1PRvYKfN;Ls>hNruOvKXfy=Ap-ytOMNptn0Ke4 z8PybgnL`4*-ut_^SukdDXve6;ZguPBdc2x7KV`>)`+-rqDx7AyR94&2+a!MckG-KP z0&4Cb+L^Ob2%j6;@fW|yw<`nGykLIR@x;K4I}H_vv+6#j3OtrUkj!JToalSeC32|~ zx9{y&#r5#z_q?zHv>+Pa8K~P4T>pa@*V52~FR+^*oIqQ`hO;rs9l?X=#JCUs+1_k8 zn`{=me6SaIkdKbz#6H=u&;2HitBqVjqVHD zDryK=+x!CN>UJ+ekm(=hscTj_OP1pYb${$;qjlt^L789xvE4>_)!4i7WV!H&Aymvz zhv=n@J<3DW2BN%9vbhBqS$EeIN)tGZx`(d`l!)e3fbnPhxRWmzWeX1)@v{ccrU6uy z29R%pm4Kf%U~C&lgR@fpRj3+#&aW9X*c-1Y^Ki}Xric)4y*-{!S;ch@LV=%H*s5c; zw^#oLtz&0Ex@v;?JgQr`GTYBm8Y&#oQ~T$_{$mv@^JwgedZXQ(xDU$-Gj41Dp_+vU z7BG+RR9DA%x@K#tAQ!T|C9bM)8Z?J_h7mjMdl3`~RJ8(xipE6Sm*y#8?Sb@x6OZPM ziujK5YzXjSf5Ta(-_QLm8mbd6w)$6#(53$w!Zl+Ea!FvWJOIJ=lfm`I!PgDF1L^;v zW^h`A6KqVqnO1yIO#|ja^+GKH`5gP!rv?e~J8iNBVKq__lJKk6VNFY^7-GbuM;K4|uTlX7gsuq@Wv z;+Rv6n}BqzbiTm(Uv3_E`{{X}q32%L_^`clM#y|$Hhf^*YjAV-!EzU8716?K)KiYa zS2K}$bO+bi3z-)|6?<*8XEbdb6PAqU+caW_?97}BWyC*6308RL?$zq^PNj2+6@kK2sYdwttuCj_T$TcUREYK%P`!gxVT z79CX|xTVBfarvH=q~KuZN||2G+vS7I%G^nn1W&~5m%WciI{A8q15;1?6a?8p^joakK~BXJj61)*8%{zBCT;XTW?yotju$G0ls9c}CJVK7_k z7=8CkQh3Ged*#}y2lJz3#Q1ns4cA!OC2jc=&o^R7(xfPiL zk%P2#(j)9KtfRszajtYwlhmECZG=NOTK7&u%cg7YxmvQ<#MoiBM0*5FOkW=#>C5mX zSz()nN519pA@5BCZI#nhN$u)GOaT&3bR`fseKqJ(?-vfKUSXUI&p|5D=4YrKLTzii zuUIYhx78LBiZAj}s0|4d-%75$Eko7VZ;H&};PHC(_lV^)Yjl{3o*$d*`f4x-Dx^(fc{s;-dz{@Q=ty`0zJU%x(+TLt#>t zA5^S%RI88cYqVlAa&`%Cw1U^3f65clXN@Z`(B5YYR)Hb1Zko0_d-er016X16jYU+& zW>~J44<6nVtEFMr(tpL4Uytf~0&s;FtHtYgUV-Wcr%5a_jaCBfUk&CZjmzSdM;@px z-hf`=%?;|R1xS^W#v7Br1eH7+PlHHfw1$g3e~ zDiWLIby+epojDDc3|}o}S3dEvSEJKfX>?Z?Hj`!(zZK!kD7(&jcOs^8$eE<{EPyz3 z8NpjD_64xmy5FBhk{z=E+eCPQLu!8u?ft6>rmsdc+tu1jadl$&b?JK%k~$2J573Y7 z^T*kSfBtUI+~XVm^5@=L3oI<%SV;?AyFKmO4{G*e^jYM=gbZ+cb_n{y_996MW($+5 zbea4vpe6tOafFlM50TDrGq?w%u*02ceexbVqn5{t!SJE{yfRLI0m75fLX-5}(tWd6 z8F%YGQL3!vvc;ud8jPfFo2O6VG}`Kq+?O0m3t#)isKlluF(3v@uswW&U%~^80Ge@N zG@Z!q+N>mXkjP>8W0{AAaDQ?m51%oK^fFuv*Lh$BZ;WeYh8V5CB?hF6M5fX3b@}{a zf*nK_sxgv=J#0&~W3PQ_nUMHEeHlNAyxx9$P2J3{tE%zk?U%1yee4d>^n|KCh{c4C zFVr;k-*eNfMPV`OCPln`ylyu;8#{6z+2f^hFk0V^O(yxDSPb!JJzZSmi?5!jOxwWLqBb^cCgYNu3Ye0(hN@%8Aw%jk)yq4IW^ZX-J>(MNqZx-~u z-EY&%NXho#l~%Og#q-Kl6cR9p-Og z3*O@OxOp7;dKHtRO8V(0d8pI&p}tKFp<|XWMtM&xXzL^nEhFZ8$x-4pf5-Bj|I$ED zCZK^?anF0x#J%=^6jqP;91S4Ily0xtg9Uen$8{2=dU2_%X@?5Y!c{L6NpwRyRs zwkg@QbfD5@>bu|dD)yKpS99yHSXy=J{8|ZMd-YgO!TC=*PCE_cIZ``T9}mS%yXNRw z@Jm1-QmDX!Fs}N{N{LOB+FE+n8HDe*&^(=g^oA#m)AgTru{%oH=}&z4`z|d$WWr(mp(?Fvza((K1Z$*O zCp+ozO%@O>V9Den(jk(e*ub&K;oEzY*3B)EcJ0q@&B*f9`&zmqH)8g z{DhMLoX`Jv0dS76My!&xtJ4-=K%XofPsJv!_Z+e?icJl9&mZR!{tz6P9 z?yzdM@Yb0GR-h&=1Pb3MV81_ihOcH*KVF`V>qwStdDwEY)TQ}ej3XoUi7$Vqq!0jQ z#5BfbWY4Z`(%^f^_QveTiv4kRaV$9l85E zoG&};;cxO?v64>Bexc-*6N{TeCtRdCBBXX)mP|R{hx0SlKo#Rwy07+Vw8tb^JP^DA ztddNNKacXjxeSDZtOfZ5cSg@9=i721T**qNDL4VT?FhZH5rP<|2L-X0S`>u!|C{ zr(3g`aikgjPnVa1F35N2hZRJo_8-I1#iv>d_I7FhLdR}8JFbYcqix|1a46$7O;${B z2rFxy2Gg%fImF-G#dIJFC(#PqCy9-~R^}eSOK4-SCI)dXLwgU`T4F7m(`n!Bh|7q1iA?!^Y`KGWM|l3-qmc^Qiqg6qvIPU) z%3}k{fnVc>hr7Kjb-$APCWjiAV7Ha=9Rp;WGTNokXmQ z42Lscotq6H0Y4(U6hQCp;|E)fg0eH$?)Z<|k{z1egIIc`cwDkAzH)l_wZ;dMP}}?y zQU*yvOmI*Z<{I)>dU9pu6zv_4N4FB;*ns4Jou-&yS{khfHG6`#ZOqH3)$BcZi@$z% zPLPP;IKn4ryF&8qQi-~xL0CN=>HdYl>vr?V5Fj*HVv&UN2b&!kt#K(cgB7bzIpg>L z+V>zylZ>$XE>2SZUvDwGbOjc4wymWcoWgz!!F8$iKbv7GR+{I!@yk7SX&_AEgWHVX zpL8`*|D5Hq*V^x=24ZK%J&rh08+8D2f{ItSKj}ETOES{liO{t&L4G**BUkBB6vbzgNa17&JOLS|uAfFD2i)=Fb=yUF1_v~ohkd@h-M_PS zdo^T$kE!gsju@@-UG=pxAQHs3b(++idrR;~jN@T=)q&F<3%Lr?3&CJ97$QxvLU2tf3(waRHXP-|Gw3FjFlkhergZ~r#w#EItQ^mHpN~I&uct$ zV|qO)yw6$i+$djZuYZwTi#@zGN!1Hqz4}AL=iiP2N>1`UbB*tdHmUy^QkVYvXzG81 zKz6_xw1S0JKyhKV>abCpQCpU0IUjR}=?E-rPrwk)j0%!FE($-)RKlv;5UrZ)#~bHJ zJd*(wPpo#v!Q*6+Qp_MndJrb?ILIR0=NeB)?Xn5HM zmbzq7`DGlnU!T|My4WGe3)>>3WE&*Gw)kC2r7B06}c z{95o}z9Stg z^TfGIPA!1$8>Qxc2**vsrUHYa%o$h+|A-nZ5(Y$+bB8POEwzzdU$zn0leSWL7w6`Z z+d+jm@!$G|amqMtm4mtF*p~U{SEQVs8%dA(m;x#bnv$fKOOoz?+T%QazG|sU{kdz* zQTI*c#NCvy8VmV$e|tBOba_aGd0) z*H`x&NI5tw@e>)uazf$WO-5J3(kme|-dvyG%7Svba%qMMz0mvdv=?T|?mI3COH)hR zJR^-g@~y$xAFe(c%mvIUoWkGyYfZshYG2;b=vkg4^Xe++wz=>BE+rlTh{Kf>t=_&q z4{G)-Sm$Zm%}j78hq`6q_y@mSx0HUzLR@WCk`#m0vs%IF-D2N`&s#hTf-yQe_{!vE zBG$egJcz+2r75j8hBMyLdT5QFSiU&}J`ozFQx>_drLSMM$DpM|K>3SYeOFfzZp@In zQLlt+DY|`TAqPvZ(5v4Wv%-$fNANZp3;A}uZn|Cj_5JrLLR0~EGjKc`CgHH!wt>!D z5z*~_w+8vv?1y^pzl5NcvTJC^04(jySfEKKOqk#M_J*!LZ>iTu1c9Z<7Oa(}tqEK9 zJ;r9j1lgJ0i1(D^**g1S-B~Y{TN@dxqBf@8Mj@Qw;KKp0GF^v;W76@hmVpgVemqqi%#WXDb ztDJZqG!@Chy5`+0A5>F_a?J(^%qX0s#(Vi_U`% zh5c@h+(5IkN^F^VZ@xc4=a3$gu7?0m?Li=S!CP)dpBlphVbtspsM3SBW1f|9Z>Ty{ zP3OqPB9Gg;08Q$1U;zuL_DaoaNFJ-t`I`$RIbq|I(mZxE`$l+D0@>zBSP}PAVBU)VF0cIW2krk@p!s`- zktZQMH#VUx(bgE1{w9@J1C&~Tsk`9zNs4_Fw^Iax3YTcPeRh#v=p1x-mOLq zMh*Or?!G&!$*k))f>;It-?0tShEYKjL_s>js3Qo93?(2!C?ZWd5h5i7MglgwP>U1A!#8B#@BgK4ISP{(INE?p^D<>wEsn$^&PYbIxz?v-dtb zkUf&7TWO{v!9sR039^UqJrws(stT~mimc%@J7AUB z!;qDSLGF7G#fhDNCaH<7Xq+U&`n^^g@w~>S?K#czQ5~2DsQo?#2L~gg8TCyYA2pHn z$J-Qn!|f47Dd}yHyU#(<{~7^C9SJyUfZQ!kK1dzdeo&gh)@)i+yLvXHaT_ibha~=X zU9=ef10QV(*k8cv!t4lDULG6UW(y494Ja$_$i|cm;vr&vQWSJ0gjxV@&RJjKfp3!M z>fR+@TK3R(Bo5zjT}!RM0c@-pQEb&=IFgDSvdddbukUjIL*y2Xb^XU2{m*bKMS2A~ znS3Jqkr}iC+9-{CpYkGn2SSqpvl`o2T#g3paX>gToGZA-YNNr5IS$bntf6TBZYu+a z69DgzkR1amgc3?merjwg5q6z&wZj%zEjTV5C?cR6Q82k z3+(md-to8(+&{yu^h`g%Dbs=^bmlp(5Zy;YfsxfZJ9U`^n#iZw2^ny+6W&awv`x~k zk)P!A@)|n+Iq}Xp?e<%`1cbAjRobI$h|47YjEPU$OyEE%5ZJSFk7Z0p4ej;}{3L_e zBsTHsz|J~w)MVqm44CyqGp2dH>RwQT-)2s4^yGS8S>5#WY_tcSPipnbgm|NzZ1Xbb z!ssEouoVFwixq0BGKF1TJmDHJKt_F19Fl=KZgOxL z&8Y6E>{WWn8njB@vEmhe6iWQJHMj!LV@VavRD8)o{5xYuP|3Xm8H)e0_IJY7pOf1r ziaE(`b(MyJEyqP`!2J|31<}TJQSHhcI5sMrl}CF{qa{3fd8?$igz@J@xyR~zAlO!! zQZ!i`zB8*Jd8E068;zje>sdc;e<`R@a_96q{B+FT)Oq4tp9D$|@ON=Byc?q8i#TML z^2)mYrzvcnOu+3C{y5MhfGXL91J2+7cI@PQKJ6T}McVzpeBzLvL*o*JpMj*bHu()X zFWWyJ`JrUuU|5lfBg6=*QE@2OVWNTC zPF4b5I9~_-q{mSuo8~r(JVAHo?HJY!VBZD}fYX-yet3~G2=2<_M&5{5n9?hbc1Q^x zM#Qlo*g71w1Wf1+iDe}u@aIFdhs2DU4;{y~W8X(HupbG@E80>NPZL9!a)8FJ(-MRNmKt+WX; zP@ho#Bf_J)cB!Tj-EftqLB_iVFw2Yab4yJ_MvaHA@90+?a3(Q1rm1b&yMILwF&d zdy5zlxHWN!Ev~Sgy>QDJ%de+U;%3J6bg(u|XX;w8oXLUm77;V+HN4Fe0X{MH1yjTW z>N#FqxR5Db9k}as*F6S*Zku+vN6=>`d3GU}>z4dRba2n%}UV009Ae?gx49hwH5f~hS>Z=WsuaS5M z@XyI)nmngV{_eC#G_daO9P{<9WmT0?U3s*D__u!;&Q{o#SP>@+ZIA;Y`t2hVF$LY8 z5i0=W^AG8<(L`l?3VwJn5S?~xY>XW8OP6PHm&^!bD`))NO^@tY3d$bRFx-as)i<^Q zb!uftBen{zwh01Q*2gDdY&&hn?aI#@3ZP>D@SCeDm?r!y7EW$Ob z89F86Z#uE^;R9A8S@Jl}bG)?S+FtxE%x@qhk1zEOF%j=}UMYYMHQ)~vQ3~Z^E$Cn9 zE#4aI{+tYjeK598?yGn%B%#xgiX3U!d-66DG#oKggz*9`<>=<2*~ z2F)soO|nPmObwrZW5CITkgZdKObfX@tK|L8fxU2VEMj@$cOg8VU8q+dIP8}(xBhF0 zJg-@L+iUKc+ya7QBV@(;X)FPg7t!L+k=73QXWW!?ZP?FKe}3V2i&(G6k9%Dl#L-Hu zlJ|~zFgRJJaxY;i;aucx_`Ly6#GwGWg4#FQzf&h2v!BYoTfWDUuc0)>3lPw+o+;tr z+WK0_oSH+fjTGbi_#nC3y-Q9B@cFZ7x7(lbO{3b)Srtd-$K3?YMf^S*H0Kw|+OBct z1?zy@60t(IlG}v$MaC!ckdC@ObaEPpaDvo#&|7Y4b8wx1>;_0tlSeay-wDGL$8oLF zW9I?}tMC!lrLGOW6#J%_B+OoOEshEF3ajlJ&kM*Q7$}M~pSikRgHbO7;v0og&aBpi zBU1>xGNHa-rB=c&n|Ep6GwJx`M1}kC5*qKX{}?8$e?W1bz;k0*NU~;7SWd;Eo~Cj! z`3J*ok>(4H6v|6Q=$Jw+FgaeabVhNk|L0QG;Hg^o{P{^Awo(`?TRJ!Tez)?9dKy4k zc>Xw*cgz!F*uV_Q%)BT+DhUNBdgGlhZodvJh0h^$bH)FaG2);ohF9mE$+@@Zw9&|B z*AFw9{n&^BlR=p#Xy7qj|7^EL)1i=u!9bM2@gGv-K0$8$&cFFcGE1aEVlJ<1G4ZqM zw-D}AmN9xtCRp0)-np)o`sHU*mwWn$7NN1k>FDy3TiNb875(Z&T<30)GWCEWn$nRa z_Zc@=w^5I=Cp~uthZrQVDb80oL{n41j-KxJDua7FvPKg~e&xl2gRdO`!yY^SlK&+~| zqHrrg^PPX_KI5)?y_~FL3R;75&WOL;ZCnG6~|Utm4< zCBg$8FsHoI#a4LkxuaQgbNb7eRilkuxJ1S?a4r(C-;mrejd2fPj7S+mi_sx^X4 za28RX*F6MQ)f^4>%gU}EobxwJ;ms}xl#CMq80*g9vbbDI8sf^eI zTcQP%gL0l>ENxtR-|%37qr@PH_yf#KX%y49J97@}uZ}TbXCnrhsV@yPx=fAQ0*T(; zd~DGHprqxXp6E9M6xUz(J;az^q1YKcL>WN;q7(bxLQz|={K`D|W1LRznY&oh=2f{a z@3W*`h8&*U?_d&>pqa_3VHXFO>e4uvK!H_snTRZF^iuvKd@fFZO4W#{CBzADJ99jg zl3RhDfJteKfiL0Pu@470so~saha7*@R&w7%z0ZP3DeIz10D#$605G*U?0Hu+j@lbP z^Cc4uIKGLaKW-3C(ba7bPYe?|}+et9qM10zU3m{G1&#Sb3)ftRXnap83Xl}arW zrt?%Z!giuS9AT_q!{yQ@5(9+F=Bvy{^stg$MNAf-!qpaw^&Q}3VnQ1$ zkhRe$Sz+q~H)3KU>u7|mTTpm_@QIdqDTGxJAT>l~M!_swVRl1l<5Ohc-YQgP@9&$>>lcN>iH&h*b0i)^K81i6QyCM|I z&_tEs8aysnwmYWyW+}tNiONaA_iw-9REs>FqX7SSN`>$6RWvg|f0iF472gM7I$BR} zS&uEd61h`2`QPka{{KZ@Wwn!rp#tGVP)6&{nWBP-gj_1;R@0KmFO#~W&EWz{A0IP1 z9d*maMc*)mMu2V*vi-A(9SWNqe5feZs4_>q03uXI|HU}do0M#s*2?WTQRlKe*qPl?x#c{&Ey`_ zA|UTC{2b*Heys+Uvos6=lAVufIp}pD$KuEbv&v`+WF>HBFf>r4OoBA4?mlIDZ3Q^0 z`(GRs)pAlDGm{mgKXf?;SM`F~DMl;8jhEU(T8U{!D@??CcMVW<)_LGhP@Jc>Ng)-i z9Uw#(%Xr%WF{#^`GTk7M9OsR~Z8e@wK2O-bAUFYOLlaQAx?s`*j#s)`H>6oS<1Hp^(u7!b&-oZ%s<8tnOPAAkIN_9z{rJaNwm<~SvnYy?rz$~** zmfs4qO1-2ev4l>;p6jqtfNlgTcQ^reZ#sk@VrpU1qnjD&K9r{}Gm#`xGYerWc>N>A zj=R!t5d_>_yqw3BSbiGNVANGNH){(+TUCuj4p)*w?zoxrfO|ej81QiHG zvHf8!-5a|$UeNfMl$y#Ev4!w#*X`qqxeV!Mb489e%{bStLl9GH(8l_Eju@Lf6>1tcSN-pbh={6rF)hL{qRAbGK9&nxv zW>(gO$tV$=Yx>n|W2M5B)JbDL5d&iIz~v?EZ~0|)5go~3ZCmZS%$#} z3*FhDX^OnG+`*qQz|E#=Znd17YBfp39EHp-Id?^A;%8Xwk#%(XU-zBIa9ONHQT1({ zM&Jp_cNQb|-Vb{)w$F{tKj6g{^7;b3j zG3ySft%zU;O%ZY7RD_z>OrgiNCpGKrB3|gTx^ZSGQsV-u`0lyfROXkGo&HRq06#eh zs0q>8J3iA7=cv|ec+u8QXph}m49{DA`RuKWQ!DC%GNnnab;K{>T7yxej)8@&R9$LS zkZ-9g4;r0lJme*isGg%KrkP=+`Cdm%U1yiI9ls-lr0K_JNI7@zCh$jCjT;}k@us`t zuKqD(`g9j)*d;cn>I9o|YU?UXP@Dd#OPDd+ZXwX@Fsh0w-1G~&F>>Aet$*=Q;mxOG zmj>HZ%nJf&Y3Y9rxcZ$NKMKk2q`P#h$$au@(tX$anW zO;0WVGU>(|M@@n>8fszk%61^?b~{!t`~}a6#r?296ch1P2WPU-CwqjOY^fF}m2#rk z)7PBUpxCrYl;+&(^c{^XHWy3|uf7$Qx}uB=U97k?Aw+E{S^!JsoQgC{O`Io~lnhk_ z-Vxt$=dSzoUj>T3L@SQ)p2;}rX1&Hpe;rJ@3EXzQp><|A@>P|CZ{{MA6OLtCvKj&% zIUjC1=Xrl;`S-D$8roRzNhAytM>|VZ0vdm%w!^x~7}l~i$UV&t$Px`lu~oJ#Qe{3K zzGABP5aF0AY3PE8YUd4{utbd1hxgFbhTN>xih9BVf;(6X$sELH^Tnt=;W-UunOpB@ z;g_D*k^t@(gfQ>Vc08bcoYqrQ6|XPUyJm1$OFD0WG*&yt|4_RNlxQFU*o&TzOgxEU zwdP1>S}%q45N!t`xdoFWeAViU#m%_%aI3Vcvkx<07pH|u4LvhPdzMj4reYz>UA`LM z6AL1>OG2sk<#;2Jz7~Xf(y;=Qju~6sn+-Z2=^QWCLf_tdRTQrQl=Ur)0+l*}0uhw| z*af74X2`AY6iRLOmQU_3@_X5;qWLyVP?v54w@~xt`wp7v)WxhoFLZPbW-V2N%Y3Y# zO=Oc>v5{LhS=>3hyO>jvjx3%dH4EKwhl_AFJ8=vDdQt97Q&{KLn{=`Jw%m2=!Y@in zfONo4)QJZ0*!z^1{pd+l(cLk#r3qbqys1CWoOU+V#fUxWMdrKphfT20c%S;{TT^{1 z;)2&5{(1IVLY5%~5fQ-iBkS<`1NmPA)g%aZ?USbX&Tt>g<}x~0)0nm`uLHktqn&?cp*9`4K_oR>`2Qiu* zGJ8#P)=Ey+Ke!^dBsT1r>Y}G?4R`sjOi`Ek_VJ_};~|slJ6cB_cwzS2EyIkoms%oAmo~7dQuzip5=R%tKWfU(OWswavJ;$$A_U4J@cu zax_Bg)J}=F6d<BS-zTo>}0BKw_F<~Lu;Bjw^*AG zvuh5!;5E7lG%$Ou^)_q=Ouk;8%^_b<%Ta~^Z5W&RoPxv8g}|-a{=lYz6L!x--7IAl z>h$KcdFwAsa#-pBF&WaWwf86W3XI3{F3V|J@oXj5JIOGi4BgV{(FPCPSZ1|Wds0UJ zi+m14;@byx&y|Ao*DbKZ4XTcXKs{f8{oEND)?O>h?1${zd>}o(`%{w1PZuN!+Syg)&>}H;%+R{_k^x1aV(kX6YIt#WdjyV3^Ob^(HKuuzw zRGdN7;*W*t)(d=5U31*7oL_Z}H1bJv?kW94O=Rc(f9eSxQZ)^!}lkapzLJ^c(_w8J+06zbZeB#8nO%?Av?mPHK S=Z8o@i)*+3D7)hR*Z%@lD+^%& diff --git a/pkgdown.yml b/pkgdown.yml index b0eb1d2b..e78a15c4 100644 --- a/pkgdown.yml +++ b/pkgdown.yml @@ -6,7 +6,7 @@ articles: fast: fast.html oobag: oobag.html pd: pd.html -last_built: 2023-11-22T00:27Z +last_built: 2023-11-22T04:41Z urls: reference: https://bcjaeger.github.io/aorsf/reference article: https://bcjaeger.github.io/aorsf/articles diff --git a/reference/as.data.table.orsf_summary_uni.html b/reference/as.data.table.orsf_summary_uni.html index 0b8eb576..693a6984 100644 --- a/reference/as.data.table.orsf_summary_uni.html +++ b/reference/as.data.table.orsf_summary_uni.html @@ -96,23 +96,23 @@

    Examples as.data.table(smry) #> variable importance value mean medn lwr upr -#> 1: ascites 0.4881423 0 0.3069916 0.1979830 0.06346234 0.5090317 -#> 2: ascites 0.4881423 1 0.4605003 0.3949375 0.26487511 0.6423456 -#> 3: bili 0.4264570 0.80 0.2400703 0.1534410 0.05657566 0.3841292 -#> 4: bili 0.4264570 1.40 0.2611113 0.1718908 0.07259064 0.4205876 -#> 5: bili 0.4264570 3.52 0.3726536 0.3112669 0.17445109 0.5458866 -#> 6: copper 0.3144330 42.8 0.2618979 0.1664112 0.05742858 0.4157278 -#> 7: copper 0.3144330 74.0 0.2835549 0.1859239 0.06741613 0.4535328 -#> 8: copper 0.3144330 129 0.3390422 0.2605582 0.11054817 0.5398980 +#> 1: ascites 0.4922601 0 0.3067915 0.2127828 0.06450018 0.5323465 +#> 2: ascites 0.4922601 1 0.4469048 0.3769895 0.25032774 0.6316547 +#> 3: bili 0.4062072 0.80 0.2394577 0.1613976 0.06048064 0.3858617 +#> 4: bili 0.4062072 1.40 0.2625021 0.1823690 0.07973927 0.4206238 +#> 5: bili 0.4062072 3.52 0.3647897 0.2934823 0.16585086 0.5418694 +#> 6: edema 0.3176705 0 0.3002751 0.2055768 0.06355251 0.5233390 +#> 7: edema 0.3176705 0.5 0.4159611 0.3924873 0.22324966 0.6142678 +#> 8: edema 0.3176705 1 0.4173494 0.3861601 0.17888827 0.6425020 #> pred_horizon level #> 1: 1788 0 #> 2: 1788 1 #> 3: 1788 <NA> #> 4: 1788 <NA> #> 5: 1788 <NA> -#> 6: 1788 <NA> -#> 7: 1788 <NA> -#> 8: 1788 <NA> +#> 6: 1788 0 +#> 7: 1788 0.5 +#> 8: 1788 1

    diff --git a/reference/orsf_summarize_uni.html b/reference/orsf_summarize_uni.html index 57c28fae..9632cafe 100644 --- a/reference/orsf_summarize_uni.html +++ b/reference/orsf_summarize_uni.html @@ -152,24 +152,24 @@

    Examples#> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % -#> 0 0.3161695 0.2275708 0.04079213 0.5410582 -#> 1 0.4556415 0.4338152 0.24012977 0.6757556 +#> 0 0.3040873 0.1956687 0.04602941 0.5045504 +#> 1 0.4974976 0.4638980 0.32045574 0.6810480 #> #> -- bili (VI Rank: 2) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % -#> 0.80 0.2252977 0.1307385 0.03684485 0.3476662 -#> 1.40 0.2564145 0.1645221 0.05220417 0.4061546 -#> 3.52 0.3946137 0.3528272 0.18515998 0.5687976 +#> 0.80 0.2288651 0.1434553 0.04150904 0.3468400 +#> 1.40 0.2487791 0.1674784 0.05434565 0.3729538 +#> 3.52 0.3911358 0.3464777 0.20956700 0.5310261 #> #> -- edema (VI Rank: 3) -------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % -#> 0 0.3094053 0.2146270 0.03974405 0.5390676 -#> 0.5 0.4081716 0.3865421 0.17838896 0.6251894 -#> 1 0.4232587 0.4171964 0.17870206 0.6232070 +#> 0 0.3004761 0.1916197 0.04602941 0.5019744 +#> 0.5 0.4213227 0.4141359 0.16768999 0.6226272 +#> 1 0.4210003 0.4080320 0.17669578 0.6328263 #> #> Predicted risk at time t = 1788 for top 3 predictors @@ -183,24 +183,24 @@

    Examples#> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % -#> 0.80 0.2252977 0.1307385 0.03684485 0.3476662 -#> 1.40 0.2564145 0.1645221 0.05220417 0.4061546 -#> 3.52 0.3946137 0.3528272 0.18515998 0.5687976 +#> 0.80 0.2288651 0.1434553 0.04150904 0.3468400 +#> 1.40 0.2487791 0.1674784 0.05434565 0.3729538 +#> 3.52 0.3911358 0.3464777 0.20956700 0.5310261 #> #> -- copper (VI Rank: 2) ------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % -#> 42.8 0.2768856 0.1810462 0.03651200 0.4861954 -#> 74.0 0.2930721 0.1926693 0.03784076 0.5148088 -#> 129 0.3464940 0.2607161 0.08194868 0.5696629 +#> 42.8 0.2777923 0.1678304 0.04222316 0.4476773 +#> 74.0 0.2907817 0.1767469 0.04488256 0.4685898 +#> 129 0.3327518 0.2343686 0.08382702 0.5373931 #> #> -- sex (VI Rank: 3) ---------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % -#> m 0.3544876 0.2671461 0.10626310 0.5673370 -#> f 0.3222385 0.2432161 0.04065488 0.5449863 +#> m 0.3380225 0.2689282 0.08670841 0.5455287 +#> f 0.3055802 0.1815720 0.04748219 0.5132384 #> #> Predicted risk at time t = 1788 for top 3 predictors diff --git a/reference/orsf_time_to_train.html b/reference/orsf_time_to_train.html index aa55c2b3..6f770a99 100644 --- a/reference/orsf_time_to_train.html +++ b/reference/orsf_time_to_train.html @@ -95,7 +95,7 @@

    Examplestime_estimated <- orsf_time_to_train(object, n_tree_subset = 50) print(time_estimated) -#> Time difference of 0.1933455 secs +#> Time difference of 0.1932049 secs # let's see how close the approximation was time_true_start <- Sys.time() @@ -105,11 +105,11 @@

    Examplestime_true <- time_true_stop - time_true_start print(time_true) -#> Time difference of 0.2267592 secs +#> Time difference of 0.2313173 secs # error abs(time_true - time_estimated) -#> Time difference of 0.03341365 secs +#> Time difference of 0.0381124 secs diff --git a/reference/orsf_vs.html b/reference/orsf_vs.html index 508b61c7..5f425299 100644 --- a/reference/orsf_vs.html +++ b/reference/orsf_vs.html @@ -106,13 +106,13 @@

    Examples orsf_vs(object, n_predictor_min = 15) #> n_predictors stat_value -#> 1: 15 0.8263972 -#> 2: 16 0.8203552 -#> 3: 17 0.8160842 -#> 4: 18 0.8402000 +#> 1: 15 0.8340018 +#> 2: 16 0.8294703 +#> 3: 17 0.8167613 +#> 4: 18 0.8307204 #> predictors_included predictor_dropped #> 1: age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... trig -#> 2: age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... alk.phos +#> 2: age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... platelet #> 3: trt_placebo,age,sex_f,ascites_1,hepato_1,spiders_1,... trt_placebo #> 4: id,trt_placebo,age,sex_f,ascites_1,hepato_1,... id diff --git a/reference/print.ObliqueForest.html b/reference/print.ObliqueForest.html index ae9e6770..312ea42c 100644 --- a/reference/print.ObliqueForest.html +++ b/reference/print.ObliqueForest.html @@ -136,10 +136,10 @@

    Examples#> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 -#> Average leaves per tree: 20.6 +#> Average leaves per tree: 20.8 #> Min observations in leaf: 5 #> Min events in leaf: 1 -#> OOB stat value: 0.79 +#> OOB stat value: 0.78 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> diff --git a/reference/print.orsf_summary_uni.html b/reference/print.orsf_summary_uni.html index 254502ff..90b66781 100644 --- a/reference/print.orsf_summary_uni.html +++ b/reference/print.orsf_summary_uni.html @@ -102,24 +102,24 @@

    Examples#> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % -#> 0 0.3077270 0.2001923 0.0705980 0.5318454 -#> 1 0.4677556 0.4123794 0.2776341 0.6448244 +#> 0 0.3054245 0.1943058 0.0669212 0.5210500 +#> 1 0.4642809 0.3931239 0.2667095 0.6482154 #> #> -- bili (VI Rank: 2) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % -#> 0.80 0.2397950 0.1550060 0.06308384 0.3854908 -#> 1.40 0.2608756 0.1657390 0.07482668 0.4249903 -#> 3.52 0.3702576 0.3061468 0.17442081 0.5340155 +#> 0.80 0.2330790 0.1596352 0.06235256 0.3619985 +#> 1.40 0.2540362 0.1809254 0.07558882 0.3929548 +#> 3.52 0.3718914 0.3116138 0.18216413 0.5269286 #> #> -- edema (VI Rank: 3) -------------------------- #> #> |---------------- Risk ----------------| -#> Value Mean Median 25th % 75th % -#> 0 0.3027980 0.1887166 0.0635760 0.5320489 -#> 0.5 0.4035478 0.3550219 0.2083619 0.6029459 -#> 1 0.4052181 0.3646119 0.1792339 0.6191445 +#> Value Mean Median 25th % 75th % +#> 0 0.3001416 0.1839553 0.06611975 0.5104195 +#> 0.5 0.4042295 0.3595143 0.20304881 0.6188152 +#> 1 0.4030578 0.3599751 0.17563269 0.6173294 #> #> Predicted risk at time t = 1788 for top 3 predictors diff --git a/search.json b/search.json index 436dc7f7..0ecd5e7e 100644 --- a/search.json +++ b/search.json @@ -1 +1 @@ -[{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":null,"dir":"","previous_headings":"","what":"Contributing to aorsf","title":"Contributing to aorsf","text":"Want contribute aorsf? Great! aorsf initially stable state development, great deal active subsequent development envisioned. outline propose change aorsf. detailed info contributing , tidyverse packages, please see development contributing guide.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"fixing-typos","dir":"","previous_headings":"","what":"Fixing typos","title":"Contributing to aorsf","text":"can fix typos, spelling mistakes, grammatical errors documentation directly using GitHub web interface, long changes made source file. generally means ’ll need edit roxygen2 comments .R, .Rd file. can find .R file generates .Rd reading comment first line.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"bigger-changes","dir":"","previous_headings":"","what":"Bigger changes","title":"Contributing to aorsf","text":"want make bigger change, ’s good idea first file issue make sure someone team agrees ’s needed. ’ve found bug, please file issue illustrates bug minimal reprex (also help write unit test, needed).","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"pull-request-process","dir":"","previous_headings":"Bigger changes","what":"Pull request process","title":"Contributing to aorsf","text":"Fork package clone onto computer. haven’t done , recommend using usethis::create_from_github(\"ropensci/aorsf\", fork = TRUE). Install development dependencies devtools::install_dev_deps(), make sure package passes R CMD check running devtools::check(). R CMD check doesn’t pass cleanly, ’s good idea ask help continuing. Create Git branch pull request (PR). recommend using usethis::pr_init(\"brief-description--change\"). Make changes, commit git, create PR running usethis::pr_push(), following prompts browser. title PR briefly describe change. body PR contain Fixes #issue-number. user-facing changes, add bullet top NEWS.md (.e. just first header). Follow style described https://style.tidyverse.org/news.html.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"code-style","dir":"","previous_headings":"Bigger changes","what":"Code style","title":"Contributing to aorsf","text":"New code follow tidyverse style guide. can use styler package apply styles, please don’t restyle code nothing PR. use roxygen2, Markdown syntax, documentation. use testthat unit tests. Contributions test cases included easier accept.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"code-of-conduct","dir":"","previous_headings":"","what":"Code of Conduct","title":"Contributing to aorsf","text":"Please note aorsf project released Contributor Code Conduct. contributing project agree abide terms.","code":""},{"path":"https://bcjaeger.github.io/aorsf/LICENSE.html","id":null,"dir":"","previous_headings":"","what":"MIT License","title":"MIT License","text":"Copyright (c) 2022 aorsf authors (Byron C. Jaeger, Sawyer Welden, Nicholas M. Pajewski) Permission hereby granted, free charge, person obtaining copy software associated documentation files (“Software”), deal Software without restriction, including without limitation rights use, copy, modify, merge, publish, distribute, sublicense, /sell copies Software, permit persons Software furnished , subject following conditions: copyright notice permission notice shall included copies substantial portions Software. SOFTWARE PROVIDED “”, WITHOUT WARRANTY KIND, EXPRESS IMPLIED, INCLUDING LIMITED WARRANTIES MERCHANTABILITY, FITNESS PARTICULAR PURPOSE NONINFRINGEMENT. EVENT SHALL AUTHORS COPYRIGHT HOLDERS LIABLE CLAIM, DAMAGES LIABILITY, WHETHER ACTION CONTRACT, TORT OTHERWISE, ARISING , CONNECTION SOFTWARE USE DEALINGS SOFTWARE.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"background","dir":"Articles","previous_headings":"","what":"Background","title":"Introduction to aorsf","text":"oblique random forest (RF) extension traditional (axis-based) RF. Instead using single variable split data grow new branches, trees oblique RF use weighted combination multiple variables.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"oblique-rfs-for-survival-classification-and-regression","dir":"Articles","previous_headings":"","what":"Oblique RFs for survival, classification, and regression","title":"Introduction to aorsf","text":"purpose aorsf (‘’ short accelerated) provide unifying framework fit oblique RFs can scale adequately large data sets. fastest algorithms available package used default often equivalent prediction accuracy computational approaches. Everything aorsf begins orsf() function. begin oblique RF survival using pbc_orsf data. Note n_tree 5 convenience examples, >= 500 practice. Next, oblique RF classification using penguins_orsf data: regression, use penguins data switch outcome: may notice first input aorsf data. design choice makes easier use orsf pipes (.e., %>% |>). instance,","code":"library(aorsf) # An oblique survival RF pbc_fit <- orsf(data = pbc_orsf, n_tree = 5, formula = Surv(time, status) ~ . - id) pbc_fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 21 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.76 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> ----------------------------------------- # An oblique classification RF penguin_fit <- orsf(data = penguins_orsf, n_tree = 5, formula = species ~ .) penguin_fit #> ---------- Oblique random classification forest #> #> Linear combinations: Accelerated Logistic regression #> N observations: 333 #> N classes: 3 #> N trees: 5 #> N predictors total: 7 #> N predictors per node: 3 #> Average leaves per tree: 5.8 #> Min observations in leaf: 5 #> OOB stat value: 0.99 #> OOB stat type: AUC-ROC #> Variable importance: anova #> #> ----------------------------------------- # An oblique regression RF bill_fit <- orsf(data = penguins_orsf, n_tree = 5, formula = bill_length_mm ~ .) bill_fit #> ---------- Oblique random regression forest #> #> Linear combinations: Accelerated Linear regression #> N observations: 333 #> N trees: 5 #> N predictors total: 7 #> N predictors per node: 3 #> Average leaves per tree: 50.8 #> Min observations in leaf: 5 #> OOB stat value: 0.78 #> OOB stat type: RSQ #> Variable importance: anova #> #> ----------------------------------------- library(dplyr) pbc_fit <- pbc_orsf |> select(-id) |> orsf(formula = Surv(time, status) ~ ., n_tree = 5)"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"interpretation","dir":"Articles","previous_headings":"","what":"Interpretation","title":"Introduction to aorsf","text":"aorsf includes several functions dedicated interpretation ORSFs, estimation partial dependence variable importance.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"variable-importance","dir":"Articles","previous_headings":"Interpretation","what":"Variable importance","title":"Introduction to aorsf","text":"multiple methods compute variable importance, can applied type oblique forest. compute negation importance, ORSF multiplies coefficient variable -1 re-computes --sample (sometimes referred --bag) accuracy ORSF model. can also compute variable importance using permutation, classical approach noises predictor assigned resulting degradation prediction accuracy importance predictor. faster alternative permutation negation importance ANOVA importance, computes proportion times variable obtains low p-value (p < 0.01) forest grown.","code":"orsf_vi_negate(pbc_fit) #> copper bili ast stage albumin protime #> 0.116520792 0.048724909 0.035613213 0.024345471 0.021060515 0.020984542 #> sex spiders age edema ascites chol #> 0.020266760 0.017507511 0.014007382 0.010108835 0.006596406 0.005373518 #> trig hepato platelet alk.phos trt #> 0.002588621 0.001477129 -0.002477502 -0.003196011 -0.015360657 orsf_vi_permute(penguin_fit) #> bill_length_mm body_mass_g bill_depth_mm flipper_length_mm #> 0.266091492 0.096949736 0.070062245 0.039317030 #> island sex year #> 0.026172875 0.013229418 -0.001438192 orsf_vi_anova(bill_fit) #> species sex island body_mass_g #> 0.36990596 0.20408163 0.17790702 0.10084034 #> flipper_length_mm bill_depth_mm year #> 0.08943089 0.04687500 0.02654867"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"partial-dependence-pd","dir":"Articles","previous_headings":"Interpretation","what":"Partial dependence (PD)","title":"Introduction to aorsf","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. PD, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"individual-conditional-expectations-ice","dir":"Articles","previous_headings":"Interpretation","what":"Individual conditional expectations (ICE)","title":"Introduction to aorsf","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. ICE, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"what-about-the-original-orsf","dir":"Articles","previous_headings":"","what":"What about the original ORSF?","title":"Introduction to aorsf","text":"original ORSF (.e., obliqueRSF) used glmnet find linear combinations inputs. aorsf allows users implement approach using orsf_control_survival(method = 'net') function: net forests fit lot faster original ORSF function obliqueRSF. However, net forests still much slower cph ones.","code":"orsf_net <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, control = orsf_control_survival(method = 'net'))"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"aorsf-and-other-machine-learning-software","dir":"Articles","previous_headings":"","what":"aorsf and other machine learning software","title":"Introduction to aorsf","text":"unique feature aorsf fast algorithms fit ORSF ensembles. RLT obliqueRSF fit oblique random survival forests, aorsf faster. ranger randomForestSRC fit survival forests, neither package supports oblique splitting. obliqueRF fits oblique random forests classification regression, survival. PPforest fits oblique random forests classification survival. Note: default prediction behavior aorsf models produce predicted risk specific prediction horizon, default ranger randomForestSRC. think change future, computing time independent predictions aorsf helpful.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"learning-more","dir":"Articles","previous_headings":"","what":"Learning more","title":"Introduction to aorsf","text":"aorsf began dedicated package oblique random survival forests, papers published far focused survival analysis risk prediction. However, routines regression classification oblique RFs aorsf high overlap survival ones. See orsf details oblique random survival forests. see JCGS paper details algorithms used specifically aorsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"go-faster","dir":"Articles","previous_headings":"","what":"Go faster","title":"Tips to speed up computation","text":"Analyses can slow crawl models need hours run. article find tricks prevent bottleneck using orsf().","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"dont-specify-a-control","dir":"Articles","previous_headings":"","what":"Don’t specify a control","title":"Tips to speed up computation","text":"default control orsf() NULL , unspecified, orsf() pick fastest possible control depending type forest grown. default control run-time compared approaches can striking. example:","code":"time_fast <- system.time( expr = orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5) ) time_net <- system.time( expr = orsf(pbc_orsf, formula = time+status~. -id, control = orsf_control_survival(method = 'net'), n_tree = 5) ) # control_fast() is much faster time_net['elapsed'] / time_fast['elapsed'] #> elapsed #> 49.28571"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"use-n_thread","dir":"Articles","previous_headings":"","what":"Use n_thread","title":"Tips to speed up computation","text":"n_thread argument uses multi-threading run aorsf functions parallel possible. know many threads want, e.g. want exactly 5, just say n_thread = 5. aren’t sure many threads available want use many can, say n_thread = 0 aorsf figure number . R single threaded language, multi-threading applied orsf() needs call R functions C++, occurs customized R function used find linear combination variables compute prediction accuracy.","code":"# automatically pick number of threads based on amount available orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5, n_thread = 0) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 19.8 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.77 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"do-less","dir":"Articles","previous_headings":"","what":"Do less","title":"Tips to speed up computation","text":"defaults orsf() can adjusted make run faster: set n_retry 0 instead 3 (default) set oobag_pred_type ‘none’ instead ‘surv’ (default) set ‘importance’ ‘none’ instead ‘anova’ (default) increase split_min_events, split_min_obs, leaf_min_events, leaf_min_obs make trees stop growing sooner increase split_min_stat make trees stop growing sooner Applying tips: default values make orsf() run slower, also usually make predictions accurate make fit easier interpret.","code":"orsf(pbc_orsf, formula = time+status~., n_thread = 0, n_tree = 5, n_retry = 0, oobag_pred_type = 'none', importance = 'none', split_min_events = 20, leaf_min_events = 10, split_min_stat = 10) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 18 #> N predictors per node: 5 #> Average leaves per tree: 6.2 #> Min observations in leaf: 5 #> Min events in leaf: 10 #> OOB stat value: none #> OOB stat type: none #> Variable importance: none #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"show-progress","dir":"Articles","previous_headings":"","what":"Show progress","title":"Tips to speed up computation","text":"Setting verbose_progress = TRUE doesn’t make anything run faster, can help make feel like things running less slow.","code":"verbose_fit <- orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5, verbose_progress = TRUE) #> Growing trees: 100%. #> Computing predictions: 100%."},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"out-of-bag-data","dir":"Articles","previous_headings":"","what":"Out-of-bag data","title":"Out-of-bag predictions and evaluation","text":"random forests, tree grown bootstrapped version training set. bootstrap samples selected replacement, bootstrapped training set contains two-thirds instances original training set. ‘--bag’ data instances bootstrapped training set.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"out-of-bag-predictions-and-error","dir":"Articles","previous_headings":"","what":"Out-of-bag predictions and error","title":"Out-of-bag predictions and evaluation","text":"tree random forest can make predictions --bag data, --bag predictions can aggregated make ensemble --bag prediction. Since --bag data used grow tree, accuracy ensemble --bag predictions approximate generalization error random forest. --bag prediction error plays central role routines estimate variable importance, e.g. negation importance. Let’s fit oblique random survival forest plot distribution ensemble --bag predictions. surprisingly, survival predictions 0 1. Next, let’s check --bag accuracy fit: --bag estimate 1 (default method evaluate --bag predictions) 0.77541.","code":"fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, oobag_pred_type = 'surv', n_tree = 5, oobag_pred_horizon = 2000) hist(fit$pred_oobag, main = 'Ensemble out-of-bag survival predictions at t=3,500') # what function is used to evaluate out-of-bag predictions? fit$eval_oobag$stat_type #> [1] 1 # what is the output from this function? fit$eval_oobag$stat_values #> [,1] #> [1,] 0.77541"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"monitoring-out-of-bag-error","dir":"Articles","previous_headings":"","what":"Monitoring out-of-bag error","title":"Out-of-bag predictions and evaluation","text":"--bag data set contains one-third training set, --bag error estimate usually converges stable value trees added forest. want monitor convergence --bag error oblique random survival forest, can set oobag_eval_every compute --bag error every oobag_eval_every tree. example, let’s compute --bag error fitting tree forest 50 trees: general, least 500 trees recommended random forest fit. ’re just using 10 illustration.","code":"fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, n_tree = 20, tree_seeds = 2, oobag_pred_type = 'surv', oobag_pred_horizon = 2000, oobag_eval_every = 1) plot( x = seq(1, 20, by = 1), y = fit$eval_oobag$stat_values, main = 'Out-of-bag C-statistic computed after each new tree is grown.', xlab = 'Number of trees grown', ylab = fit$eval_oobag$stat_type ) lines(x=seq(1, 20), y = fit$eval_oobag$stat_values)"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"user-supplied-out-of-bag-evaluation-functions","dir":"Articles","previous_headings":"","what":"User-supplied out-of-bag evaluation functions","title":"Out-of-bag predictions and evaluation","text":"cases, may want control --bag error estimated. example, let’s use Brier score SurvMetrics package: two ways apply function compute --bag error. First, can apply function --bag survival predictions stored ‘aorsf’ objects, e.g: Second, can pass function orsf(), used place Harrell’s C-statistic:","code":"oobag_brier_surv <- function(y_mat, w_vec, s_vec){ # output is numeric vector of length 1 as.numeric( SurvMetrics::Brier( object = Surv(time = y_mat[, 1], event = y_mat[, 2]), pre_sp = s_vec, # t_star in Brier() should match oob_pred_horizon in orsf() t_star = 2000 ) ) } oobag_brier_surv(y_mat = pbc_orsf[,c('time', 'status')], s_vec = fit$pred_oobag) #> [1] 0.117498 fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, n_tree = 20, tree_seeds = 2, oobag_pred_horizon = 2000, oobag_fun = oobag_brier_surv, oobag_eval_every = 1) plot( x = seq(1, 20, by = 1), y = fit$eval_oobag$stat_values, main = 'Out-of-bag error computed after each new tree is grown.', sub = 'For the Brier score, lower values indicate more accurate predictions', xlab = 'Number of trees grown', ylab = \"Brier score\" ) lines(x=seq(1, 20), y = fit$eval_oobag$stat_values)"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"specific-instructions-on-user-supplied-functions","dir":"Articles","previous_headings":"User-supplied out-of-bag evaluation functions","what":"Specific instructions on user-supplied functions","title":"Out-of-bag predictions and evaluation","text":"User-supplied functions must: exactly three arguments named y_mat, w_vec, s_vec. return numeric output length 1 either conditions true, error occur. simple test make sure user-supplied function work aorsf package :","code":"# Helper code to make sure your oobag_fun function will work with aorsf # time and status values test_time <- seq(from = 1, to = 5, length.out = 100) test_status <- rep(c(0,1), each = 50) # y-matrix is presumed to contain time and status (with column names) y_mat <- cbind(time = test_time, status = test_status) # s_vec is presumed to be a vector of survival probabilities s_vec <- seq(0.9, 0.1, length.out = 100) # see 1 in the checklist above names(formals(oobag_brier_surv)) == c(\"y_mat\", \"w_vec\", \"s_vec\") #> [1] TRUE TRUE TRUE test_output <- oobag_brier_surv(y_mat = y_mat, w_vec = w_vec, s_vec = s_vec) # test output should be numeric is.numeric(test_output) #> [1] TRUE # test_output should be a numeric value of length 1 length(test_output) == 1 #> [1] TRUE"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"notes","dir":"Articles","previous_headings":"","what":"Notes","title":"Out-of-bag predictions and evaluation","text":"evaluating --bag error: oobag_pred_horizon input orsf() determines prediction horizon --bag predictions. prediction horizon needs specified evaluate prediction accuracy cases, examples . sure check case using functions, , sure oobag_pred_horizon matches prediction horizon used custom function. functions expect predicted risk (.e., 1 - predicted survival), others expect predicted survival. cases, also able use function whatsoever compute --bag prediction error estimating negation permutation importance, assuming passes tests . Unfortunately, exception riskRegression::Score(), one favorites. experimented riskRegression::Score found work try run C++. sure case.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"partial-dependence-pd","dir":"Articles","previous_headings":"","what":"Partial dependence (PD)","title":"PD and ICE curves with ORSF","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. Begin fitting ORSF ensemble. Set prediction horizon 5 years fit ensemble aorsf function pass ensemble assume want compute predictions 5 years.","code":"library(aorsf) pred_horizon <- 365.25 * 5 set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, n_tree = 50, oobag_pred_horizon = pred_horizon) fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 150 #> N events: 52 #> N trees: 50 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 10.26 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.82 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"three-ways-to-compute-pd","dir":"Articles","previous_headings":"","what":"Three ways to compute PD","title":"PD and ICE curves with ORSF","text":"can compute PD three ways aorsf: using -bag predictions training data using --bag predictions training data using predictions new set data -bag PD indicates relationships model learned training. helpful goal interpret model. --bag PD indicates relationships model learned training using --bag data simulates application model new data. want test model’s reliability fairness new data don’t access large testing set. new data PD shows model predicts outcomes observations seen. helpful want test model’s reliability fairness. Let’s re-fit ORSF model available data proceeding next sections.","code":"pd_inb <- orsf_pd_inb(fit, pred_spec = list(bili = 1:5)) pd_inb #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.2092270 0.01550072 0.1062397 0.7518187 #> 2: 1826.25 2 0.2398837 0.02728744 0.1317005 0.7802210 #> 3: 1826.25 3 0.2714311 0.04341724 0.1782770 0.7963900 #> 4: 1826.25 4 0.3253141 0.08765314 0.2433043 0.8281836 #> 5: 1826.25 5 0.3567976 0.11872654 0.2674730 0.8405402 pd_oob <- orsf_pd_oob(fit, pred_spec = list(bili = 1:5)) pd_oob #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.2118379 0.01054286 0.1402358 0.7136371 #> 2: 1826.25 2 0.2444647 0.02511806 0.1799592 0.7557463 #> 3: 1826.25 3 0.2744771 0.03471440 0.1933003 0.7984586 #> 4: 1826.25 4 0.3372186 0.07777410 0.2748979 0.8174482 #> 5: 1826.25 5 0.3687054 0.09913391 0.3112299 0.8486331 pd_test <- orsf_pd_new(fit, new_data = pbc_orsf_test, pred_spec = list(bili = 1:5)) pd_test #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.2568011 0.01602679 0.2090503 0.7726113 #> 2: 1826.25 2 0.2890090 0.03589477 0.2531100 0.8002019 #> 3: 1826.25 3 0.3189690 0.05372495 0.2802965 0.7979415 #> 4: 1826.25 4 0.3713392 0.10139677 0.3347816 0.8157019 #> 5: 1826.25 5 0.4036832 0.12768657 0.3760068 0.8264211 set.seed(329730) fit <- orsf(pbc_orsf, Surv(time, status) ~ . -id, n_tree = 50, oobag_pred_horizon = pred_horizon)"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"one-variable-one-horizon","dir":"Articles","previous_headings":"","what":"One variable, one horizon","title":"PD and ICE curves with ORSF","text":"Computing PD single variable straightforward: output shows expected predicted mortality risk men substantially higher women 5 years baseline.","code":"pd_sex <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\"))) pd_sex #> pred_horizon sex mean lwr medn upr #> 1: 1826.25 m 0.3564520 0.02967837 0.2882201 0.9239640 #> 2: 1826.25 f 0.3143578 0.01025241 0.1993324 0.9417115"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"one-variable-moving-horizon","dir":"Articles","previous_headings":"","what":"One variable, moving horizon","title":"PD and ICE curves with ORSF","text":"effect predictor varies time? PD can show . inspection, can see males higher risk females difference risk grows time. can also seen viewing ratio expected risk time:","code":"pd_sex_tv <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\")), pred_horizon = seq(365, 365*5)) ggplot(pd_sex_tv, aes(x = pred_horizon, y = mean, color = sex)) + geom_line() + labs(x = 'Time since baseline', y = 'Expected risk') library(data.table) ratio_tv <- pd_sex_tv[ , .(ratio = mean[sex == 'm'] / mean[sex == 'f']), by = pred_horizon ] ggplot(ratio_tv, aes(x = pred_horizon, y = ratio)) + geom_line(color = 'grey') + geom_smooth(color = 'black', se = FALSE) + labs(x = 'time since baseline', y = 'ratio in expected risk for males versus females') #> `geom_smooth()` using method = 'gam' and formula = 'y ~ s(x, bs = \"cs\")'"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"multiple-variables-marginally","dir":"Articles","previous_headings":"","what":"Multiple variables, marginally","title":"PD and ICE curves with ORSF","text":"want compute PD marginally multiple variables, just list variable values pred_spec specify expand_grid = FALSE. Now tedious wanted variables? bet. ’s made function . bonus, printed output sorted least important variables. ’s easy enough turn ‘summary’ object data.table downstream plotting tables.","code":"pd_two_vars <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\"), bili = 1:5), expand_grid = FALSE) pd_two_vars #> pred_horizon variable value level mean lwr medn upr #> 1: 1826.25 sex NA m 0.3564520 0.02967837 0.2882201 0.9239640 #> 2: 1826.25 sex NA f 0.3143578 0.01025241 0.1993324 0.9417115 #> 3: 1826.25 bili 1 0.2421478 0.01205421 0.1771471 0.8585054 #> 4: 1826.25 bili 2 0.2992784 0.03112816 0.2207990 0.9007556 #> 5: 1826.25 bili 3 0.3536322 0.06013201 0.2783839 0.9178955 #> 6: 1826.25 bili 4 0.3941406 0.06750719 0.3290965 0.9373161 #> 7: 1826.25 bili 5 0.4239507 0.09721327 0.3734445 0.9406612 pd_smry <- orsf_summarize_uni(fit, n_variables = 4) pd_smry #> #> -- ascites (VI Rank: 1) ------------------------ #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3118350 0.2056567 0.05505108 0.5253575 #> 1 0.4888042 0.4291607 0.28408656 0.6800329 #> #> -- bili (VI Rank: 2) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.80 0.2348378 0.1676975 0.04366000 0.3629356 #> 1.40 0.2656862 0.1909136 0.06576283 0.4016281 #> 3.52 0.3728350 0.3032686 0.15444819 0.5579918 #> #> -- edema (VI Rank: 3) -------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3058974 0.1993324 0.05505108 0.5337264 #> 0.5 0.4021478 0.3710209 0.17711696 0.6120340 #> 1 0.4018115 0.3538034 0.18682381 0.6141621 #> #> -- copper (VI Rank: 4) ------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 42.8 0.2602508 0.1549015 0.04663376 0.4235054 #> 74.0 0.2831359 0.1713812 0.05519991 0.4734346 #> 129 0.3434663 0.2590931 0.10631260 0.5546865 #> #> Predicted risk at time t = 1826.25 for top 4 predictors head(as.data.table(pd_smry)) #> variable importance Value Mean Median 25th % 75th % #> 1: ascites 0.5225225 0 0.3118350 0.2056567 0.05505108 0.5253575 #> 2: ascites 0.5225225 1 0.4888042 0.4291607 0.28408656 0.6800329 #> 3: bili 0.3807339 0.80 0.2348378 0.1676975 0.04366000 0.3629356 #> 4: bili 0.3807339 1.40 0.2656862 0.1909136 0.06576283 0.4016281 #> 5: bili 0.3807339 3.52 0.3728350 0.3032686 0.15444819 0.5579918 #> 6: edema 0.2965828 0 0.3058974 0.1993324 0.05505108 0.5337264 #> pred_horizon level #> 1: 1826.25 0 #> 2: 1826.25 1 #> 3: 1826.25 #> 4: 1826.25 #> 5: 1826.25 #> 6: 1826.25 0"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"multiple-variables-jointly","dir":"Articles","previous_headings":"","what":"Multiple variables, jointly","title":"PD and ICE curves with ORSF","text":"PD can show expected value model’s predictions function specific predictor, function multiple predictors. instance, can estimate predicted risk joint function bili, edema, trt: inspection, model’s predictions indicate slightly lower risk placebo group, seem change much different values bili edema. clear increase predicted risk higher levels edema higher levels bili slope predicted risk function bili appears highest among patients edema 0.5. effect bili modified edema 0.5? quick sanity check coxph suggests .","code":"pred_spec = list(bili = seq(1, 5, length.out = 20), edema = levels(pbc_orsf_train$edema), trt = levels(pbc_orsf$trt)) pd_bili_edema <- orsf_pd_oob(fit, pred_spec) library(ggplot2) ggplot(pd_bili_edema, aes(x = bili, y = medn, col = trt, linetype = edema)) + geom_line() + labs(y = 'Expected predicted risk') library(survival) pbc_orsf$edema_05 <- ifelse(pbc_orsf$edema == '0.5', 'yes', 'no') fit_cph <- coxph(Surv(time,status) ~ edema_05 * bili, data = pbc_orsf) anova(fit_cph) #> Analysis of Deviance Table #> Cox model: response is Surv(time, status) #> Terms added sequentially (first to last) #> #> loglik Chisq Df Pr(>|Chi|) #> NULL -550.19 #> edema_05 -546.83 6.7248 1 0.009508 ** #> bili -513.59 66.4689 1 3.555e-16 *** #> edema_05:bili -510.54 6.1112 1 0.013433 * #> --- #> Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"individual-conditional-expectations-ice","dir":"Articles","previous_headings":"","what":"Individual conditional expectations (ICE)","title":"PD and ICE curves with ORSF","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. Just like PD, can compute ICE using -bag, --bag, testing data, principles apply. ’ll use --bag estimates .","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"visualizing-ice-curves","dir":"Articles","previous_headings":"","what":"Visualizing ICE curves","title":"PD and ICE curves with ORSF","text":"Inspecting ICE curves observation can help identify whether heterogeneity model’s predictions. .e., effect variable follow pattern data, groups variable impacts risk differently? going turn boundary checking orsf_ice_oob setting boundary_checks = FALSE, allow generate ICE curves go beyond 90th percentile bili. id_variable identifier current value variable(s) data. redundant one variable, helpful multiple variables. id_row identifier observation original data. used group observation’s predictions together plots. plots, helpful scale ICE data. subtract initial value predicted risk (.e., bili = 1) observation’s conditional expectation values. , Every curve start 0 plot shows change predicted risk function bili. Now can visualize curves. inspection figure, individual slopes cluster around overall trend - Good! small number individual slopes appear flat. may helpful investigate .","code":"pred_spec <- list(bili = seq(1, 10, length.out = 25)) ice_oob <- orsf_ice_oob(fit, pred_spec, boundary_checks = FALSE) ice_oob #> id_variable id_row pred_horizon bili pred #> 1: 1 1 1826.25 1 0.8743469 #> 2: 1 2 1826.25 1 0.8733466 #> 3: 1 3 1826.25 1 0.7506376 #> 4: 1 4 1826.25 1 0.8355820 #> 5: 1 5 1826.25 1 0.5365481 #> --- #> 6896: 25 272 1826.25 10 0.5260801 #> 6897: 25 273 1826.25 10 0.4911584 #> 6898: 25 274 1826.25 10 0.1958302 #> 6899: 25 275 1826.25 10 0.6267285 #> 6900: 25 276 1826.25 10 0.2922190 ice_oob[, pred_subtract := rep(pred[id_variable==1], times=25)] ice_oob[, pred := pred - pred_subtract] library(ggplot2) ggplot(ice_oob, aes(x = bili, y = pred, group = id_row)) + geom_line(alpha = 0.15) + labs(y = 'Change in predicted risk') + geom_smooth(se = FALSE, aes(group = 1)) #> `geom_smooth()` using method = 'gam' and formula = 'y ~ s(x, bs = \"cs\")'"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"limitations-of-pd","dir":"Articles","previous_headings":"","what":"Limitations of PD","title":"PD and ICE curves with ORSF","text":"Partial dependence number known limitations assumptions users aware (see Hooker, 2021). particular, partial dependence less intuitive >2 predictors examined jointly, assumed feature(s) partial dependence computed correlated features (likely true many cases). Accumulated local effect plots can used (see ) case feature independence valid assumption.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"references","dir":"Articles","previous_headings":"","what":"References","title":"PD and ICE curves with ORSF","text":"Giles Hooker, Lucas Mentch, Siyu Zhou. Unrestricted Permutation forces Extrapolation: Variable Importance Requires least One Model, Free Variable Importance. arXiv e-prints 2021 Oct; arXiv-1905. URL: https://doi.org/10.48550/arXiv.1905.03151","code":""},{"path":"https://bcjaeger.github.io/aorsf/authors.html","id":null,"dir":"","previous_headings":"","what":"Authors","title":"Authors and Citation","text":"Byron Jaeger. Author, maintainer. Nicholas Pajewski. Contributor. Sawyer Welden. Contributor. Christopher Jackson. Reviewer. Marvin Wright. Reviewer. Lukas Burk. Reviewer.","code":""},{"path":"https://bcjaeger.github.io/aorsf/authors.html","id":"citation","dir":"","previous_headings":"","what":"Citation","title":"Authors and Citation","text":"Jaeger et al. (2022). aorsf: R package supervised learning using oblique random survival forest. Journal Open Source Software, 7(77), 4705. https://doi.org/10.21105/joss.04705. Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics. 2023 Aug 3:1-6. Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique Random Survival Forests. Annals Applied Statistics. 13(3): 1847-1883. URL https://doi.org/10.1214/19-AOAS1261 DOI: 10.1214/19-AOAS1261","code":"@Article{, title = {aorsf: An R package for supervised learning using the oblique random survival forest}, author = {Byron C. Jaeger and Sawyer Welden and Kristin Lenoir and Nicholas M. Pajewski}, journal = {Journal of Open Source Software}, year = {2022}, volume = {7}, number = {77}, pages = {4705}, url = {https://doi.org/10.21105/joss.04705}, } @Article{, title = {Accelerated and interpretable oblique random survival forests}, author = {Byron C. Jaeger and Sawyer Welden and Kristin Lenoir and Jaime L. Speiser and Matthew W. Segar and Ambarish Pandey and Nicholas M. Pajewski}, journal = {Journal of Computational and Graphical Statistics}, year = {2023}, url = {https://doi.org/10.1080/10618600.2023.2231048}, } @Article{, title = {Oblique Random Survival Forests}, author = {Byron C. Jaeger and D. Leann Long and Dustin M. Long and Mario Sims and Jeff M. Szychowski and Yuan-I Min and Leslie A. Mcclure and George Howard and Noah Simon}, journal = {Annals of Applied Statistics}, year = {2019}, volume = {13}, number = {3}, pages = {1847--1883}, url = {https://doi.org/10.1214/19-AOAS1261}, }"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"aorsf-","dir":"","previous_headings":"","what":"Accelerated Oblique Random Survival Forests","title":"Accelerated Oblique Random Survival Forests","text":"Fit, interpret, make predictions oblique random forests (RFs).","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"why-aorsf","dir":"","previous_headings":"","what":"Why aorsf?","title":"Accelerated Oblique Random Survival Forests","text":"Hundreds times faster software oblique RFs.1 Accurate predictions.2 Computes partial dependence variable importance.2 Intuitive API formula based interface. Extensive input checks informative error messages.","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"installation","dir":"","previous_headings":"","what":"Installation","title":"Accelerated Oblique Random Survival Forests","text":"can install aorsf CRAN using can install development version aorsf GitHub :","code":"install.packages(\"aorsf\") # install.packages(\"remotes\") remotes::install_github(\"ropensci/aorsf\")"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"what-is-an-oblique-decision-tree","dir":"","previous_headings":"","what":"What is an oblique decision tree?","title":"Accelerated Oblique Random Survival Forests","text":"Decision trees developed splitting set training data two new subsets, goal similarity within new subsets . splitting process repeated resulting subsets data stopping criterion met. new subsets data formed based single predictor, decision tree said axis-based splits data appear perpendicular axis predictor. linear combinations variables used instead single variable, tree oblique splits data neither parallel right angle axis. Figure: Decision trees classification axis-based splitting (left) oblique splitting (right). Cases orange squares; controls purple circles. trees partition predictor space defined variables X1 X2, oblique splits better job separating two classes.","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"examples","dir":"","previous_headings":"","what":"Examples","title":"Accelerated Oblique Random Survival Forests","text":"orsf() function can fit several types oblique RFs. personal favorite accelerated oblique survival RF great combination prediction accuracy computational efficiency (see JCGS paper).2","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5)"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"inspect","dir":"","previous_headings":"Examples","what":"Inspect","title":"Accelerated Oblique Random Survival Forests","text":"Printing output orsf() give information descriptive statistics ensemble. See print.orsf_fit description line printed output. See orsf examples details controlling ORSF ensemble fits using prediction modeling workflows.","code":"fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 150 #> N events: 52 #> N trees: 500 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 10.198 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.84 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"variable-importance","dir":"","previous_headings":"Examples","what":"Variable importance","title":"Accelerated Oblique Random Survival Forests","text":"importance individual variables can estimated three ways using aorsf: negation2: variable assessed separately multiplying variable’s coefficients -1 determining much model’s performance changes. worse model’s performance negating coefficients given variable, important variable. technique promising b/c require permutation emphasizes variables larger coefficients linear combinations, also relatively new hasn’t studied much permutation importance. See Jaeger, (2023) details technique. permutation: variable assessed separately randomly permuting variable’s values determining much model’s performance changes. worse model’s performance permuting values given variable, important variable. technique flexible, intuitive, frequently used. also several known limitations analysis variance (ANOVA)3: p-value computed coefficient linear combination variables decision tree. Importance individual predictor variable proportion times p-value coefficient < 0.01. technique efficient computationally, may effective permutation negation terms selecting signal noise variables. See Menze, 2011 details technique. can supply R function estimate --bag error using negation permutation importance (see oob vignette)","code":"orsf_vi_negate(fit) #> bili sex copper stage age #> 0.1152040355 0.0550384871 0.0346540451 0.0342394602 0.0212811906 #> ast protime hepato chol albumin #> 0.0189147173 0.0179113542 0.0151705980 0.0111316204 0.0107352274 #> edema ascites spiders trig alk.phos #> 0.0101276579 0.0097629480 0.0043991365 0.0031611867 0.0030722039 #> trt platelet #> 0.0024625381 -0.0005569787 orsf_vi_permute(fit) #> bili stage copper age sex #> 0.0487808290 0.0180334035 0.0178325263 0.0124277288 0.0111897854 #> ast hepato edema protime ascites #> 0.0111084077 0.0095618267 0.0082559886 0.0082473977 0.0078725536 #> albumin chol spiders alk.phos trig #> 0.0073437819 0.0057881417 0.0033941136 0.0028194077 0.0019933887 #> platelet trt #> -0.0002101522 -0.0016860907 orsf_vi_anova(fit) #> bili ascites edema sex copper stage age #> 0.48004315 0.43536122 0.38654727 0.31024531 0.29493088 0.27168950 0.26673985 #> hepato ast albumin protime chol spiders trig #> 0.21492921 0.20151679 0.18771331 0.18352060 0.14617169 0.13932292 0.13620489 #> alk.phos platelet trt #> 0.09051254 0.07011494 0.06179067"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"partial-dependence-pd","dir":"","previous_headings":"Examples","what":"Partial dependence (PD)","title":"Accelerated Oblique Random Survival Forests","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. summary function, orsf_summarize_uni(), computes PD many variables ask , using sensible values. PD, see vignette","code":"orsf_summarize_uni(fit, n_variables = 2) #> #> -- bili (VI Rank: 1) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.70 0.2099215 0.1262483 0.05057666 0.3160044 #> 1.30 0.2244830 0.1472311 0.06196578 0.3369922 #> 3.18 0.2932736 0.2263620 0.11896921 0.4424589 #> #> -- ascites (VI Rank: 2) ------------------------ #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.2630294 0.1490837 0.0613327 0.4186542 #> 1 0.3924844 0.3053928 0.2222267 0.5253717 #> #> Predicted risk at time t = 1826.25 for top 2 predictors"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"individual-conditional-expectations-ice","dir":"","previous_headings":"Examples","what":"Individual conditional expectations (ICE)","title":"Accelerated Oblique Random Survival Forests","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. ICE, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"comparison-to-existing-software","dir":"","previous_headings":"","what":"Comparison to existing software","title":"Accelerated Oblique Random Survival Forests","text":"Comparisons aorsf existing software presented JCGS paper. paper: describes aorsf detail summary procedures used tree fitting algorithm runs general benchmark comparing aorsf obliqueRSF several learners reports prediction accuracy computational efficiency learners. runs simulation study comparing variable importance techniques ORSFs, axis based RSFs, boosted trees. reports probability variable importance technique rank relevant variable higher importance irrelevant variable. hands-comparison aorsf R packages provided orsf examples","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"references","dir":"","previous_headings":"","what":"References","title":"Accelerated Oblique Random Survival Forests","text":"Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique random survival forests. Annals applied statistics 2019 Sep; 13(3):1847-83. DOI: 10.1214/19-AOAS1261 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"funding","dir":"","previous_headings":"","what":"Funding","title":"Accelerated Oblique Random Survival Forests","text":"developers aorsf receive financial support Center Biomedical Informatics, Wake Forest University School Medicine. also receive support National Center Advancing Translational Sciences National Institutes Health Award Number UL1TR001420. content solely responsibility authors necessarily represent official views National Institutes Health.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/aorsf-package.html","id":null,"dir":"Reference","previous_headings":"","what":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","title":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","text":"Fit, interpret, make predictions oblique random survival forests. Oblique decision trees notoriously slow compared axis based counterparts, 'aorsf' runs fast faster axis-based decision tree algorithms right-censored time--event outcomes. Methods accelerate interpret oblique random survival forest described Jaeger et al., (2023) doi:10.1080/10618600.2023.2231048 .","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/aorsf-package.html","id":"author","dir":"Reference","previous_headings":"","what":"Author","title":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","text":"Maintainer: Byron Jaeger bjaeger@wakehealth.edu (ORCID) contributors: Nicholas Pajewski [contributor] Sawyer Welden swelden@wakehealth.edu [contributor] Christopher Jackson chris.jackson@mrc-bsu.cam.ac.uk [reviewer] Marvin Wright [reviewer] Lukas Burk [reviewer]","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"Coerce to data.table — as.data.table.orsf_summary_uni","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"Convert 'orsf_summary' object data.table object.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"","code":"# S3 method for orsf_summary_uni as.data.table(x, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"x object class 'orsf_summary_uni' ... used","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"data.table","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"","code":"library(data.table) object <- orsf(pbc_orsf, Surv(time, status) ~ . - id) smry <- orsf_summarize_uni(object, n_variables = 3) as.data.table(smry) #> variable importance value mean medn lwr upr #> 1: ascites 0.4881423 0 0.3069916 0.1979830 0.06346234 0.5090317 #> 2: ascites 0.4881423 1 0.4605003 0.3949375 0.26487511 0.6423456 #> 3: bili 0.4264570 0.80 0.2400703 0.1534410 0.05657566 0.3841292 #> 4: bili 0.4264570 1.40 0.2611113 0.1718908 0.07259064 0.4205876 #> 5: bili 0.4264570 3.52 0.3726536 0.3112669 0.17445109 0.5458866 #> 6: copper 0.3144330 42.8 0.2618979 0.1664112 0.05742858 0.4157278 #> 7: copper 0.3144330 74.0 0.2835549 0.1859239 0.06741613 0.4535328 #> 8: copper 0.3144330 129 0.3390422 0.2605582 0.11054817 0.5398980 #> pred_horizon level #> 1: 1788 0 #> 2: 1788 1 #> 3: 1788 #> 4: 1788 #> 5: 1788 #> 6: 1788 #> 7: 1788 #> 8: 1788 "},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Oblique Random Survival Forest (ORSF) — orsf","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Fit oblique random survival forest","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"","code":"orsf( data, formula, control = NULL, weights = NULL, n_tree = 500, n_split = 5, n_retry = 3, n_thread = 1, mtry = NULL, sample_with_replacement = TRUE, sample_fraction = 0.632, leaf_min_events = 1, leaf_min_obs = 5, split_rule = NULL, split_min_events = 5, split_min_obs = 10, split_min_stat = NULL, oobag_pred_type = NULL, oobag_pred_horizon = NULL, oobag_eval_every = n_tree, oobag_fun = NULL, importance = \"anova\", importance_max_pvalue = 0.01, group_factors = TRUE, tree_seeds = NULL, attach_data = TRUE, no_fit = FALSE, na_action = \"fail\", verbose_progress = FALSE, ... ) orsf_train(object, attach_data = TRUE)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"data data.frame, tibble, data.table contains relevant variables. formula (formula) Two sided formula single outcome. terms right names predictor variables, symbol '.' may used indicate variables data except response. symbol '-' may also used indicate removal predictor. Details response vary depending forest type: Survival: response include time variable, followed status variable, may written inside call Surv (see examples). Classification: response single variable, variable type factor data. Regression: response single variable, variable typee double integer least 10 unique numeric values data. control (orsf_control) object returned one orsf_control functions: orsf_control_survival, orsf_control_classification, orsf_control_regression. NULL (default) use accelerated control, fastest available option. survival classification, Cox Logistic regression 1 iteration, regression ordinary least squares. weights (numeric vector) Optional. given, input length equal nrow(data) complete imputed data length equal nrow(na.omit(data)) na_action \"omit\". Values weights treated like replication weights, .e., value 2 thing 2 observations data, containing copy corresponding person's data. Use weights cautiously, orsf count number observations events prior growing node tree, higher values weights lead deeper trees. use input, highly recommended scale weights sum(weights) == nrow(data), help make tree depth consistent default weights = rep(1, nrow(data)) n_tree (integer) number trees grow. Default n_tree = 500. n_split (integer) number cut-points assessed splitting node decision trees. Default n_split = 5. n_retry (integer) node splittable, current linear combination inputs unable provide valid split, orsf try new linear combination based different set randomly selected predictors, n_retry times. Default n_retry = 3. Set n_retry = 0 prevent retries. n_thread (integer) number threads use growing trees, computing predictions, computing importance. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. mtry (integer) Number predictors randomly included candidates splitting node. default smallest integer greater square root number total predictors, .e., mtry = ceiling(sqrt(number predictors)) sample_with_replacement (logical) TRUE (default), observations sampled replacement -bag sample created decision tree. FALSE, observations sampled without replacement tree -bag sample containing sample_fraction% original sample. sample_fraction (double) proportion observations trees' -bag sample contain, relative number rows data. used sample_with_replacement FALSE. Default value 0.632. leaf_min_events (integer) minimum number events leaf node. Default leaf_min_events = 1 leaf_min_obs (integer) minimum number observations leaf node. Default leaf_min_obs = 5. split_rule (character) assess quality potential splitting rule node. Valid options survival : 'logrank' : log-rank test statistic (default). 'cstat' : Harrell's concordance statistic. classification, valid options : 'gini' : gini impurity (default) 'cstat' : area underneath ROC curve (AUC-ROC) regression, valid options : 'variance' : variance reduction (default) split_min_events (integer) minimum number events required node consider splitting . Default split_min_events = 5. input relevant survival trees. split_min_obs (integer) minimum number observations required node consider splitting . Default split_min_obs = 10. split_min_stat (double) minimum test statistic required split node. splits found statistic exceeding split_min_stat, given node either becomes leaf retry occurs (n_retry retries). Defaults 3.84 split_rule = 'logrank' 0.50 split_rule = 'cstat' (see first note ) 0.00 split_rule = 'gini' (see second note ) 0.00 split_rule = 'variance' Note 1 C-statistic splitting, C < 0.50, consider statistic value 1 - C allow good 'anti-predictive' splits. , C-statistic initially computed 0.1, considered 1 - 0.10 = 0.90. Note 2 Gini impurity, value 0 1 usually indicate best worst possible scores, respectively. make things simple avoid introducing split_max_stat input, flip values Gini impurity 1 0 indicate best worst possible scores, respectively. oobag_pred_type (character) type --bag predictions compute fitting ensemble. Valid options tree type: 'none' : compute --bag predictions 'leaf' : ID predicted leaf returned tree Valid options survival: 'risk' : probability event occurring oobag_pred_horizon (default). 'surv' : 1 - risk. 'chf' : cumulative hazard function oobag_pred_horizon. 'mort' : mortality, .e., number events expected observations training data identical given observation. Valid options classification: 'prob' : probability class (default) 'class' : class (.e., .max(prob)) Valid options regression: 'mean' : mean value (default) oobag_pred_horizon (numeric) numeric value indicating time used --bag predictions. Default median observed times, .e., oobag_pred_horizon = median(time). input relevant survival trees prediction type 'risk', 'surv', 'chf'. oobag_eval_every (integer) --bag performance ensemble checked every oobag_eval_every trees. , oobag_eval_every = 10, --bag performance checked growing 10th tree, 20th tree, . Default oobag_eval_every = n_tree. oobag_fun (function) used evaluating --bag prediction accuracy every oobag_eval_every trees. oobag_fun = NULL (default), evaluation statistic selected based tree type survival: Harrell's C-statistic (1982) classification: Area underneath ROC curve (AUC-ROC) regression: Traditional prediction R-squared use oobag_fun note following: oobag_fun three inputs: y_mat, w_vec, s_vec survival trees, y_mat two column matrix first column named 'time' second named 'status'. classification trees, y_mat matrix number columns = number distinct classes outcome. regression, y_mat matrix one column. s_vec numeric vector containing predictions oobag_fun return numeric output length 1 details, see --bag vignette. importance (character) Indicate method variable importance: 'none': variable importance computed. 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance details methods, see orsf_vi. importance_max_pvalue (double) relevant importance \"anova\". maximum p-value register positive case counting number times variable found 'significant' tree growth. Default 0.01, recommended Menze et al. group_factors (logical) relevant variable importance estimated. TRUE, importance factor variables reported overall aggregating importance individual levels factor. FALSE, importance individual factor levels returned. tree_seeds (integer vector) Optional. specified, random seeds set using values tree_seeds[] growing tree . Two forests grown number trees seeds exact --bag samples, making --bag error estimates forests comparable. NULL (default), seeds picked random. attach_data (logical) TRUE, copy training data attached output. required plan using functions like orsf_pd_oob orsf_summarize_uni interpret forest using training data. Default TRUE. no_fit (logical) TRUE, model fitting steps defined saved, training initiated. object returned can directly submitted orsf_train() long attach_data TRUE. na_action (character) happen data contains missing values (.e., NA values). Valid options : 'fail' : error thrown data contains NA values 'omit' : rows data incomplete data dropped 'impute_meanmode' : missing values continuous categorical variables data imputed using mean mode, respectively. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. ... arguments passed methods (currently used). object untrained 'aorsf' object, created setting no_fit = TRUE orsf().","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"accelerated oblique RSF object (aorsf)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"function based similar ORSF function obliqueRSF R package. primary difference function runs much faster. speed increase attributable better management memory (.e., unnecessary copies inputs) using Newton Raphson scoring algorithm identify linear combinations inputs rather performing penalized regression using routines glmnet.modified Newton Raphson scoring algorithm function applies adaptation C++ routine developed Terry M. Therneau fits Cox proportional hazards models (see survival::coxph() specifically survival::coxph.fit()).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"details-on-inputs","dir":"Reference","previous_headings":"","what":"Details on inputs","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"formula: response formula can survival object returned Surv function, can also just time status variables. .e., Surv(time, status) ~ . works just like time + status ~ . . symbol right hand side short-hand using variables data (omitting left hand side formula) predictors. order variables left hand side matters. .e., writing status + time ~ . make orsf assume status variable actually time variable. response variable can survival object stored data. example, y ~ . valid formula data$y inherits Surv class. Although can fit oblique random survival forest 1 predictor variable, formula least 2 predictors. reason recommendation linear combination predictors trivial one predictor. mtry: mtry parameter may temporarily reduced ensure least 2 events per predictor variable. occurs using orsf_control_cph coefficients Newton Raphson scoring algorithm may become unstable number covariates greater equal number events. reduction occur using orsf_control_net. oobag_fun: oobag_fun specified, used compute negation importance permutation importance, role ANOVA importance. n_thread: R function must called C++ (.e., user-supplied function compute --bag error identify linear combinations variables), n_thread automatically set 1 attempting run R functions multiple threads cause R session crash.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"what-is-an-oblique-decision-tree-","dir":"Reference","previous_headings":"","what":"What is an oblique decision tree?","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Decision trees developed splitting set training data two new subsets, goal similarity within new subsets . splitting process repeated resulting subsets data stopping criterion met. new subsets data formed based single predictor, decision tree said axis-based splits data appear perpendicular axis predictor. linear combinations variables used instead single variable, tree oblique splits data neither parallel right angle axis Figure : Decision trees classification axis-based splitting (left) oblique splitting (right). Cases orange squares; controls purple circles. trees partition predictor space defined variables X1 X2, oblique splits better job separating two classes.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"what-is-a-random-forest-","dir":"Reference","previous_headings":"","what":"What is a random forest?","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Random forests collections de-correlated decision trees. Predictions tree aggregated make ensemble prediction forest. details, see Breiman el, 2001.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"training-out-of-bag-error-and-testing","dir":"Reference","previous_headings":"","what":"Training, out-of-bag error, and testing","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"random forests, tree grown bootstrapped version training set. bootstrap samples selected replacement, bootstrapped training set contains two-thirds instances original training set. '--bag' data instances bootstrapped training set. tree random forest can make predictions --bag data, --bag predictions can aggregated make ensemble --bag prediction. Since --bag data used grow tree, accuracy ensemble --bag predictions approximate generalization error random forest. Generalization error refers error random forest's predictions applied predict outcomes data used train , .e., testing data.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"missing-data","dir":"Reference","previous_headings":"","what":"Missing data","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Data passed aorsf functions allowed missing values. user impute missing values using R package purpose, recipes mlr3pipelines.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"First load relevant packages entry-point aorsf standard call orsf(): printing fit provides quick descriptive summaries:","code":"set.seed(329730) suppressPackageStartupMessages({ library(aorsf) library(survival) library(tidymodels) library(tidyverse) library(randomForestSRC) library(ranger) library(riskRegression) library(obliqueRSF) }) fit <- orsf(pbc_orsf, Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 20.98 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"model-control","dir":"Reference","previous_headings":"","what":"Model control","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"examples make use orsf_control_ functions build compare models based --bag predictions. also standardize --bag samples using input argument tree_seeds","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"accelerated-linear-combinations","dir":"Reference","previous_headings":"","what":"Accelerated linear combinations","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"accelerated ORSF ensemble default nice balance computational speed prediction accuracy. runs single iteration Newton Raphson scoring Cox partial likelihood function find linear combinations predictors.","code":"fit_accel <- orsf(pbc_orsf, control = orsf_control_survival(), formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-cox-regression","dir":"Reference","previous_headings":"","what":"Linear combinations with Cox regression","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"orsf_control_cph runs Cox regression non-terminal node survival tree, using regression coefficients create linear combinations predictors:","code":"control_cph <- orsf_control_survival(method = 'glm', scale_x = TRUE, max_iter = 20) fit_cph <- orsf(pbc_orsf, control = control_cph, formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-penalized-cox-regression","dir":"Reference","previous_headings":"","what":"Linear combinations with penalized cox regression","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"orsf_control_net runs penalized Cox regression non-terminal node survival tree, using regression coefficients create linear combinations predictors. can really helpful want feature selection within node, lot slower options.","code":"# select 3 predictors out of 5 to be used in # each linear combination of predictors. control_net <- orsf_control_survival(method = 'net', target_df = 3) fit_net <- orsf(pbc_orsf, control = control_net, formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-your-own-function","dir":"Reference","previous_headings":"","what":"Linear combinations with your own function","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Let’s make three customized functions identify linear combinations predictors. first uses random coefficients second derives coefficients principal component analysis. third uses orsf() inside orsf(). can plug functions orsf_control_custom(), pass result orsf(): fit seems work best example? Let’s find evaluating --bag survival predictions. AUC values, highest lowest: indices prediction accuracy: inspection, net, accel, rlt high discrimination index prediction accuracy. rando pca less well, aren’t bad.","code":"f_rando <- function(x_node, y_node, w_node){ matrix(runif(ncol(x_node)), ncol=1) } f_pca <- function(x_node, y_node, w_node) { # estimate two principal components. pca <- stats::prcomp(x_node, rank. = 2) # use the second principal component to split the node pca$rotation[, 1L, drop = FALSE] } # This approach is known as reinforcement learning trees. # some special care is taken to prevent your R session from crashing. # Specifically, random coefficients are used when n_obs <= 10 # or n_events <= 5. f_aorsf <- function(x_node, y_node, w_node){ colnames(y_node) <- c('time', 'status') colnames(x_node) <- paste(\"x\", seq(ncol(x_node)), sep = '') data <- as.data.frame(cbind(y_node, x_node)) if(nrow(data) <= 10 || sum(y_node[,'status']) <= 5) return(matrix(runif(ncol(x_node)), ncol = 1)) fit <- orsf(data, time + status ~ ., weights = as.numeric(w_node), n_tree = 25, importance = 'permute') out <- orsf_vi(fit) # drop the least two important variables n_vars <- length(out) out[c(n_vars, n_vars-1)] <- 0 # ensure out has same variable order as input out <- out[colnames(x_node)] matrix(out, ncol = 1) } fit_rando <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_rando), tree_seeds = 329) fit_pca <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_pca), tree_seeds = 329) fit_rlt <- orsf(pbc_orsf, time + status ~ . - id, control = orsf_control_survival(method = f_aorsf), tree_seeds = 329) risk_preds <- list( accel = 1 - fit_accel$pred_oobag, cph = 1 - fit_cph$pred_oobag, net = 1 - fit_net$pred_oobag, rando = 1 - fit_rando$pred_oobag, pca = 1 - fit_pca$pred_oobag, rlt = 1 - fit_rlt$pred_oobag ) sc <- Score(object = risk_preds, formula = Surv(time, status) ~ 1, data = pbc_orsf, summary = 'IPA', times = fit_accel$pred_horizon) sc$AUC$score[order(-AUC)] ## model times AUC se lower upper ## 1: net 1788 0.9134593 0.02079935 0.8726933 0.9542253 ## 2: rlt 1788 0.9129537 0.01979016 0.8741657 0.9517417 ## 3: accel 1788 0.9112315 0.02098077 0.8701099 0.9523530 ## 4: cph 1788 0.9063871 0.02165434 0.8639453 0.9488288 ## 5: rando 1788 0.9023489 0.02218936 0.8588586 0.9458393 ## 6: pca 1788 0.8994220 0.02201713 0.8562692 0.9425748 sc$Brier$score[order(-IPA), .(model, times, IPA)] ## model times IPA ## 1: net 1788 0.4916038 ## 2: accel 1788 0.4879683 ## 3: cph 1788 0.4751883 ## 4: rlt 1788 0.4640282 ## 5: pca 1788 0.4370592 ## 6: rando 1788 0.4258344 ## 7: Null model 1788 0.0000000"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"tidymodels","dir":"Reference","previous_headings":"","what":"tidymodels","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"example uses tidymodels functions stops short using official tidymodels workflow. working getting aorsf pulled censored package update real workflows happens!","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"comparing-orsf-with-other-learners","dir":"Reference","previous_headings":"","what":"Comparing ORSF with other learners","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Start recipe pre-process data Next create 10-fold cross validation object pre-process data: Define functions ‘workflow’ randomForestSRC, ranger, aorsf. Run ‘workflows’ fold: Next unnest column get back tibble testing data predictions. finish aggregating predictions computing performance testing data. Note computing one statistic predictions instead computing one statistic fold. approach fine smaller testing sets /small event counts. inspection, aorsf obtained slightly higher discrimination (AUC) aorsf obtained higher index prediction accuracy (IPA)","code":"imputer <- recipe(pbc_orsf, formula = time + status ~ .) %>% step_rm(id) %>% step_impute_mean(all_numeric_predictors()) %>% step_impute_mode(all_nominal_predictors()) # 10-fold cross validation; make a container for the pre-processed data analyses <- vfold_cv(data = pbc_orsf, v = 10) %>% mutate(recipe = map(splits, ~prep(imputer, training = training(.x))), train = map(recipe, juice), test = map2(splits, recipe, ~bake(.y, new_data = testing(.x)))) analyses ## # 10-fold cross-validation ## # A tibble: 10 x 5 ## splits id recipe train test ## ## 1 Fold01 ## 2 Fold02 ## 3 Fold03 ## 4 Fold04 ## 5 Fold05 ## 6 Fold06 ## 7 Fold07 ## 8 Fold08 ## 9 Fold09 ## 10 Fold10 rfsrc_wf <- function(train, test, pred_horizon){ # rfsrc does not like tibbles, so cast input data into data.frames train <- as.data.frame(train) test <- as.data.frame(test) rfsrc(formula = Surv(time, status) ~ ., data = train) %>% predictRisk(newdata = test, times = pred_horizon) %>% as.numeric() } ranger_wf <- function(train, test, pred_horizon){ ranger(Surv(time, status) ~ ., data = train) %>% predictRisk(newdata = test, times = pred_horizon) %>% as.numeric() } aorsf_wf <- function(train, test, pred_horizon){ train %>% orsf(Surv(time, status) ~ .,) %>% predict(new_data = test, pred_type = 'risk', pred_horizon = pred_horizon) %>% as.numeric() } # 5 year risk prediction ph <- 365.25 * 5 results <- analyses %>% transmute(test, pred_aorsf = map2(train, test, aorsf_wf, pred_horizon = ph), pred_rfsrc = map2(train, test, rfsrc_wf, pred_horizon = ph), pred_ranger = map2(train, test, ranger_wf, pred_horizon = ph)) results <- results %>% unnest(everything()) glimpse(results) ## Rows: 276 ## Columns: 23 ## $ id 1, 8, 15, 17, 23, 35, 56, 68, 92, 94, 97, 109, 116, 130, 1~ ## $ trt d_penicill_main, placebo, d_penicill_main, placebo, placeb~ ## $ age 58.76523, 53.05681, 64.64613, 52.18344, 55.96715, 48.61875~ ## $ sex f, f, f, f, f, f, f, f, f, f, m, f, f, f, f, f, f, f, f, f~ ## $ ascites 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0~ ## $ hepato 1, 0, 0, 1, 1, 0, 1, 0, 0, 1, 1, 0, 0, 1, 0, 0, 1, 0, 1, 0~ ## $ spiders 1, 0, 0, 0, 1, 0, 1, 0, 0, 1, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0~ ## $ edema 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0.5, 0, 0.5, 0, 0, 0, 0.5, 0~ ## $ bili 14.5, 0.3, 0.8, 2.7, 17.4, 1.2, 1.1, 0.7, 1.4, 3.2, 2.0, 0~ ## $ chol 261, 280, 231, 274, 395, 314, 498, 174, 206, 201, 420, 120~ ## $ albumin 2.60, 4.00, 3.87, 3.15, 2.94, 3.20, 3.80, 4.09, 3.13, 3.11~ ## $ copper 156, 52, 173, 159, 558, 201, 88, 58, 36, 178, 62, 53, 74, ~ ## $ alk.phos 1718.0, 4651.2, 9009.8, 1533.0, 6064.8, 12258.8, 13862.4, ~ ## $ ast 137.95, 28.38, 127.71, 117.80, 227.04, 72.24, 95.46, 71.30~ ## $ trig 172, 189, 96, 128, 191, 151, 319, 46, 70, 69, 91, 52, 382,~ ## $ platelet 190, 373, 295, 224, 214, 431, 365, 203, 145, 188, 344, 271~ ## $ protime 12.2, 11.0, 11.0, 10.5, 11.7, 10.6, 10.6, 10.6, 12.2, 11.8~ ## $ stage 4, 3, 3, 4, 4, 3, 2, 3, 4, 4, 3, 3, 3, 3, 2, 2, 3, 2, 3, 2~ ## $ time 400, 2466, 3584, 769, 264, 2847, 1847, 4039, 388, 750, 611~ ## $ status 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 0, 0, 1, 0, 0, 1, 0, 1, 0~ ## $ pred_aorsf 0.95858574, 0.05070837, 0.22924369, 0.47048899, 0.94442624~ ## $ pred_rfsrc 0.85474291, 0.05480510, 0.31751746, 0.45156052, 0.85784657~ ## $ pred_ranger 0.77897322, 0.04599438, 0.30267242, 0.43467381, 0.77914735~ Score( object = list(aorsf = results$pred_aorsf, rfsrc = results$pred_rfsrc, ranger = results$pred_ranger), formula = Surv(time, status) ~ 1, data = results, summary = 'IPA', times = ph ) ## ## Metric AUC: ## ## Results by model: ## ## model times AUC lower upper ## 1: aorsf 1826 90.7 86.4 95.0 ## 2: rfsrc 1826 89.9 85.6 94.2 ## 3: ranger 1826 89.7 85.5 94.0 ## ## Results of model comparisons: ## ## times model reference delta.AUC lower upper p ## 1: 1826 rfsrc aorsf -0.8 -2.2 0.5 0.2 ## 2: 1826 ranger aorsf -1.0 -2.5 0.5 0.2 ## 3: 1826 ranger rfsrc -0.1 -1.3 1.0 0.8 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The higher AUC the better. ## ## Metric Brier: ## ## Results by model: ## ## model times Brier lower upper IPA ## 1: Null model 1826.25 20.5 18.1 22.9 0.0 ## 2: aorsf 1826.25 10.8 8.6 13.0 47.3 ## 3: rfsrc 1826.25 11.8 9.7 13.9 42.5 ## 4: ranger 1826.25 11.9 9.8 14.0 41.9 ## ## Results of model comparisons: ## ## times model reference delta.Brier lower upper p ## 1: 1826.25 aorsf Null model -9.7 -12.3 -7.1 2.179169e-13 ## 2: 1826.25 rfsrc Null model -8.7 -11.0 -6.4 3.915661e-14 ## 3: 1826.25 ranger Null model -8.6 -10.9 -6.2 8.869452e-13 ## 4: 1826.25 rfsrc aorsf 1.0 0.3 1.7 5.383491e-03 ## 5: 1826.25 ranger aorsf 1.1 0.5 1.7 7.890574e-04 ## 6: 1826.25 ranger rfsrc 0.1 -0.4 0.6 6.310608e-01 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The lower Brier the better, the higher IPA the better."},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"mlr-pipelines","dir":"Reference","previous_headings":"","what":"mlr3 pipelines","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Warning: code may may run depending current version mlr3proba. First load additional mlr3 libraries. Next ’ll define tasks learners engage . Now can make benchmark designed compare three favorite learners: Let’s look overall results: inspection, aorsf higher expected value ‘surv.cindex’ (higher better) aorsf lower expected value ‘surv.graf’ (lower better)","code":"suppressPackageStartupMessages({ library(mlr3verse) library(mlr3proba) library(mlr3extralearners) library(mlr3viz) library(mlr3benchmark) }) # Mayo Clinic Primary Biliary Cholangitis Data task_pbc <- TaskSurv$new( id = 'pbc', backend = select(pbc_orsf, -id) %>% mutate(stage = as.numeric(stage)), time = \"time\", event = \"status\" ) # Veteran's Administration Lung Cancer Trial data(veteran, package = \"randomForestSRC\") task_veteran <- TaskSurv$new( id = 'veteran', backend = veteran, time = \"time\", event = \"status\" ) # NKI 70 gene signature data_nki <- OpenML::getOMLDataSet(data.id = 1228) task_nki <- TaskSurv$new( id = 'nki', backend = data_nki$data, time = \"time\", event = \"event\" ) # Gene Expression-Based Survival Prediction in Lung Adenocarcinoma data_lung <- OpenML::getOMLDataSet(data.id = 1245) task_lung <- TaskSurv$new( id = 'nki', backend = data_lung$data %>% mutate(OS_event = as.numeric(OS_event) -1), time = \"OS_years\", event = \"OS_event\" ) # Chemotherapy for Stage B/C colon cancer # (there are two rows per person, one for death # and the other for recurrence, hence the two tasks) task_colon_death <- TaskSurv$new( id = 'colon_death', backend = survival::colon %>% filter(etype == 2) %>% drop_na() %>% # drop id, redundant variables select(-id, -study, -node4, -etype), mutate(OS_event = as.numeric(OS_event) -1), time = \"time\", event = \"status\" ) task_colon_recur <- TaskSurv$new( id = 'colon_death', backend = survival::colon %>% filter(etype == 1) %>% drop_na() %>% # drop id, redundant variables select(-id, -study, -node4, -etype), mutate(OS_event = as.numeric(OS_event) -1), time = \"time\", event = \"status\" ) # putting them all together tasks <- list(task_pbc, task_veteran, task_nki, task_lung, task_colon_death, task_colon_recur, # add a few more pre-made ones tsk(\"actg\"), tsk('gbcs'), tsk('grace'), tsk(\"unemployment\"), tsk(\"whas\")) # Learners with default parameters learners <- lrns(c(\"surv.ranger\", \"surv.rfsrc\", \"surv.aorsf\")) # Brier (Graf) score, c-index and training time as measures measures <- msrs(c(\"surv.graf\", \"surv.cindex\", \"time_train\")) # Benchmark with 5-fold CV design <- benchmark_grid( tasks = tasks, learners = learners, resamplings = rsmps(\"cv\", folds = 5) ) benchmark_result <- benchmark(design) bm_scores <- benchmark_result$score(measures, predict_sets = \"test\") bm_scores %>% select(task_id, learner_id, surv.graf, surv.cindex, time_train) %>% group_by(learner_id) %>% filter(!is.infinite(surv.graf)) %>% summarize( across( .cols = c(surv.graf, surv.cindex, time_train), .fns = ~mean(.x, na.rm = TRUE) ) ) ## # A tibble: 3 x 4 ## learner_id surv.graf surv.cindex time_train ## ## 1 surv.aorsf 0.150 0.734 0.383 ## 2 surv.ranger 0.164 0.716 2.04 ## 3 surv.rfsrc 0.155 0.724 0.757"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating Yield Medical Tests. JAMA 1982; 247(18):2543-2546. DOI: 10.1001/jama.1982.03320430047030 Breiman L. Random forests. Machine learning 2001 Oct; 45(1):5-32. DOI: 10.1023/:1010933404324 Ishwaran H, Kogalur UB, Blackstone EH, Lauer MS. Random survival forests. Annals applied statistics 2008 Sep; 2(3):841-60. DOI: 10.1214/08-AOAS169 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29 Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique random survival forests. Annals applied statistics 2019 Sep; 13(3):1847-83. DOI: 10.1214/19-AOAS1261 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":null,"dir":"Reference","previous_headings":"","what":"Oblique random forest control — orsf_control","title":"Oblique random forest control — orsf_control","text":"Oblique random forest control","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Oblique random forest control — orsf_control","text":"","code":"orsf_control( tree_type, method, scale_x, ties, net_mix, target_df, max_iter, epsilon, ... ) orsf_control_classification( method = \"glm\", scale_x = TRUE, net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... ) orsf_control_regression( method = \"glm\", scale_x = TRUE, net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... ) orsf_control_survival( method = \"glm\", scale_x = TRUE, ties = \"efron\", net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Oblique random forest control — orsf_control","text":"tree_type (character) type tree. Valid options \"classification\", .e., categorical outcomes \"regression\", .e., continuous outcomes \"survival\", .e., time-event outcomes method (character function) identify linear linear combinations predictors. method character value, must one : 'glm': linear, logistic, cox regression 'net': 'glm' penalty terms 'pca': principal component analysis 'random': random draw uniform distribution method function, used identify linear combinations predictor variables. method must case accept three inputs named x_node, y_node w_node, expect following types dimensions: x_node (matrix; n rows, p columns) y_node (matrix; n rows, 2 columns) w_node (matrix; n rows, 1 column) addition, method must return matrix p rows 1 column. scale_x (logical) TRUE, values predictors scaled prior instance finding linear combination predictors, using summary values data current node decision tree. ties (character) character string specifying method tie handling. relevant modeling survival outcomes using method engages tied outcome times. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. net_mix (double) elastic net mixing parameter. value 1 gives lasso penalty, value 0 gives ridge penalty. multiple values alpha given, penalized model fit using alpha value prior splitting node. target_df (integer) Preferred number variables used linear combination. example, mtry 5 target_df 3, sample 5 predictors look best linear combination using 3 . max_iter (integer) iteration continues convergence (see eps ) number attempted iterations equal iter_max. epsilon (double) using modeling based method, iteration continues algorithm relative change kind objective less epsilon, absolute change less sqrt(epsilon). ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Oblique random forest control — orsf_control","text":"object class 'orsf_control', used input control argument orsf. Components : tree_type: type trees fit lincomb_type: method linear combinations lincomb_eps: epsilon convergence lincomb_iter_max: max iterations lincomb_scale: scale . lincomb_alpha: mixing parameter lincomb_df_target: target degrees freedom lincomb_ties_method: method ties survival time lincomb_R_function: R function custom splits","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Oblique random forest control — orsf_control","text":"Adjust scale_x risk. Setting scale_x = FALSE reduce computation time also make orsf model dependent scale data, default value TRUE.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":null,"dir":"Reference","previous_headings":"","what":"Cox regression ORSF control — orsf_control_cph","title":"Cox regression ORSF control — orsf_control_cph","text":"Use coefficients proportional hazards model create linear combinations predictor variables fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Cox regression ORSF control — orsf_control_cph","text":"","code":"orsf_control_cph(method = \"efron\", eps = 1e-09, iter_max = 20, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Cox regression ORSF control — orsf_control_cph","text":"method (character) character string specifying method tie handling. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. eps (double) using Newton Raphson scoring identify linear combinations inputs, iteration continues algorithm relative change log partial likelihood less eps, absolute change less sqrt(eps). Must positive. default value 1e-09 used consistency survival::coxph.control. iter_max (integer) iteration continues convergence (see eps ) number attempted iterations equal iter_max. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Cox regression ORSF control — orsf_control_cph","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Cox regression ORSF control — orsf_control_cph","text":"code survival package modified make routine. details Cox proportional hazards model, see coxph /Therneau Grambsch (2000).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Cox regression ORSF control — orsf_control_cph","text":"Therneau T.M., Grambsch P.M. (2000) Cox Model. : Modeling Survival Data: Extending Cox Model. Statistics Biology Health. Springer, New York, NY. DOI: 10.1007/978-1-4757-3294-8_3","code":""},{"path":[]},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Custom ORSF control — orsf_control_custom","text":"","code":"orsf_control_custom(beta_fun, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Custom ORSF control — orsf_control_custom","text":"beta_fun (function) function define coefficients used linear combinations predictor variables. beta_fun must accept three inputs named x_node, y_node w_node, expect following types dimensions: x_node (matrix; n rows, p columns) y_node (matrix; n rows, 2 columns) w_node (matrix; n rows, 1 column) addition, beta_fun must return matrix p rows 1 column. conditions met, orsf_control_custom() let know. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Custom ORSF control — orsf_control_custom","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Custom ORSF control — orsf_control_custom","text":"Two customized functions identify linear combinations predictors shown . first uses random coefficients second derives coefficients principal component analysis.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"random-coefficients","dir":"Reference","previous_headings":"","what":"Random coefficients","title":"Custom ORSF control — orsf_control_custom","text":"f_rando() function get random coefficients: can plug f_rando orsf_control_survival(), pass result orsf():","code":"f_rando <- function(x_node, y_node, w_node){ matrix(runif(ncol(x_node)), ncol=1) } library(aorsf) fit_rando <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_rando), n_tree = 500) fit_rando ## ---------- Oblique random survival forest ## ## Linear combinations: Custom user function ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 19.682 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.83 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"principal-components","dir":"Reference","previous_headings":"","what":"Principal components","title":"Custom ORSF control — orsf_control_custom","text":"Follow steps , starting custom function: plug function orsf_control_survival() pass result orsf():","code":"f_pca <- function(x_node, y_node, w_node) { # estimate two principal components. pca <- stats::prcomp(x_node, rank. = 2) # use the second principal component to split the node pca$rotation[, 2L, drop = FALSE] } fit_pca <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_pca), n_tree = 500)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"evaluate","dir":"Reference","previous_headings":"","what":"Evaluate","title":"Custom ORSF control — orsf_control_custom","text":"well two customized ORSFs ? Let’s compute indices prediction accuracy based --bag predictions: PCA ORSF quite well! (higher IPA better)","code":"library(riskRegression) ## riskRegression version 2023.09.08 library(survival) risk_preds <- list(rando = 1 - fit_rando$pred_oobag, pca = 1 - fit_pca$pred_oobag) sc <- Score(object = risk_preds, formula = Surv(time, status) ~ 1, data = pbc_orsf, summary = 'IPA', times = fit_pca$pred_horizon) sc$Brier ## ## Results by model: ## ## model times Brier lower upper IPA ## 1: Null model 1788 20.479 18.090 22.868 0.000 ## 2: rando 1788 11.872 9.771 13.972 42.031 ## 3: pca 1788 12.990 10.971 15.009 36.569 ## ## Results of model comparisons: ## ## times model reference delta.Brier lower upper p ## 1: 1788 rando Null model -8.607 -10.809 -6.406 1.832790e-14 ## 2: 1788 pca Null model -7.489 -9.213 -5.765 1.664802e-17 ## 3: 1788 pca rando 1.118 0.258 1.979 1.087482e-02 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The lower Brier the better, the higher IPA the better."},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":null,"dir":"Reference","previous_headings":"","what":"Accelerated ORSF control — orsf_control_fast","title":"Accelerated ORSF control — orsf_control_fast","text":"Fast methods identify linear combinations predictors fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Accelerated ORSF control — orsf_control_fast","text":"","code":"orsf_control_fast(method = \"efron\", do_scale = TRUE, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Accelerated ORSF control — orsf_control_fast","text":"method (character) character string specifying method tie handling. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. do_scale (logical) TRUE, values predictors scaled prior instance Newton Raphson scoring, using summary values data current node decision tree. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Accelerated ORSF control — orsf_control_fast","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Accelerated ORSF control — orsf_control_fast","text":"code survival package modified make routine. Adjust do_scale risk. Setting do_scale = FALSE reduce computation time also make orsf model dependent scale data, default value TRUE.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":null,"dir":"Reference","previous_headings":"","what":"Penalized Cox regression ORSF control — orsf_control_net","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"Use regularized Cox proportional hazard models identify linear combinations input variables fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"","code":"orsf_control_net(alpha = 1/2, df_target = NULL, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"alpha (double) elastic net mixing parameter. value 1 gives lasso penalty, value 0 gives ridge penalty. multiple values alpha given, penalized model fit using alpha value prior splitting node. df_target (integer) Preferred number variables used linear combination. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"df_target less mtry, separate argument orsf indicates number variables chosen random prior finding linear combination variables.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"Simon N, Friedman J, Hastie T, Tibshirani R. Regularization paths Cox's proportional hazards model via coordinate descent. Journal statistical software 2011 Mar; 39(5):1. DOI: 10.18637/jss.v039.i05","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF Individual Conditional Expectations — orsf_ice_oob","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"Compute individual conditional expectations ORSF model. Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. can compute individual conditional expectations three ways using random forest: using -bag predictions training data using --bag predictions training data using predictions new set data See examples details","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"","code":"orsf_ice_oob( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... ) orsf_ice_inb( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... ) orsf_ice_new( object, pred_spec, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"object (orsf_fit) trained oblique random survival forest (see orsf). pred_spec (named list data.frame). pred_spec named list, item list vector values used points partial dependence function. name item list indicate variable modified take corresponding values. pred_spec data.frame, columns indicate variable names, values indicate variable values, partial dependence computed using inputs row. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction expand_grid (logical) TRUE, partial dependence computed possible combinations inputs pred_spec. FALSE, partial dependence computed variable pred_spec, separately. boundary_checks (logical) TRUE, pred_spec checked make sure requested values 10th 90th percentile object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. ... arguments passed methods (currently used). new_data data.frame, tibble, data.table compute predictions . na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'omit' : rows new_data incomplete data dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"data.table containing individual conditional expectations specified variable(s) specified prediction horizon(s).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"Begin fitting ORSF ensemble Use ensemble compute ICE values using --bag predictions: Much detailed examples given vignette","code":"library(aorsf) set.seed(329) fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 21.026 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## ----------------------------------------- pred_spec <- list(bili = seq(1, 10, length.out = 25)) ice_oob <- orsf_ice_oob(fit, pred_spec, boundary_checks = FALSE) ice_oob ## id_variable id_row pred_horizon bili pred ## 1: 1 1 1788 1 0.1264442 ## 2: 1 2 1788 1 0.1739727 ## 3: 1 3 1788 1 0.3904517 ## 4: 1 4 1788 1 0.2874752 ## 5: 1 5 1788 1 0.4398522 ## --- ## 6896: 25 272 1788 10 0.3076971 ## 6897: 25 273 1788 10 0.4942110 ## 6898: 25 274 1788 10 0.6407498 ## 6899: 25 275 1788 10 0.3871298 ## 6900: 25 276 1788 10 0.6479179"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF partial dependence — orsf_pd_oob","title":"ORSF partial dependence — orsf_pd_oob","text":"Compute partial dependence ORSF model. Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model's prediction. can compute partial dependence three ways using random forest: using -bag predictions training data using --bag predictions training data using predictions new set data See examples details","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF partial dependence — orsf_pd_oob","text":"","code":"orsf_pd_oob( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... ) orsf_pd_inb( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... ) orsf_pd_new( object, pred_spec, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF partial dependence — orsf_pd_oob","text":"object (orsf_fit) trained oblique random survival forest (see orsf). pred_spec (named list data.frame). pred_spec named list, item list vector values used points partial dependence function. name item list indicate variable modified take corresponding values. pred_spec data.frame, columns indicate variable names, values indicate variable values, partial dependence computed using inputs row. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction expand_grid (logical) TRUE, partial dependence computed possible combinations inputs pred_spec. FALSE, partial dependence computed variable pred_spec, separately. prob_values (numeric) vector values 0 1, indicating quantiles used summarize partial dependence values set inputs. prob_values length prob_labels. quantiles calculated based predictions object set values indicated pred_spec. prob_labels (character) vector labels length prob_values, label indicating corresponding value prob_values labelled summarized outputs. prob_labels length prob_values. boundary_checks (logical) TRUE, pred_spec checked make sure requested values 10th 90th percentile object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. ... arguments passed methods (currently used). new_data data.frame, tibble, data.table compute predictions . na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'omit' : rows new_data incomplete data dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF partial dependence — orsf_pd_oob","text":"data.table containing partial dependence values specified variable(s) specified prediction horizon(s).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF partial dependence — orsf_pd_oob","text":"Partial dependence number known limitations assumptions users aware (see Hooker, 2021). particular, partial dependence less intuitive >2 predictors examined jointly, assumed feature(s) partial dependence computed correlated features (likely true many cases). Accumulated local effect plots can used (see ) case feature independence valid assumption.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF partial dependence — orsf_pd_oob","text":"Begin fitting ORSF ensemble:","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"three-ways-to-compute-pd-and-ice","dir":"Reference","previous_headings":"","what":"Three ways to compute PD and ICE","title":"ORSF partial dependence — orsf_pd_oob","text":"can compute partial dependence ICE three ways aorsf: using -bag predictions training data using --bag predictions training data using predictions new set data -bag partial dependence indicates relationships model learned training. helpful goal interpret model. --bag partial dependence indicates relationships model learned training using --bag data simulates application model new data. want test model’s reliability fairness new data don’t access large testing set. new data partial dependence shows model predicts outcomes observations seen. helpful want test model’s reliability fairness.","code":"pd_train <- orsf_pd_inb(fit, pred_spec = list(bili = 1:5)) pd_train ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7932390 0.2177461 0.9060625 0.9816153 ## 2: 1826.25 2 0.7642403 0.1988035 0.8717127 0.9710504 ## 3: 1826.25 3 0.7240284 0.1770122 0.8303501 0.9480047 ## 4: 1826.25 4 0.6744615 0.1615326 0.7599508 0.9088882 ## 5: 1826.25 5 0.6313355 0.1553589 0.7152580 0.8658139 pd_train <- orsf_pd_oob(fit, pred_spec = list(bili = 1:5)) pd_train ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7840481 0.2727537 0.8694252 0.9809905 ## 2: 1826.25 2 0.7549406 0.2525478 0.8333524 0.9693362 ## 3: 1826.25 3 0.7158234 0.2364582 0.7890158 0.9461864 ## 4: 1826.25 4 0.6656823 0.2260407 0.7158336 0.9151153 ## 5: 1826.25 5 0.6225353 0.2071656 0.6734005 0.8681677 pd_test <- orsf_pd_new(fit, new_data = pbc_orsf_test, pred_spec = list(bili = 1:5)) pd_test ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7524101 0.1868769 0.8121185 0.9803382 ## 2: 1826.25 2 0.7234050 0.1759562 0.7754099 0.9653244 ## 3: 1826.25 3 0.6816975 0.1581292 0.7224945 0.9403449 ## 4: 1826.25 4 0.6339907 0.1467816 0.6598026 0.9000773 ## 5: 1826.25 5 0.5911775 0.1387876 0.6186801 0.8504577"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"ORSF partial dependence — orsf_pd_oob","text":"Giles Hooker, Lucas Mentch, Siyu Zhou. Unrestricted Permutation forces Extrapolation: Variable Importance Requires least One Model, Free Variable Importance. arXiv e-prints 2021 Oct; arXiv-1905. URL: https://doi.org/10.48550/arXiv.1905.03151","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":null,"dir":"Reference","previous_headings":"","what":"Scale input data — orsf_scale_cph","title":"Scale input data — orsf_scale_cph","text":"functions exported users may access internal routines used scale inputs orsf_control_cph used.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Scale input data — orsf_scale_cph","text":"","code":"orsf_scale_cph(x_mat, w_vec = NULL) orsf_unscale_cph(x_mat)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Scale input data — orsf_scale_cph","text":"x_mat (numeric matrix) matrix values scaled unscaled. Note orsf_unscale_cph accept x_mat inputs attribute containing transform values, added automatically orsf_scale_cph. w_vec (numeric vector) optional vector weights. weights supplied (default), observations equally weighted. supplied, w_vec must length equal nrow(x_mat).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Scale input data — orsf_scale_cph","text":"scaled unscaled x_mat.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Scale input data — orsf_scale_cph","text":"data transformed first subtracting mean multiplying scale. inverse transform can completed using orsf_unscale_cph dividing column corresponding scale adding mean. values means scales stored attribute output returned orsf_scale_cph (see examples)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Scale input data — orsf_scale_cph","text":"","code":"x_mat <- as.matrix(pbc_orsf[, c('bili', 'age', 'protime')]) head(x_mat) #> bili age protime #> 1 14.5 58.76523 12.2 #> 2 1.1 56.44627 10.6 #> 3 1.4 70.07255 12.0 #> 4 1.8 54.74059 10.3 #> 5 3.4 38.10541 10.9 #> 7 1.0 55.53457 9.7 x_scaled <- orsf_scale_cph(x_mat) head(x_scaled) #> bili age protime #> [1,] 3.77308887 1.0412574 1.9694656 #> [2,] -0.75476469 0.7719344 -0.1822316 #> [3,] -0.65339483 2.3544852 1.7005035 #> [4,] -0.51823502 0.5738373 -0.5856748 #> [5,] 0.02240421 -1.3581657 0.2212116 #> [6,] -0.78855464 0.6660494 -1.3925613 attributes(x_scaled) # note the transforms attribute #> $dim #> [1] 276 3 #> #> $dimnames #> $dimnames[[1]] #> NULL #> #> $dimnames[[2]] #> [1] \"bili\" \"age\" \"protime\" #> #> #> $transforms #> mean scale #> [1,] 3.333696 0.3378995 #> [2,] 49.799661 0.1161396 #> [3,] 10.735507 1.3448108 #> x_unscaled <- orsf_unscale_cph(x_scaled) head(x_unscaled) #> bili age protime #> [1,] 14.5 58.76523 12.2 #> [2,] 1.1 56.44627 10.6 #> [3,] 1.4 70.07255 12.0 #> [4,] 1.8 54.74059 10.3 #> [5,] 3.4 38.10541 10.9 #> [6,] 1.0 55.53457 9.7 # numeric difference in x_mat and x_unscaled should be practically 0 max(abs(x_mat - x_unscaled)) #> [1] 3.552714e-15"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF summary; univariate — orsf_summarize_uni","title":"ORSF summary; univariate — orsf_summarize_uni","text":"Summarize univariate information ORSF object","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF summary; univariate — orsf_summarize_uni","text":"","code":"orsf_summarize_uni( object, n_variables = NULL, pred_horizon = NULL, pred_type = NULL, importance = NULL, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF summary; univariate — orsf_summarize_uni","text":"object (orsf_fit) trained oblique random survival forest (see orsf). n_variables (integer) many variables summarized? Setting input lower number reduce computation time. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction importance (character) Indicate method variable importance: 'none': variable importance computed. 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance details methods, see orsf_vi. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF summary; univariate — orsf_summarize_uni","text":"object class 'orsf_summary', includes data importance individual predictors. expected values predictions specific values predictors.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF summary; univariate — orsf_summarize_uni","text":"pred_horizon left unspecified, median value time--event variable object's training data used. recommended always specify prediction horizon, median time may especially meaningful horizon compute predicted risk values . object already variable importance values, can safely bypass computation variable importance function setting importance = 'none'.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF summary; univariate — orsf_summarize_uni","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 25) # since anova importance was used to make object, it is also # used for ranking variables in the summary, unless we specify # a different type of importance orsf_summarize_uni(object, n_variables = 3) #> #> -- ascites (VI Rank: 1) ------------------------ #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3161695 0.2275708 0.04079213 0.5410582 #> 1 0.4556415 0.4338152 0.24012977 0.6757556 #> #> -- bili (VI Rank: 2) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.80 0.2252977 0.1307385 0.03684485 0.3476662 #> 1.40 0.2564145 0.1645221 0.05220417 0.4061546 #> 3.52 0.3946137 0.3528272 0.18515998 0.5687976 #> #> -- edema (VI Rank: 3) -------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3094053 0.2146270 0.03974405 0.5390676 #> 0.5 0.4081716 0.3865421 0.17838896 0.6251894 #> 1 0.4232587 0.4171964 0.17870206 0.6232070 #> #> Predicted risk at time t = 1788 for top 3 predictors # if we want to summarize object according to variables # ranked by negation importance, we can compute negation # importance within orsf_summarize_uni() as follows: orsf_summarize_uni(object, n_variables = 3, importance = 'negate') #> #> -- bili (VI Rank: 1) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.80 0.2252977 0.1307385 0.03684485 0.3476662 #> 1.40 0.2564145 0.1645221 0.05220417 0.4061546 #> 3.52 0.3946137 0.3528272 0.18515998 0.5687976 #> #> -- copper (VI Rank: 2) ------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 42.8 0.2768856 0.1810462 0.03651200 0.4861954 #> 74.0 0.2930721 0.1926693 0.03784076 0.5148088 #> 129 0.3464940 0.2607161 0.08194868 0.5696629 #> #> -- sex (VI Rank: 3) ---------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> m 0.3544876 0.2671461 0.10626310 0.5673370 #> f 0.3222385 0.2432161 0.04065488 0.5449863 #> #> Predicted risk at time t = 1788 for top 3 predictors"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":null,"dir":"Reference","previous_headings":"","what":"Estimate training time — orsf_time_to_train","title":"Estimate training time — orsf_time_to_train","text":"Estimate training time","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Estimate training time — orsf_time_to_train","text":"","code":"orsf_time_to_train(object, n_tree_subset = 50)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Estimate training time — orsf_time_to_train","text":"object untrained aorsf object n_tree_subset (integer) many trees fit order estimate time needed train object. default value 50, usually gives good enough approximation.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Estimate training time — orsf_time_to_train","text":"difftime object.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Estimate training time — orsf_time_to_train","text":"","code":"# specify but do not train the model by setting no_fit = TRUE. object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 500, no_fit = TRUE) # grow 50 trees to approximate the time it will take to grow 500 trees time_estimated <- orsf_time_to_train(object, n_tree_subset = 50) print(time_estimated) #> Time difference of 0.1933455 secs # let's see how close the approximation was time_true_start <- Sys.time() fit <- orsf_train(object) time_true_stop <- Sys.time() time_true <- time_true_stop - time_true_start print(time_true) #> Time difference of 0.2267592 secs # error abs(time_true - time_estimated) #> Time difference of 0.03341365 secs"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF variable importance — orsf_vi","title":"ORSF variable importance — orsf_vi","text":"Estimate importance individual variables using oblique random survival forests.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF variable importance — orsf_vi","text":"","code":"orsf_vi( object, group_factors = TRUE, importance = NULL, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_negate( object, group_factors = TRUE, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_permute( object, group_factors = TRUE, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_anova(object, group_factors = TRUE, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF variable importance — orsf_vi","text":"object (orsf_fit) trained oblique random survival forest (see orsf). group_factors (logical) TRUE, importance factor variables reported overall aggregating importance individual levels factor. FALSE, importance individual factor levels returned. importance (character) Indicate method variable importance: 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance oobag_fun (function) used evaluating --bag prediction accuracy negating coefficients (importance = 'negate') permuting values predictor (importance = 'permute') oobag_fun = NULL (default), evaluation statistic selected based tree type survival: Harrell's C-statistic (1982) classification: Area underneath ROC curve (AUC-ROC) regression: Traditional prediction R-squared use oobag_fun note following: oobag_fun three inputs: y_mat, w_vec, s_vec survival trees, y_mat two column matrix first column named 'time' second named 'status'. classification trees, y_mat matrix number columns = number distinct classes outcome. regression, y_mat matrix one column. s_vec numeric vector containing predictions oobag_fun return numeric output length 1 oobag_fun used created object initial value --bag prediction accuracy consistent values computed variable importance estimated. details, see --bag vignette. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF variable importance — orsf_vi","text":"orsf_vi functions return named numeric vector. Names vector predictor variables used object Values vector estimated importance given predictor. returned vector sorted highest lowest value, higher values indicating higher importance.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF variable importance — orsf_vi","text":"orsf_fit object fitted importance = 'anova', 'negate', 'permute', output vector importance values based requested type importance. However, may still want call orsf_vi() output want group factor levels one overall importance value. orsf_vi() general purpose function extract compute variable importance estimates 'orsf_fit' object (see orsf). orsf_vi_negate(), orsf_vi_permute(), orsf_vi_anova() wrappers orsf_vi(). way functions work depends whether object given already variable importance estimates (see examples).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"variable-importance-methods","dir":"Reference","previous_headings":"","what":"Variable importance methods","title":"ORSF variable importance — orsf_vi","text":"negation importance: variable assessed separately multiplying variable's coefficients -1 determining much model's performance changes. worse model's performance negating coefficients given variable, important variable. technique promising b/c require permutation emphasizes variables larger coefficients linear combinations, also relatively new studied much permutation importance. See Jaeger, (2023) details technique. permutation importance: variable assessed separately randomly permuting variable's values determining much model's performance changes. worse model's performance permuting values given variable, important variable. technique flexible, intuitive, frequently used. also several known limitations analysis variance (ANOVA) importance: p-value computed coefficient linear combination variables decision tree. Importance individual predictor variable proportion times p-value coefficient < 0.01. technique efficient computationally, may effective permutation negation terms selecting signal noise variables. See Menze, 2011 details technique.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"anova-importance","dir":"Reference","previous_headings":"","what":"ANOVA importance","title":"ORSF variable importance — orsf_vi","text":"default variable importance technique, ANOVA, calculated fit ORSF ensemble. ANOVA default fast, may decisive permutation negation techniques variable selection.","code":"fit <- orsf(pbc_orsf, Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 21.114 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"raw-vi-values","dir":"Reference","previous_headings":"","what":"Raw VI values","title":"ORSF variable importance — orsf_vi","text":"‘raw’ variable importance values can accessed fit object ‘raw’ values factors aggregated single value. Currently one value k-1 levels k level factor. example, can see edema_1 edema_0.5 importance values edema factor variable levels 0, 0.5, 1.","code":"attr(fit, 'importance_values') ## NULL"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"collapse-vi-across-factor-levels","dir":"Reference","previous_headings":"","what":"Collapse VI across factor levels","title":"ORSF variable importance — orsf_vi","text":"get aggregated values across levels factor, access importance element orsf fit: use orsf_vi() group_factors set TRUE (default) Note can make default returned importance values ungrouped setting group_factors FALSE orsf_vi functions orsf function.","code":"fit$importance ## ascites bili edema copper age albumin protime ## 0.49306931 0.40601166 0.30339953 0.26839623 0.26685796 0.25804901 0.22825024 ## chol stage ast spiders hepato sex trig ## 0.19290780 0.18941048 0.17435648 0.16943522 0.15678670 0.13905325 0.12965799 ## alk.phos platelet trt ## 0.11338661 0.09012876 0.06778770 orsf_vi(fit) ## ascites bili edema copper age albumin protime ## 0.49306931 0.40601166 0.30339953 0.26839623 0.26685796 0.25804901 0.22825024 ## chol stage ast spiders hepato sex trig ## 0.19290780 0.18941048 0.17435648 0.16943522 0.15678670 0.13905325 0.12965799 ## alk.phos platelet trt ## 0.11338661 0.09012876 0.06778770"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"add-vi-to-an-orsf","dir":"Reference","previous_headings":"","what":"Add VI to an ORSF","title":"ORSF variable importance — orsf_vi","text":"can fit ORSF without VI, add VI later","code":"fit_no_vi <- orsf(pbc_orsf, Surv(time, status) ~ . - id, importance = 'none') # Note: you can't call orsf_vi_anova() on fit_no_vi because anova # VI can only be computed while the forest is being grown. orsf_vi_negate(fit_no_vi) ## bili copper sex protime albumin age ## 0.122344895 0.047850279 0.035986359 0.023711711 0.021831451 0.021503160 ## stage ascites chol ast spiders hepato ## 0.019718835 0.012550534 0.011115307 0.009845811 0.007601474 0.007055077 ## edema trt alk.phos trig platelet ## 0.006411580 0.003666224 0.002388178 0.001156845 -0.001214167 orsf_vi_permute(fit_no_vi) ## bili copper protime age ascites ## 5.513908e-02 2.181846e-02 1.246900e-02 1.192659e-02 1.176139e-02 ## albumin stage chol spiders edema ## 1.175554e-02 9.479348e-03 6.215674e-03 5.752179e-03 4.960035e-03 ## ast hepato sex trig alk.phos ## 4.647971e-03 3.594325e-03 2.477936e-03 1.162558e-03 6.778008e-05 ## platelet trt ## -1.132546e-03 -1.376816e-03"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"orsf-and-vi-all-at-once","dir":"Reference","previous_headings":"","what":"ORSF and VI all at once","title":"ORSF variable importance — orsf_vi","text":"fit ORSF compute vi time can still get negation VI fit, needs computed","code":"fit_permute_vi <- orsf(pbc_orsf, Surv(time, status) ~ . - id, importance = 'permute') # get the vi instantly (i.e., it doesn't need to be computed again) orsf_vi_permute(fit_permute_vi) ## bili copper protime albumin age ## 0.0582460338 0.0255992039 0.0130100780 0.0129532316 0.0121027391 ## ascites stage chol ast edema ## 0.0119289124 0.0084185175 0.0071302967 0.0053592731 0.0051471990 ## spiders hepato sex trig alk.phos ## 0.0046418826 0.0036776097 0.0026334550 0.0024978806 0.0013078222 ## platelet trt ## 0.0003504423 -0.0013892173 orsf_vi_negate(fit_permute_vi) ## bili copper sex protime age albumin ## 0.1259391254 0.0507141085 0.0363834330 0.0235136073 0.0233592840 0.0225371677 ## stage chol ascites ast spiders edema ## 0.0211978251 0.0141956334 0.0141890702 0.0108977272 0.0073762768 0.0070333453 ## hepato alk.phos trig trt platelet ## 0.0050661672 0.0048879157 0.0044980321 0.0039418881 0.0007189274"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"ORSF variable importance — orsf_vi","text":"Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating Yield Medical Tests. JAMA 1982; 247(18):2543-2546. DOI: 10.1001/jama.1982.03320430047030 Breiman L. Random forests. Machine learning 2001 Oct; 45(1):5-32. DOI: 10.1023/:1010933404324 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":null,"dir":"Reference","previous_headings":"","what":"Variable selection — orsf_vs","title":"Variable selection — orsf_vs","text":"Variable selection","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Variable selection — orsf_vs","text":"","code":"orsf_vs(object, n_predictor_min = 3, verbose_progress = FALSE)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Variable selection — orsf_vs","text":"object (orsf_fit) trained oblique random survival forest (see orsf). n_predictor_min (integer) minimum number predictors allowed verbose_progress (logical) implemented yet. progress printed console?","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Variable selection — orsf_vs","text":"data.table four columns: n_predictors: number predictors used stat_value: --bag statistic predictors_included: names predictors included predictor_dropped: predictor selected dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Variable selection — orsf_vs","text":"tree_seeds specified object successive run orsf evaluated --bag samples initial run.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Variable selection — orsf_vs","text":"","code":"object <- orsf(formula = time + status ~ ., data = pbc_orsf, n_tree = 25, importance = 'anova') orsf_vs(object, n_predictor_min = 15) #> n_predictors stat_value #> 1: 15 0.8263972 #> 2: 16 0.8203552 #> 3: 17 0.8160842 #> 4: 18 0.8402000 #> predictors_included predictor_dropped #> 1: age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... trig #> 2: age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... alk.phos #> 3: trt_placebo,age,sex_f,ascites_1,hepato_1,spiders_1,... trt_placebo #> 4: id,trt_placebo,age,sex_f,ascites_1,hepato_1,... id"},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"data light modification survival::pbc data. modifications :","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"","code":"pbc_orsf"},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"format","dir":"Reference","previous_headings":"","what":"Format","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"data frame 276 rows 20 variables: id case number time number days registration earlier death, transplantion, study analysis July, 1986 status status endpoint, 0 censored transplant, 1 dead trt randomized treatment group: D-penicillmain placebo age years sex m/f ascites presence ascites hepato presence hepatomegaly enlarged liver spiders blood vessel malformations skin edema 0 edema, 0.5 untreated successfully treated, 1 edema despite diuretic therapy bili serum bilirubin (mg/dl) chol serum cholesterol (mg/dl) albumin serum albumin (g/dl) copper urine copper (ug/day) alk.phos alkaline phosphotase (U/liter) ast aspartate aminotransferase, called SGOT (U/ml) trig triglycerides (mg/dl) platelet platelet count protime standardized blood clotting time stage histologic stage disease (needs biopsy)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"source","dir":"Reference","previous_headings":"","what":"Source","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"T Therneau P Grambsch (2000), Modeling Survival Data: Extending Cox Model, Springer-Verlag, New York. ISBN: 0-387-98784-3.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"removed rows missing data converted status 0 censor transplant, 1 dead converted stage ordered factor. converted trt, ascites, hepato, spiders, edema factors.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"data copied lightly modified penguins data palmerpenguins R package. modification removal rows missing data. data include measurements penguin species, island Palmer Archipelago, size (flipper length, body mass, bill dimensions), sex.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"","code":"penguins_orsf"},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"format","dir":"Reference","previous_headings":"","what":"Format","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"tibble 333 rows 8 variables: species factor denoting penguin species (Adélie, Chinstrap Gentoo) island factor denoting island Palmer Archipelago, Antarctica (Biscoe, Dream Torgersen) bill_length_mm number denoting bill length (millimeters) bill_depth_mm number denoting bill depth (millimeters) flipper_length_mm integer denoting flipper length (millimeters) body_mass_g integer denoting body mass (grams) sex factor denoting penguin sex (female, male) year integer denoting study year (2007, 2008, 2009)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"source","dir":"Reference","previous_headings":"","what":"Source","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"Adélie penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Adélie penguins (Pygoscelis adeliae) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 5. Environmental Data Initiative. doi:10.6073/pasta/98b16d7d563f265cb52372c8ca99e60f Gentoo penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Gentoo penguin (Pygoscelis papua) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 5. Environmental Data Initiative. doi:10.6073/pasta/7fca67fb28d56ee2ffa3d9370ebda689 Chinstrap penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Chinstrap penguin (Pygoscelis antarcticus) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 6. Environmental Data Initiative. doi:10.6073/pasta/c14dfcfada8ea13a17536e73eb6fbe9e Originally published : Gorman KB, Williams TD, Fraser WR (2014) Ecological Sexual Dimorphism Environmental Variability within Community Antarctic Penguins (Genus Pygoscelis). PLoS ONE 9(3): e90081. doi:10.1371/journal.pone.0090081","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":null,"dir":"Reference","previous_headings":"","what":"Compute predictions using ORSF — predict.ObliqueForest","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"Predicted risk, survival, hazard, mortality ORSF model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"","code":"# S3 method for ObliqueForest predict( object, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", boundary_checks = TRUE, n_thread = 1, verbose_progress = FALSE, pred_aggregate = TRUE, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"object (orsf_fit) trained oblique random survival forest (see orsf). new_data data.frame, tibble, data.table compute predictions . pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'pass' : output NA rows new_data 1 NA value predictors used object 'omit' : rows new_data incomplete data dropped 'impute_meanmode' : missing values continuous categorical variables new_data imputed using mean mode, respectively. clarify, mean mode used impute missing values training data object, new_data. boundary_checks (logical) TRUE, pred_horizon checked make sure requested values less maximum observed time object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. pred_aggregate (logical) TRUE (default), predictions aggregated trees taking mean. FALSE, returned output contain one row per observation one column tree. length pred_horizon two pred_aggregate FALSE, result list matrices, 'th item list corresponding 'th value pred_horizon. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"matrix predictions. Column j matrix corresponds value j pred_horizon. Row matrix corresponds row new_data.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"new_data must columns equivalent types data used train object. Also, factors new_data must levels data used train object. pred_horizon values exceed maximum follow-time object's training data, truly want , set boundary_checks = FALSE can use pred_horizon large want. Note predictions beyond maximum follow-time object's training data equal predictions maximum follow-time, aorsf estimate survival beyond maximum observed time. unspecified, pred_horizon may automatically specified value used oobag_pred_horizon object created (see orsf).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"Begin fitting ORSF ensemble: Predict risk, survival, cumulative hazard one several times: Predict mortality, defined number events forest’s population observations characteristics like current observation. type prediction require specify prediction horizon","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5) # predicted risk, the default predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'risk', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.45965512 0.73309199 0.89715078 ## [2,] 0.03235764 0.09091330 0.18045864 ## [3,] 0.12091603 0.25919883 0.39403239 ## [4,] 0.01488893 0.03745896 0.07571412 ## [5,] 0.01279842 0.02623832 0.06015808 # predicted survival, i.e., 1 - risk predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'surv', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.5403449 0.2669080 0.1028492 ## [2,] 0.9676424 0.9090867 0.8195414 ## [3,] 0.8790840 0.7408012 0.6059676 ## [4,] 0.9851111 0.9625410 0.9242859 ## [5,] 0.9872016 0.9737617 0.9398419 # predicted cumulative hazard function # (expected number of events for person i at time j) predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'chf', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.65381651 1.28606246 1.75476570 ## [2,] 0.03531788 0.10967272 0.24697387 ## [3,] 0.15371784 0.36989220 0.65462524 ## [4,] 0.01549537 0.04229610 0.09352493 ## [5,] 0.01290261 0.02687956 0.06916273 predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'mort') ## [,1] ## [1,] 79.795533 ## [2,] 22.393743 ## [3,] 38.749709 ## [4,] 13.552788 ## [5,] 9.984989"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":null,"dir":"Reference","previous_headings":"","what":"Inspect your ORSF model — print.ObliqueForest","title":"Inspect your ORSF model — print.ObliqueForest","text":"Printing ORSF model tells : Linear combinations: identified? N observations: Number rows training data N events: Number events training data N trees: Number trees forest N predictors total: Total number columns predictor matrix N predictors per node: Number variables used linear combinations Average leaves per tree: proxy depth trees Min observations leaf: See leaf_min_obs orsf Min events leaf: See leaf_min_events orsf OOB stat value: --bag error fitting trees OOB stat type: --bag error computed? Variable importance: variable importance computed?","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Inspect your ORSF model — print.ObliqueForest","text":"","code":"# S3 method for ObliqueForest print(x, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Inspect your ORSF model — print.ObliqueForest","text":"x (orsf_fit) oblique random survival forest (ORSF; see orsf). ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Inspect your ORSF model — print.ObliqueForest","text":"x, invisibly.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Inspect your ORSF model — print.ObliqueForest","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 5) print(object) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 20.6 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.79 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"Print ORSF summary — print.orsf_summary_uni","title":"Print ORSF summary — print.orsf_summary_uni","text":"Print ORSF summary","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Print ORSF summary — print.orsf_summary_uni","text":"","code":"# S3 method for orsf_summary_uni print(x, n_variables = NULL, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Print ORSF summary — print.orsf_summary_uni","text":"x object class 'orsf_summary' n_variables number variables print ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Print ORSF summary — print.orsf_summary_uni","text":"invisibly, x","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Print ORSF summary — print.orsf_summary_uni","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id) smry <- orsf_summarize_uni(object, n_variables = 3) print(smry) #> #> -- ascites (VI Rank: 1) ------------------------ #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3077270 0.2001923 0.0705980 0.5318454 #> 1 0.4677556 0.4123794 0.2776341 0.6448244 #> #> -- bili (VI Rank: 2) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.80 0.2397950 0.1550060 0.06308384 0.3854908 #> 1.40 0.2608756 0.1657390 0.07482668 0.4249903 #> 3.52 0.3702576 0.3061468 0.17442081 0.5340155 #> #> -- edema (VI Rank: 3) -------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3027980 0.1887166 0.0635760 0.5320489 #> 0.5 0.4035478 0.3550219 0.2083619 0.6029459 #> 1 0.4052181 0.3646119 0.1792339 0.6191445 #> #> Predicted risk at time t = 1788 for top 3 predictors"},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-012-unreleased","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.2 (unreleased)","title":"aorsf 0.1.2 (unreleased)","text":"Added orsf_control functions classification, regression, survival (https://github.com/ropensci/aorsf/pull/25). optimization implemented matrix multiplication prediction (https://github.com/ropensci/aorsf/pull/20)","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-011","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.1","title":"aorsf 0.1.1","text":"CRAN release: 2023-10-26 fixed uninitialized value pd_type","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-010","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.0","title":"aorsf 0.1.0","text":"CRAN release: 2023-10-13 Re-worked internal C++ routines following design ranger. Re-worked progress printed console verbose_progress TRUE, following design ranger. Messages now indicate action taken, % complete, approximate time finishing action. Improved variable importance, following design ranger. Importance now computed tree--tree instead aggregate. Additionally, mortality type prediction used importance survival trees, since mortality depend pred_horizon. Allowed multi-threading performed orsf(), predict.orsf_fit(), functions orsf_vi() orsf_pd() family. Allowed sampling without replacement sampling specific fraction observations orsf() Included Harrell’s C-statistic option assessing goodness splits growing trees. Fixed issue uninformative error message occur pred_horizon > max(time) orsf_summarize_uni. Thanks @JyHao1 @DustinMLong finding !","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-007","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.7","title":"aorsf 0.0.7","text":"CRAN release: 2023-01-12 Additional changes internal testing avoid problems ATLAS","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-006","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.6","title":"aorsf 0.0.6","text":"CRAN release: 2023-01-06 Minor fix internal tests failing run ATLAS","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-005","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.5","title":"aorsf 0.0.5","text":"CRAN release: 2022-12-14 orsf() longer throws errors warnings try give single predictor. note added documentation details ?orsf explains using single predictor orsf() somewhat useless. done resolve https://github.com/mlr-org/mlr3extralearners/issues/259. predict.orsf_fit now accepts pred_horizon = 0 returns sensible values. Thanks @mattwarkentin feature request. added function perform variable selection, orsf_vs(). Made variable importance consistent respect group_factors. Originally, output orsf ungrouped VI values orsf_vi grouped values. update, orsf defaults grouped values. ungrouped values can still recovered. Fixed issue orsf_pd functions output data returned original scale.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-004","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.4","title":"aorsf 0.0.4","text":"CRAN release: 2022-11-07 orsf formulas now accepts Surv objects (see https://github.com/ropensci/aorsf/issues/11) Added verbose_progress input orsf, prints messages console indicating progress. Allowance missing values orsf. Mean mode imputation performed observations missing data. values can also used impute new data missing values. Centering scaling predictors now done prior growing forest.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-003","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.3","title":"aorsf 0.0.3","text":"CRAN release: 2022-10-09 Included rOpenSci reviewers Christopher Jackson, Marvin N Wright, Lukas Burk DESCRIPTION reviewers. Thank ! Added clarification docs pros/cons different variable importance techniques Added regression tests aorsf versus obliqueRSF (similar) Additional support tests functions long right hand sides Updated --bag vignette appropriate custom functions. Allow status values input data general, .e., just 0 1. Allow missing values predict functions, including partial dependence.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-002","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.2","title":"aorsf 0.0.2","text":"CRAN release: 2022-09-05 Modified unit tests compatibility extra checks run CRAN.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-001","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.1","title":"aorsf 0.0.1","text":"CRAN release: 2022-08-23 Added orsf_control_custom(), allows users submit custom functions identifying linear combinations inputs growing oblique decision trees. Added weights input orsf, allowing users fit orsf specific data training set. Added chf mort options predict.orsf_fit(). Mortality predictions fully implemented yet - supported partial dependence --bag error estimates. features added future update.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-0009000","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.0.9000","title":"aorsf 0.0.0.9000","text":"Core features implemented: fit, interpret, predict using oblique random survival forests. Vignettes + Readme covering usage core features. Website hosted GitHub pages, managed pkgdown.","code":""}] +[{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":null,"dir":"","previous_headings":"","what":"Contributing to aorsf","title":"Contributing to aorsf","text":"Want contribute aorsf? Great! aorsf initially stable state development, great deal active subsequent development envisioned. outline propose change aorsf. detailed info contributing , tidyverse packages, please see development contributing guide.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"fixing-typos","dir":"","previous_headings":"","what":"Fixing typos","title":"Contributing to aorsf","text":"can fix typos, spelling mistakes, grammatical errors documentation directly using GitHub web interface, long changes made source file. generally means ’ll need edit roxygen2 comments .R, .Rd file. can find .R file generates .Rd reading comment first line.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"bigger-changes","dir":"","previous_headings":"","what":"Bigger changes","title":"Contributing to aorsf","text":"want make bigger change, ’s good idea first file issue make sure someone team agrees ’s needed. ’ve found bug, please file issue illustrates bug minimal reprex (also help write unit test, needed).","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"pull-request-process","dir":"","previous_headings":"Bigger changes","what":"Pull request process","title":"Contributing to aorsf","text":"Fork package clone onto computer. haven’t done , recommend using usethis::create_from_github(\"ropensci/aorsf\", fork = TRUE). Install development dependencies devtools::install_dev_deps(), make sure package passes R CMD check running devtools::check(). R CMD check doesn’t pass cleanly, ’s good idea ask help continuing. Create Git branch pull request (PR). recommend using usethis::pr_init(\"brief-description--change\"). Make changes, commit git, create PR running usethis::pr_push(), following prompts browser. title PR briefly describe change. body PR contain Fixes #issue-number. user-facing changes, add bullet top NEWS.md (.e. just first header). Follow style described https://style.tidyverse.org/news.html.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"code-style","dir":"","previous_headings":"Bigger changes","what":"Code style","title":"Contributing to aorsf","text":"New code follow tidyverse style guide. can use styler package apply styles, please don’t restyle code nothing PR. use roxygen2, Markdown syntax, documentation. use testthat unit tests. Contributions test cases included easier accept.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"code-of-conduct","dir":"","previous_headings":"","what":"Code of Conduct","title":"Contributing to aorsf","text":"Please note aorsf project released Contributor Code Conduct. contributing project agree abide terms.","code":""},{"path":"https://bcjaeger.github.io/aorsf/LICENSE.html","id":null,"dir":"","previous_headings":"","what":"MIT License","title":"MIT License","text":"Copyright (c) 2022 aorsf authors (Byron C. Jaeger, Sawyer Welden, Nicholas M. Pajewski) Permission hereby granted, free charge, person obtaining copy software associated documentation files (“Software”), deal Software without restriction, including without limitation rights use, copy, modify, merge, publish, distribute, sublicense, /sell copies Software, permit persons Software furnished , subject following conditions: copyright notice permission notice shall included copies substantial portions Software. SOFTWARE PROVIDED “”, WITHOUT WARRANTY KIND, EXPRESS IMPLIED, INCLUDING LIMITED WARRANTIES MERCHANTABILITY, FITNESS PARTICULAR PURPOSE NONINFRINGEMENT. EVENT SHALL AUTHORS COPYRIGHT HOLDERS LIABLE CLAIM, DAMAGES LIABILITY, WHETHER ACTION CONTRACT, TORT OTHERWISE, ARISING , CONNECTION SOFTWARE USE DEALINGS SOFTWARE.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"background","dir":"Articles","previous_headings":"","what":"Background","title":"Introduction to aorsf","text":"oblique random forest (RF) extension traditional (axis-based) RF. Instead using single variable split data grow new branches, trees oblique RF use weighted combination multiple variables.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"oblique-rfs-for-survival-classification-and-regression","dir":"Articles","previous_headings":"","what":"Oblique RFs for survival, classification, and regression","title":"Introduction to aorsf","text":"purpose aorsf (‘’ short accelerated) provide unifying framework fit oblique RFs can scale adequately large data sets. fastest algorithms available package used default often equivalent prediction accuracy computational approaches. Everything aorsf begins orsf() function. begin oblique RF survival using pbc_orsf data. Note n_tree 5 convenience examples, >= 500 practice. Next, oblique RF classification using penguins_orsf data: regression, use penguins data switch outcome: may notice first input aorsf data. design choice makes easier use orsf pipes (.e., %>% |>). instance,","code":"library(aorsf) # An oblique survival RF pbc_fit <- orsf(data = pbc_orsf, n_tree = 5, formula = Surv(time, status) ~ . - id) pbc_fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 21.4 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.77 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> ----------------------------------------- # An oblique classification RF penguin_fit <- orsf(data = penguins_orsf, n_tree = 5, formula = species ~ .) penguin_fit #> ---------- Oblique random classification forest #> #> Linear combinations: Accelerated Logistic regression #> N observations: 333 #> N classes: 3 #> N trees: 5 #> N predictors total: 7 #> N predictors per node: 3 #> Average leaves per tree: 4.4 #> Min observations in leaf: 5 #> OOB stat value: 1.00 #> OOB stat type: AUC-ROC #> Variable importance: anova #> #> ----------------------------------------- # An oblique regression RF bill_fit <- orsf(data = penguins_orsf, n_tree = 5, formula = bill_length_mm ~ .) bill_fit #> ---------- Oblique random regression forest #> #> Linear combinations: Accelerated Linear regression #> N observations: 333 #> N trees: 5 #> N predictors total: 7 #> N predictors per node: 3 #> Average leaves per tree: 49.8 #> Min observations in leaf: 5 #> OOB stat value: 0.67 #> OOB stat type: RSQ #> Variable importance: anova #> #> ----------------------------------------- library(dplyr) pbc_fit <- pbc_orsf |> select(-id) |> orsf(formula = Surv(time, status) ~ ., n_tree = 5)"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"interpretation","dir":"Articles","previous_headings":"","what":"Interpretation","title":"Introduction to aorsf","text":"aorsf includes several functions dedicated interpretation ORSFs, estimation partial dependence variable importance.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"variable-importance","dir":"Articles","previous_headings":"Interpretation","what":"Variable importance","title":"Introduction to aorsf","text":"multiple methods compute variable importance, can applied type oblique forest. compute negation importance, ORSF multiplies coefficient variable -1 re-computes --sample (sometimes referred --bag) accuracy ORSF model. can also compute variable importance using permutation, classical approach noises predictor assigned resulting degradation prediction accuracy importance predictor. faster alternative permutation negation importance ANOVA importance, computes proportion times variable obtains low p-value (p < 0.01) forest grown.","code":"orsf_vi_negate(pbc_fit) #> bili copper ast chol hepato albumin #> 0.153044558 0.048633020 0.019486232 0.019382451 0.017980303 0.016826295 #> spiders ascites edema age protime platelet #> 0.015089265 0.014709375 0.008961668 0.007569484 0.007190698 0.004158973 #> stage trig alk.phos sex trt #> -0.000138520 -0.001763304 -0.001830513 -0.002521630 -0.004025097 orsf_vi_permute(penguin_fit) #> bill_length_mm flipper_length_mm bill_depth_mm body_mass_g #> 0.270966910 0.101162687 0.060985675 0.054666181 #> island sex year #> 0.021916929 0.015026701 -0.002657129 orsf_vi_anova(bill_fit) #> species sex flipper_length_mm island #> 0.43631719 0.12500000 0.08527132 0.08147441 #> body_mass_g bill_depth_mm year #> 0.06034483 0.05000000 0.00000000"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"partial-dependence-pd","dir":"Articles","previous_headings":"Interpretation","what":"Partial dependence (PD)","title":"Introduction to aorsf","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. PD, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"individual-conditional-expectations-ice","dir":"Articles","previous_headings":"Interpretation","what":"Individual conditional expectations (ICE)","title":"Introduction to aorsf","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. ICE, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"what-about-the-original-orsf","dir":"Articles","previous_headings":"","what":"What about the original ORSF?","title":"Introduction to aorsf","text":"original ORSF (.e., obliqueRSF) used glmnet find linear combinations inputs. aorsf allows users implement approach using orsf_control_survival(method = 'net') function: net forests fit lot faster original ORSF function obliqueRSF. However, net forests still much slower cph ones.","code":"orsf_net <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, control = orsf_control_survival(method = 'net'))"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"aorsf-and-other-machine-learning-software","dir":"Articles","previous_headings":"","what":"aorsf and other machine learning software","title":"Introduction to aorsf","text":"unique feature aorsf fast algorithms fit ORSF ensembles. RLT obliqueRSF fit oblique random survival forests, aorsf faster. ranger randomForestSRC fit survival forests, neither package supports oblique splitting. obliqueRF fits oblique random forests classification regression, survival. PPforest fits oblique random forests classification survival. Note: default prediction behavior aorsf models produce predicted risk specific prediction horizon, default ranger randomForestSRC. think change future, computing time independent predictions aorsf helpful.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"learning-more","dir":"Articles","previous_headings":"","what":"Learning more","title":"Introduction to aorsf","text":"aorsf began dedicated package oblique random survival forests, papers published far focused survival analysis risk prediction. However, routines regression classification oblique RFs aorsf high overlap survival ones. See orsf details oblique random survival forests. see JCGS paper details algorithms used specifically aorsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"go-faster","dir":"Articles","previous_headings":"","what":"Go faster","title":"Tips to speed up computation","text":"Analyses can slow crawl models need hours run. article find tricks prevent bottleneck using orsf().","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"dont-specify-a-control","dir":"Articles","previous_headings":"","what":"Don’t specify a control","title":"Tips to speed up computation","text":"default control orsf() NULL , unspecified, orsf() pick fastest possible control depending type forest grown. default control run-time compared approaches can striking. example:","code":"time_fast <- system.time( expr = orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5) ) time_net <- system.time( expr = orsf(pbc_orsf, formula = time+status~. -id, control = orsf_control_survival(method = 'net'), n_tree = 5) ) # control_fast() is much faster time_net['elapsed'] / time_fast['elapsed'] #> elapsed #> 50.8"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"use-n_thread","dir":"Articles","previous_headings":"","what":"Use n_thread","title":"Tips to speed up computation","text":"n_thread argument uses multi-threading run aorsf functions parallel possible. know many threads want, e.g. want exactly 5, just say n_thread = 5. aren’t sure many threads available want use many can, say n_thread = 0 aorsf figure number . R single threaded language, multi-threading applied orsf() needs call R functions C++, occurs customized R function used find linear combination variables compute prediction accuracy.","code":"# automatically pick number of threads based on amount available orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5, n_thread = 0) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 21.2 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.78 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"do-less","dir":"Articles","previous_headings":"","what":"Do less","title":"Tips to speed up computation","text":"defaults orsf() can adjusted make run faster: set n_retry 0 instead 3 (default) set oobag_pred_type ‘none’ instead ‘surv’ (default) set ‘importance’ ‘none’ instead ‘anova’ (default) increase split_min_events, split_min_obs, leaf_min_events, leaf_min_obs make trees stop growing sooner increase split_min_stat make trees stop growing sooner Applying tips: default values make orsf() run slower, also usually make predictions accurate make fit easier interpret.","code":"orsf(pbc_orsf, formula = time+status~., n_thread = 0, n_tree = 5, n_retry = 0, oobag_pred_type = 'none', importance = 'none', split_min_events = 20, leaf_min_events = 10, split_min_stat = 10) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 18 #> N predictors per node: 5 #> Average leaves per tree: 5.8 #> Min observations in leaf: 5 #> Min events in leaf: 10 #> OOB stat value: none #> OOB stat type: none #> Variable importance: none #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"show-progress","dir":"Articles","previous_headings":"","what":"Show progress","title":"Tips to speed up computation","text":"Setting verbose_progress = TRUE doesn’t make anything run faster, can help make feel like things running less slow.","code":"verbose_fit <- orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5, verbose_progress = TRUE) #> Growing trees: 100%. #> Computing predictions: 100%."},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"out-of-bag-data","dir":"Articles","previous_headings":"","what":"Out-of-bag data","title":"Out-of-bag predictions and evaluation","text":"random forests, tree grown bootstrapped version training set. bootstrap samples selected replacement, bootstrapped training set contains two-thirds instances original training set. ‘--bag’ data instances bootstrapped training set.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"out-of-bag-predictions-and-error","dir":"Articles","previous_headings":"","what":"Out-of-bag predictions and error","title":"Out-of-bag predictions and evaluation","text":"tree random forest can make predictions --bag data, --bag predictions can aggregated make ensemble --bag prediction. Since --bag data used grow tree, accuracy ensemble --bag predictions approximate generalization error random forest. --bag prediction error plays central role routines estimate variable importance, e.g. negation importance. Let’s fit oblique random survival forest plot distribution ensemble --bag predictions. surprisingly, survival predictions 0 1. Next, let’s check --bag accuracy fit: --bag estimate 1 (default method evaluate --bag predictions) 0.7436977.","code":"fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, oobag_pred_type = 'surv', n_tree = 5, oobag_pred_horizon = 2000) hist(fit$pred_oobag, main = 'Ensemble out-of-bag survival predictions at t=3,500') # what function is used to evaluate out-of-bag predictions? fit$eval_oobag$stat_type #> [1] 1 # what is the output from this function? fit$eval_oobag$stat_values #> [,1] #> [1,] 0.7436977"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"monitoring-out-of-bag-error","dir":"Articles","previous_headings":"","what":"Monitoring out-of-bag error","title":"Out-of-bag predictions and evaluation","text":"--bag data set contains one-third training set, --bag error estimate usually converges stable value trees added forest. want monitor convergence --bag error oblique random survival forest, can set oobag_eval_every compute --bag error every oobag_eval_every tree. example, let’s compute --bag error fitting tree forest 50 trees: general, least 500 trees recommended random forest fit. ’re just using 10 illustration.","code":"fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, n_tree = 20, tree_seeds = 2, oobag_pred_type = 'surv', oobag_pred_horizon = 2000, oobag_eval_every = 1) plot( x = seq(1, 20, by = 1), y = fit$eval_oobag$stat_values, main = 'Out-of-bag C-statistic computed after each new tree is grown.', xlab = 'Number of trees grown', ylab = fit$eval_oobag$stat_type ) lines(x=seq(1, 20), y = fit$eval_oobag$stat_values)"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"user-supplied-out-of-bag-evaluation-functions","dir":"Articles","previous_headings":"","what":"User-supplied out-of-bag evaluation functions","title":"Out-of-bag predictions and evaluation","text":"cases, may want control --bag error estimated. example, let’s use Brier score SurvMetrics package: two ways apply function compute --bag error. First, can apply function --bag survival predictions stored ‘aorsf’ objects, e.g: Second, can pass function orsf(), used place Harrell’s C-statistic:","code":"oobag_brier_surv <- function(y_mat, w_vec, s_vec){ # output is numeric vector of length 1 as.numeric( SurvMetrics::Brier( object = Surv(time = y_mat[, 1], event = y_mat[, 2]), pre_sp = s_vec, # t_star in Brier() should match oob_pred_horizon in orsf() t_star = 2000 ) ) } oobag_brier_surv(y_mat = pbc_orsf[,c('time', 'status')], s_vec = fit$pred_oobag) #> [1] 0.117498 fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, n_tree = 20, tree_seeds = 2, oobag_pred_horizon = 2000, oobag_fun = oobag_brier_surv, oobag_eval_every = 1) plot( x = seq(1, 20, by = 1), y = fit$eval_oobag$stat_values, main = 'Out-of-bag error computed after each new tree is grown.', sub = 'For the Brier score, lower values indicate more accurate predictions', xlab = 'Number of trees grown', ylab = \"Brier score\" ) lines(x=seq(1, 20), y = fit$eval_oobag$stat_values)"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"specific-instructions-on-user-supplied-functions","dir":"Articles","previous_headings":"User-supplied out-of-bag evaluation functions","what":"Specific instructions on user-supplied functions","title":"Out-of-bag predictions and evaluation","text":"User-supplied functions must: exactly three arguments named y_mat, w_vec, s_vec. return numeric output length 1 either conditions true, error occur. simple test make sure user-supplied function work aorsf package :","code":"# Helper code to make sure your oobag_fun function will work with aorsf # time and status values test_time <- seq(from = 1, to = 5, length.out = 100) test_status <- rep(c(0,1), each = 50) # y-matrix is presumed to contain time and status (with column names) y_mat <- cbind(time = test_time, status = test_status) # s_vec is presumed to be a vector of survival probabilities s_vec <- seq(0.9, 0.1, length.out = 100) # see 1 in the checklist above names(formals(oobag_brier_surv)) == c(\"y_mat\", \"w_vec\", \"s_vec\") #> [1] TRUE TRUE TRUE test_output <- oobag_brier_surv(y_mat = y_mat, w_vec = w_vec, s_vec = s_vec) # test output should be numeric is.numeric(test_output) #> [1] TRUE # test_output should be a numeric value of length 1 length(test_output) == 1 #> [1] TRUE"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"notes","dir":"Articles","previous_headings":"","what":"Notes","title":"Out-of-bag predictions and evaluation","text":"evaluating --bag error: oobag_pred_horizon input orsf() determines prediction horizon --bag predictions. prediction horizon needs specified evaluate prediction accuracy cases, examples . sure check case using functions, , sure oobag_pred_horizon matches prediction horizon used custom function. functions expect predicted risk (.e., 1 - predicted survival), others expect predicted survival. cases, also able use function whatsoever compute --bag prediction error estimating negation permutation importance, assuming passes tests . Unfortunately, exception riskRegression::Score(), one favorites. experimented riskRegression::Score found work try run C++. sure case.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"partial-dependence-pd","dir":"Articles","previous_headings":"","what":"Partial dependence (PD)","title":"PD and ICE curves with ORSF","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. Begin fitting ORSF ensemble. Set prediction horizon 5 years fit ensemble aorsf function pass ensemble assume want compute predictions 5 years.","code":"library(aorsf) pred_horizon <- 365.25 * 5 set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, n_tree = 50, oobag_pred_horizon = pred_horizon) fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 150 #> N events: 52 #> N trees: 50 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 10.26 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.82 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"three-ways-to-compute-pd","dir":"Articles","previous_headings":"","what":"Three ways to compute PD","title":"PD and ICE curves with ORSF","text":"can compute PD three ways aorsf: using -bag predictions training data using --bag predictions training data using predictions new set data -bag PD indicates relationships model learned training. helpful goal interpret model. --bag PD indicates relationships model learned training using --bag data simulates application model new data. want test model’s reliability fairness new data don’t access large testing set. new data PD shows model predicts outcomes observations seen. helpful want test model’s reliability fairness. Let’s re-fit ORSF model available data proceeding next sections.","code":"pd_inb <- orsf_pd_inb(fit, pred_spec = list(bili = 1:5)) pd_inb #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.2092270 0.01550072 0.1062397 0.7518187 #> 2: 1826.25 2 0.2398837 0.02728744 0.1317005 0.7802210 #> 3: 1826.25 3 0.2714311 0.04341724 0.1782770 0.7963900 #> 4: 1826.25 4 0.3253141 0.08765314 0.2433043 0.8281836 #> 5: 1826.25 5 0.3567976 0.11872654 0.2674730 0.8405402 pd_oob <- orsf_pd_oob(fit, pred_spec = list(bili = 1:5)) pd_oob #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.2118379 0.01054286 0.1402358 0.7136371 #> 2: 1826.25 2 0.2444647 0.02511806 0.1799592 0.7557463 #> 3: 1826.25 3 0.2744771 0.03471440 0.1933003 0.7984586 #> 4: 1826.25 4 0.3372186 0.07777410 0.2748979 0.8174482 #> 5: 1826.25 5 0.3687054 0.09913391 0.3112299 0.8486331 pd_test <- orsf_pd_new(fit, new_data = pbc_orsf_test, pred_spec = list(bili = 1:5)) pd_test #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.2568011 0.01602679 0.2090503 0.7726113 #> 2: 1826.25 2 0.2890090 0.03589477 0.2531100 0.8002019 #> 3: 1826.25 3 0.3189690 0.05372495 0.2802965 0.7979415 #> 4: 1826.25 4 0.3713392 0.10139677 0.3347816 0.8157019 #> 5: 1826.25 5 0.4036832 0.12768657 0.3760068 0.8264211 set.seed(329730) fit <- orsf(pbc_orsf, Surv(time, status) ~ . -id, n_tree = 50, oobag_pred_horizon = pred_horizon)"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"one-variable-one-horizon","dir":"Articles","previous_headings":"","what":"One variable, one horizon","title":"PD and ICE curves with ORSF","text":"Computing PD single variable straightforward: output shows expected predicted mortality risk men substantially higher women 5 years baseline.","code":"pd_sex <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\"))) pd_sex #> pred_horizon sex mean lwr medn upr #> 1: 1826.25 m 0.3564520 0.02967837 0.2882201 0.9239640 #> 2: 1826.25 f 0.3143578 0.01025241 0.1993324 0.9417115"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"one-variable-moving-horizon","dir":"Articles","previous_headings":"","what":"One variable, moving horizon","title":"PD and ICE curves with ORSF","text":"effect predictor varies time? PD can show . inspection, can see males higher risk females difference risk grows time. can also seen viewing ratio expected risk time:","code":"pd_sex_tv <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\")), pred_horizon = seq(365, 365*5)) ggplot(pd_sex_tv, aes(x = pred_horizon, y = mean, color = sex)) + geom_line() + labs(x = 'Time since baseline', y = 'Expected risk') library(data.table) ratio_tv <- pd_sex_tv[ , .(ratio = mean[sex == 'm'] / mean[sex == 'f']), by = pred_horizon ] ggplot(ratio_tv, aes(x = pred_horizon, y = ratio)) + geom_line(color = 'grey') + geom_smooth(color = 'black', se = FALSE) + labs(x = 'time since baseline', y = 'ratio in expected risk for males versus females') #> `geom_smooth()` using method = 'gam' and formula = 'y ~ s(x, bs = \"cs\")'"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"multiple-variables-marginally","dir":"Articles","previous_headings":"","what":"Multiple variables, marginally","title":"PD and ICE curves with ORSF","text":"want compute PD marginally multiple variables, just list variable values pred_spec specify expand_grid = FALSE. Now tedious wanted variables? bet. ’s made function . bonus, printed output sorted least important variables. ’s easy enough turn ‘summary’ object data.table downstream plotting tables.","code":"pd_two_vars <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\"), bili = 1:5), expand_grid = FALSE) pd_two_vars #> pred_horizon variable value level mean lwr medn upr #> 1: 1826.25 sex NA m 0.3564520 0.02967837 0.2882201 0.9239640 #> 2: 1826.25 sex NA f 0.3143578 0.01025241 0.1993324 0.9417115 #> 3: 1826.25 bili 1 0.2421478 0.01205421 0.1771471 0.8585054 #> 4: 1826.25 bili 2 0.2992784 0.03112816 0.2207990 0.9007556 #> 5: 1826.25 bili 3 0.3536322 0.06013201 0.2783839 0.9178955 #> 6: 1826.25 bili 4 0.3941406 0.06750719 0.3290965 0.9373161 #> 7: 1826.25 bili 5 0.4239507 0.09721327 0.3734445 0.9406612 pd_smry <- orsf_summarize_uni(fit, n_variables = 4) pd_smry #> #> -- ascites (VI Rank: 1) ------------------------ #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3118350 0.2056567 0.05505108 0.5253575 #> 1 0.4888042 0.4291607 0.28408656 0.6800329 #> #> -- bili (VI Rank: 2) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.80 0.2348378 0.1676975 0.04366000 0.3629356 #> 1.40 0.2656862 0.1909136 0.06576283 0.4016281 #> 3.52 0.3728350 0.3032686 0.15444819 0.5579918 #> #> -- edema (VI Rank: 3) -------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3058974 0.1993324 0.05505108 0.5337264 #> 0.5 0.4021478 0.3710209 0.17711696 0.6120340 #> 1 0.4018115 0.3538034 0.18682381 0.6141621 #> #> -- copper (VI Rank: 4) ------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 42.8 0.2602508 0.1549015 0.04663376 0.4235054 #> 74.0 0.2831359 0.1713812 0.05519991 0.4734346 #> 129 0.3434663 0.2590931 0.10631260 0.5546865 #> #> Predicted risk at time t = 1826.25 for top 4 predictors head(as.data.table(pd_smry)) #> variable importance Value Mean Median 25th % 75th % #> 1: ascites 0.5225225 0 0.3118350 0.2056567 0.05505108 0.5253575 #> 2: ascites 0.5225225 1 0.4888042 0.4291607 0.28408656 0.6800329 #> 3: bili 0.3807339 0.80 0.2348378 0.1676975 0.04366000 0.3629356 #> 4: bili 0.3807339 1.40 0.2656862 0.1909136 0.06576283 0.4016281 #> 5: bili 0.3807339 3.52 0.3728350 0.3032686 0.15444819 0.5579918 #> 6: edema 0.2965828 0 0.3058974 0.1993324 0.05505108 0.5337264 #> pred_horizon level #> 1: 1826.25 0 #> 2: 1826.25 1 #> 3: 1826.25 #> 4: 1826.25 #> 5: 1826.25 #> 6: 1826.25 0"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"multiple-variables-jointly","dir":"Articles","previous_headings":"","what":"Multiple variables, jointly","title":"PD and ICE curves with ORSF","text":"PD can show expected value model’s predictions function specific predictor, function multiple predictors. instance, can estimate predicted risk joint function bili, edema, trt: inspection, model’s predictions indicate slightly lower risk placebo group, seem change much different values bili edema. clear increase predicted risk higher levels edema higher levels bili slope predicted risk function bili appears highest among patients edema 0.5. effect bili modified edema 0.5? quick sanity check coxph suggests .","code":"pred_spec = list(bili = seq(1, 5, length.out = 20), edema = levels(pbc_orsf_train$edema), trt = levels(pbc_orsf$trt)) pd_bili_edema <- orsf_pd_oob(fit, pred_spec) library(ggplot2) ggplot(pd_bili_edema, aes(x = bili, y = medn, col = trt, linetype = edema)) + geom_line() + labs(y = 'Expected predicted risk') library(survival) pbc_orsf$edema_05 <- ifelse(pbc_orsf$edema == '0.5', 'yes', 'no') fit_cph <- coxph(Surv(time,status) ~ edema_05 * bili, data = pbc_orsf) anova(fit_cph) #> Analysis of Deviance Table #> Cox model: response is Surv(time, status) #> Terms added sequentially (first to last) #> #> loglik Chisq Df Pr(>|Chi|) #> NULL -550.19 #> edema_05 -546.83 6.7248 1 0.009508 ** #> bili -513.59 66.4689 1 3.555e-16 *** #> edema_05:bili -510.54 6.1112 1 0.013433 * #> --- #> Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"individual-conditional-expectations-ice","dir":"Articles","previous_headings":"","what":"Individual conditional expectations (ICE)","title":"PD and ICE curves with ORSF","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. Just like PD, can compute ICE using -bag, --bag, testing data, principles apply. ’ll use --bag estimates .","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"visualizing-ice-curves","dir":"Articles","previous_headings":"","what":"Visualizing ICE curves","title":"PD and ICE curves with ORSF","text":"Inspecting ICE curves observation can help identify whether heterogeneity model’s predictions. .e., effect variable follow pattern data, groups variable impacts risk differently? going turn boundary checking orsf_ice_oob setting boundary_checks = FALSE, allow generate ICE curves go beyond 90th percentile bili. id_variable identifier current value variable(s) data. redundant one variable, helpful multiple variables. id_row identifier observation original data. used group observation’s predictions together plots. plots, helpful scale ICE data. subtract initial value predicted risk (.e., bili = 1) observation’s conditional expectation values. , Every curve start 0 plot shows change predicted risk function bili. Now can visualize curves. inspection figure, individual slopes cluster around overall trend - Good! small number individual slopes appear flat. may helpful investigate .","code":"pred_spec <- list(bili = seq(1, 10, length.out = 25)) ice_oob <- orsf_ice_oob(fit, pred_spec, boundary_checks = FALSE) ice_oob #> id_variable id_row pred_horizon bili pred #> 1: 1 1 1826.25 1 0.8743469 #> 2: 1 2 1826.25 1 0.8733466 #> 3: 1 3 1826.25 1 0.7506376 #> 4: 1 4 1826.25 1 0.8355820 #> 5: 1 5 1826.25 1 0.5365481 #> --- #> 6896: 25 272 1826.25 10 0.5260801 #> 6897: 25 273 1826.25 10 0.4911584 #> 6898: 25 274 1826.25 10 0.1958302 #> 6899: 25 275 1826.25 10 0.6267285 #> 6900: 25 276 1826.25 10 0.2922190 ice_oob[, pred_subtract := rep(pred[id_variable==1], times=25)] ice_oob[, pred := pred - pred_subtract] library(ggplot2) ggplot(ice_oob, aes(x = bili, y = pred, group = id_row)) + geom_line(alpha = 0.15) + labs(y = 'Change in predicted risk') + geom_smooth(se = FALSE, aes(group = 1)) #> `geom_smooth()` using method = 'gam' and formula = 'y ~ s(x, bs = \"cs\")'"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"limitations-of-pd","dir":"Articles","previous_headings":"","what":"Limitations of PD","title":"PD and ICE curves with ORSF","text":"Partial dependence number known limitations assumptions users aware (see Hooker, 2021). particular, partial dependence less intuitive >2 predictors examined jointly, assumed feature(s) partial dependence computed correlated features (likely true many cases). Accumulated local effect plots can used (see ) case feature independence valid assumption.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"references","dir":"Articles","previous_headings":"","what":"References","title":"PD and ICE curves with ORSF","text":"Giles Hooker, Lucas Mentch, Siyu Zhou. Unrestricted Permutation forces Extrapolation: Variable Importance Requires least One Model, Free Variable Importance. arXiv e-prints 2021 Oct; arXiv-1905. URL: https://doi.org/10.48550/arXiv.1905.03151","code":""},{"path":"https://bcjaeger.github.io/aorsf/authors.html","id":null,"dir":"","previous_headings":"","what":"Authors","title":"Authors and Citation","text":"Byron Jaeger. Author, maintainer. Nicholas Pajewski. Contributor. Sawyer Welden. Contributor. Christopher Jackson. Reviewer. Marvin Wright. Reviewer. Lukas Burk. Reviewer.","code":""},{"path":"https://bcjaeger.github.io/aorsf/authors.html","id":"citation","dir":"","previous_headings":"","what":"Citation","title":"Authors and Citation","text":"Jaeger et al. (2022). aorsf: R package supervised learning using oblique random survival forest. Journal Open Source Software, 7(77), 4705. https://doi.org/10.21105/joss.04705. Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics. 2023 Aug 3:1-6. Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique Random Survival Forests. Annals Applied Statistics. 13(3): 1847-1883. URL https://doi.org/10.1214/19-AOAS1261 DOI: 10.1214/19-AOAS1261","code":"@Article{, title = {aorsf: An R package for supervised learning using the oblique random survival forest}, author = {Byron C. Jaeger and Sawyer Welden and Kristin Lenoir and Nicholas M. Pajewski}, journal = {Journal of Open Source Software}, year = {2022}, volume = {7}, number = {77}, pages = {4705}, url = {https://doi.org/10.21105/joss.04705}, } @Article{, title = {Accelerated and interpretable oblique random survival forests}, author = {Byron C. Jaeger and Sawyer Welden and Kristin Lenoir and Jaime L. Speiser and Matthew W. Segar and Ambarish Pandey and Nicholas M. Pajewski}, journal = {Journal of Computational and Graphical Statistics}, year = {2023}, url = {https://doi.org/10.1080/10618600.2023.2231048}, } @Article{, title = {Oblique Random Survival Forests}, author = {Byron C. Jaeger and D. Leann Long and Dustin M. Long and Mario Sims and Jeff M. Szychowski and Yuan-I Min and Leslie A. Mcclure and George Howard and Noah Simon}, journal = {Annals of Applied Statistics}, year = {2019}, volume = {13}, number = {3}, pages = {1847--1883}, url = {https://doi.org/10.1214/19-AOAS1261}, }"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"aorsf-","dir":"","previous_headings":"","what":"Accelerated Oblique Random Survival Forests","title":"Accelerated Oblique Random Survival Forests","text":"Fit, interpret, make predictions oblique random forests (RFs).","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"why-aorsf","dir":"","previous_headings":"","what":"Why aorsf?","title":"Accelerated Oblique Random Survival Forests","text":"Hundreds times faster software oblique RFs.1 Accurate predictions.2 Computes partial dependence variable importance.2 Intuitive API formula based interface. Extensive input checks informative error messages.","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"installation","dir":"","previous_headings":"","what":"Installation","title":"Accelerated Oblique Random Survival Forests","text":"can install aorsf CRAN using can install development version aorsf GitHub :","code":"install.packages(\"aorsf\") # install.packages(\"remotes\") remotes::install_github(\"ropensci/aorsf\")"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"what-is-an-oblique-decision-tree","dir":"","previous_headings":"","what":"What is an oblique decision tree?","title":"Accelerated Oblique Random Survival Forests","text":"Decision trees developed splitting set training data two new subsets, goal similarity within new subsets . splitting process repeated resulting subsets data stopping criterion met. new subsets data formed based single predictor, decision tree said axis-based splits data appear perpendicular axis predictor. linear combinations variables used instead single variable, tree oblique splits data neither parallel right angle axis. Figure: Decision trees classification axis-based splitting (left) oblique splitting (right). Cases orange squares; controls purple circles. trees partition predictor space defined variables X1 X2, oblique splits better job separating two classes.","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"examples","dir":"","previous_headings":"","what":"Examples","title":"Accelerated Oblique Random Survival Forests","text":"orsf() function can fit several types oblique RFs. personal favorite accelerated oblique survival RF great combination prediction accuracy computational efficiency (see JCGS paper).2","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5)"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"inspect","dir":"","previous_headings":"Examples","what":"Inspect","title":"Accelerated Oblique Random Survival Forests","text":"Printing output orsf() give information descriptive statistics ensemble. See print.orsf_fit description line printed output. See orsf examples details controlling ORSF ensemble fits using prediction modeling workflows.","code":"fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 150 #> N events: 52 #> N trees: 500 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 10.198 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.84 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"variable-importance","dir":"","previous_headings":"Examples","what":"Variable importance","title":"Accelerated Oblique Random Survival Forests","text":"importance individual variables can estimated three ways using aorsf: negation2: variable assessed separately multiplying variable’s coefficients -1 determining much model’s performance changes. worse model’s performance negating coefficients given variable, important variable. technique promising b/c require permutation emphasizes variables larger coefficients linear combinations, also relatively new hasn’t studied much permutation importance. See Jaeger, (2023) details technique. permutation: variable assessed separately randomly permuting variable’s values determining much model’s performance changes. worse model’s performance permuting values given variable, important variable. technique flexible, intuitive, frequently used. also several known limitations analysis variance (ANOVA)3: p-value computed coefficient linear combination variables decision tree. Importance individual predictor variable proportion times p-value coefficient < 0.01. technique efficient computationally, may effective permutation negation terms selecting signal noise variables. See Menze, 2011 details technique. can supply R function estimate --bag error using negation permutation importance (see oob vignette)","code":"orsf_vi_negate(fit) #> bili sex copper stage age #> 0.1152040355 0.0550384871 0.0346540451 0.0342394602 0.0212811906 #> ast protime hepato chol albumin #> 0.0189147173 0.0179113542 0.0151705980 0.0111316204 0.0107352274 #> edema ascites spiders trig alk.phos #> 0.0101276579 0.0097629480 0.0043991365 0.0031611867 0.0030722039 #> trt platelet #> 0.0024625381 -0.0005569787 orsf_vi_permute(fit) #> bili stage copper age sex #> 0.0487808290 0.0180334035 0.0178325263 0.0124277288 0.0111897854 #> ast hepato edema protime ascites #> 0.0111084077 0.0095618267 0.0082559886 0.0082473977 0.0078725536 #> albumin chol spiders alk.phos trig #> 0.0073437819 0.0057881417 0.0033941136 0.0028194077 0.0019933887 #> platelet trt #> -0.0002101522 -0.0016860907 orsf_vi_anova(fit) #> bili ascites edema sex copper stage age #> 0.48004315 0.43536122 0.38654727 0.31024531 0.29493088 0.27168950 0.26673985 #> hepato ast albumin protime chol spiders trig #> 0.21492921 0.20151679 0.18771331 0.18352060 0.14617169 0.13932292 0.13620489 #> alk.phos platelet trt #> 0.09051254 0.07011494 0.06179067"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"partial-dependence-pd","dir":"","previous_headings":"Examples","what":"Partial dependence (PD)","title":"Accelerated Oblique Random Survival Forests","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. summary function, orsf_summarize_uni(), computes PD many variables ask , using sensible values. PD, see vignette","code":"orsf_summarize_uni(fit, n_variables = 2) #> #> -- bili (VI Rank: 1) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.70 0.2099215 0.1262483 0.05057666 0.3160044 #> 1.30 0.2244830 0.1472311 0.06196578 0.3369922 #> 3.18 0.2932736 0.2263620 0.11896921 0.4424589 #> #> -- ascites (VI Rank: 2) ------------------------ #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.2630294 0.1490837 0.0613327 0.4186542 #> 1 0.3924844 0.3053928 0.2222267 0.5253717 #> #> Predicted risk at time t = 1826.25 for top 2 predictors"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"individual-conditional-expectations-ice","dir":"","previous_headings":"Examples","what":"Individual conditional expectations (ICE)","title":"Accelerated Oblique Random Survival Forests","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. ICE, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"comparison-to-existing-software","dir":"","previous_headings":"","what":"Comparison to existing software","title":"Accelerated Oblique Random Survival Forests","text":"Comparisons aorsf existing software presented JCGS paper. paper: describes aorsf detail summary procedures used tree fitting algorithm runs general benchmark comparing aorsf obliqueRSF several learners reports prediction accuracy computational efficiency learners. runs simulation study comparing variable importance techniques ORSFs, axis based RSFs, boosted trees. reports probability variable importance technique rank relevant variable higher importance irrelevant variable. hands-comparison aorsf R packages provided orsf examples","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"references","dir":"","previous_headings":"","what":"References","title":"Accelerated Oblique Random Survival Forests","text":"Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique random survival forests. Annals applied statistics 2019 Sep; 13(3):1847-83. DOI: 10.1214/19-AOAS1261 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"funding","dir":"","previous_headings":"","what":"Funding","title":"Accelerated Oblique Random Survival Forests","text":"developers aorsf receive financial support Center Biomedical Informatics, Wake Forest University School Medicine. also receive support National Center Advancing Translational Sciences National Institutes Health Award Number UL1TR001420. content solely responsibility authors necessarily represent official views National Institutes Health.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/aorsf-package.html","id":null,"dir":"Reference","previous_headings":"","what":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","title":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","text":"Fit, interpret, make predictions oblique random survival forests. Oblique decision trees notoriously slow compared axis based counterparts, 'aorsf' runs fast faster axis-based decision tree algorithms right-censored time--event outcomes. Methods accelerate interpret oblique random survival forest described Jaeger et al., (2023) doi:10.1080/10618600.2023.2231048 .","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/aorsf-package.html","id":"author","dir":"Reference","previous_headings":"","what":"Author","title":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","text":"Maintainer: Byron Jaeger bjaeger@wakehealth.edu (ORCID) contributors: Nicholas Pajewski [contributor] Sawyer Welden swelden@wakehealth.edu [contributor] Christopher Jackson chris.jackson@mrc-bsu.cam.ac.uk [reviewer] Marvin Wright [reviewer] Lukas Burk [reviewer]","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"Coerce to data.table — as.data.table.orsf_summary_uni","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"Convert 'orsf_summary' object data.table object.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"","code":"# S3 method for orsf_summary_uni as.data.table(x, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"x object class 'orsf_summary_uni' ... used","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"data.table","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"","code":"library(data.table) object <- orsf(pbc_orsf, Surv(time, status) ~ . - id) smry <- orsf_summarize_uni(object, n_variables = 3) as.data.table(smry) #> variable importance value mean medn lwr upr #> 1: ascites 0.4922601 0 0.3067915 0.2127828 0.06450018 0.5323465 #> 2: ascites 0.4922601 1 0.4469048 0.3769895 0.25032774 0.6316547 #> 3: bili 0.4062072 0.80 0.2394577 0.1613976 0.06048064 0.3858617 #> 4: bili 0.4062072 1.40 0.2625021 0.1823690 0.07973927 0.4206238 #> 5: bili 0.4062072 3.52 0.3647897 0.2934823 0.16585086 0.5418694 #> 6: edema 0.3176705 0 0.3002751 0.2055768 0.06355251 0.5233390 #> 7: edema 0.3176705 0.5 0.4159611 0.3924873 0.22324966 0.6142678 #> 8: edema 0.3176705 1 0.4173494 0.3861601 0.17888827 0.6425020 #> pred_horizon level #> 1: 1788 0 #> 2: 1788 1 #> 3: 1788 #> 4: 1788 #> 5: 1788 #> 6: 1788 0 #> 7: 1788 0.5 #> 8: 1788 1"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Oblique Random Survival Forest (ORSF) — orsf","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Fit oblique random survival forest","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"","code":"orsf( data, formula, control = NULL, weights = NULL, n_tree = 500, n_split = 5, n_retry = 3, n_thread = 1, mtry = NULL, sample_with_replacement = TRUE, sample_fraction = 0.632, leaf_min_events = 1, leaf_min_obs = 5, split_rule = NULL, split_min_events = 5, split_min_obs = 10, split_min_stat = NULL, oobag_pred_type = NULL, oobag_pred_horizon = NULL, oobag_eval_every = n_tree, oobag_fun = NULL, importance = \"anova\", importance_max_pvalue = 0.01, group_factors = TRUE, tree_seeds = NULL, attach_data = TRUE, no_fit = FALSE, na_action = \"fail\", verbose_progress = FALSE, ... ) orsf_train(object, attach_data = TRUE)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"data data.frame, tibble, data.table contains relevant variables. formula (formula) Two sided formula single outcome. terms right names predictor variables, symbol '.' may used indicate variables data except response. symbol '-' may also used indicate removal predictor. Details response vary depending forest type: Survival: response include time variable, followed status variable, may written inside call Surv (see examples). Classification: response single variable, variable type factor data. Regression: response single variable, variable typee double integer least 10 unique numeric values data. control (orsf_control) object returned one orsf_control functions: orsf_control_survival, orsf_control_classification, orsf_control_regression. NULL (default) use accelerated control, fastest available option. survival classification, Cox Logistic regression 1 iteration, regression ordinary least squares. weights (numeric vector) Optional. given, input length equal nrow(data) complete imputed data length equal nrow(na.omit(data)) na_action \"omit\". Values weights treated like replication weights, .e., value 2 thing 2 observations data, containing copy corresponding person's data. Use weights cautiously, orsf count number observations events prior growing node tree, higher values weights lead deeper trees. use input, highly recommended scale weights sum(weights) == nrow(data), help make tree depth consistent default weights = rep(1, nrow(data)) n_tree (integer) number trees grow. Default n_tree = 500. n_split (integer) number cut-points assessed splitting node decision trees. Default n_split = 5. n_retry (integer) node splittable, current linear combination inputs unable provide valid split, orsf try new linear combination based different set randomly selected predictors, n_retry times. Default n_retry = 3. Set n_retry = 0 prevent retries. n_thread (integer) number threads use growing trees, computing predictions, computing importance. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. mtry (integer) Number predictors randomly included candidates splitting node. default smallest integer greater square root number total predictors, .e., mtry = ceiling(sqrt(number predictors)) sample_with_replacement (logical) TRUE (default), observations sampled replacement -bag sample created decision tree. FALSE, observations sampled without replacement tree -bag sample containing sample_fraction% original sample. sample_fraction (double) proportion observations trees' -bag sample contain, relative number rows data. used sample_with_replacement FALSE. Default value 0.632. leaf_min_events (integer) minimum number events leaf node. Default leaf_min_events = 1 leaf_min_obs (integer) minimum number observations leaf node. Default leaf_min_obs = 5. split_rule (character) assess quality potential splitting rule node. Valid options survival : 'logrank' : log-rank test statistic (default). 'cstat' : Harrell's concordance statistic. classification, valid options : 'gini' : gini impurity (default) 'cstat' : area underneath ROC curve (AUC-ROC) regression, valid options : 'variance' : variance reduction (default) split_min_events (integer) minimum number events required node consider splitting . Default split_min_events = 5. input relevant survival trees. split_min_obs (integer) minimum number observations required node consider splitting . Default split_min_obs = 10. split_min_stat (double) minimum test statistic required split node. splits found statistic exceeding split_min_stat, given node either becomes leaf retry occurs (n_retry retries). Defaults 3.84 split_rule = 'logrank' 0.50 split_rule = 'cstat' (see first note ) 0.00 split_rule = 'gini' (see second note ) 0.00 split_rule = 'variance' Note 1 C-statistic splitting, C < 0.50, consider statistic value 1 - C allow good 'anti-predictive' splits. , C-statistic initially computed 0.1, considered 1 - 0.10 = 0.90. Note 2 Gini impurity, value 0 1 usually indicate best worst possible scores, respectively. make things simple avoid introducing split_max_stat input, flip values Gini impurity 1 0 indicate best worst possible scores, respectively. oobag_pred_type (character) type --bag predictions compute fitting ensemble. Valid options tree type: 'none' : compute --bag predictions 'leaf' : ID predicted leaf returned tree Valid options survival: 'risk' : probability event occurring oobag_pred_horizon (default). 'surv' : 1 - risk. 'chf' : cumulative hazard function oobag_pred_horizon. 'mort' : mortality, .e., number events expected observations training data identical given observation. Valid options classification: 'prob' : probability class (default) 'class' : class (.e., .max(prob)) Valid options regression: 'mean' : mean value (default) oobag_pred_horizon (numeric) numeric value indicating time used --bag predictions. Default median observed times, .e., oobag_pred_horizon = median(time). input relevant survival trees prediction type 'risk', 'surv', 'chf'. oobag_eval_every (integer) --bag performance ensemble checked every oobag_eval_every trees. , oobag_eval_every = 10, --bag performance checked growing 10th tree, 20th tree, . Default oobag_eval_every = n_tree. oobag_fun (function) used evaluating --bag prediction accuracy every oobag_eval_every trees. oobag_fun = NULL (default), evaluation statistic selected based tree type survival: Harrell's C-statistic (1982) classification: Area underneath ROC curve (AUC-ROC) regression: Traditional prediction R-squared use oobag_fun note following: oobag_fun three inputs: y_mat, w_vec, s_vec survival trees, y_mat two column matrix first column named 'time' second named 'status'. classification trees, y_mat matrix number columns = number distinct classes outcome. regression, y_mat matrix one column. s_vec numeric vector containing predictions oobag_fun return numeric output length 1 details, see --bag vignette. importance (character) Indicate method variable importance: 'none': variable importance computed. 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance details methods, see orsf_vi. importance_max_pvalue (double) relevant importance \"anova\". maximum p-value register positive case counting number times variable found 'significant' tree growth. Default 0.01, recommended Menze et al. group_factors (logical) relevant variable importance estimated. TRUE, importance factor variables reported overall aggregating importance individual levels factor. FALSE, importance individual factor levels returned. tree_seeds (integer vector) Optional. specified, random seeds set using values tree_seeds[] growing tree . Two forests grown number trees seeds exact --bag samples, making --bag error estimates forests comparable. NULL (default), seeds picked random. attach_data (logical) TRUE, copy training data attached output. required plan using functions like orsf_pd_oob orsf_summarize_uni interpret forest using training data. Default TRUE. no_fit (logical) TRUE, model fitting steps defined saved, training initiated. object returned can directly submitted orsf_train() long attach_data TRUE. na_action (character) happen data contains missing values (.e., NA values). Valid options : 'fail' : error thrown data contains NA values 'omit' : rows data incomplete data dropped 'impute_meanmode' : missing values continuous categorical variables data imputed using mean mode, respectively. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. ... arguments passed methods (currently used). object untrained 'aorsf' object, created setting no_fit = TRUE orsf().","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"accelerated oblique RSF object (aorsf)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"function based similar ORSF function obliqueRSF R package. primary difference function runs much faster. speed increase attributable better management memory (.e., unnecessary copies inputs) using Newton Raphson scoring algorithm identify linear combinations inputs rather performing penalized regression using routines glmnet.modified Newton Raphson scoring algorithm function applies adaptation C++ routine developed Terry M. Therneau fits Cox proportional hazards models (see survival::coxph() specifically survival::coxph.fit()).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"details-on-inputs","dir":"Reference","previous_headings":"","what":"Details on inputs","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"formula: response formula can survival object returned Surv function, can also just time status variables. .e., Surv(time, status) ~ . works just like time + status ~ . . symbol right hand side short-hand using variables data (omitting left hand side formula) predictors. order variables left hand side matters. .e., writing status + time ~ . make orsf assume status variable actually time variable. response variable can survival object stored data. example, y ~ . valid formula data$y inherits Surv class. Although can fit oblique random survival forest 1 predictor variable, formula least 2 predictors. reason recommendation linear combination predictors trivial one predictor. mtry: mtry parameter may temporarily reduced ensure least 2 events per predictor variable. occurs using orsf_control_cph coefficients Newton Raphson scoring algorithm may become unstable number covariates greater equal number events. reduction occur using orsf_control_net. oobag_fun: oobag_fun specified, used compute negation importance permutation importance, role ANOVA importance. n_thread: R function must called C++ (.e., user-supplied function compute --bag error identify linear combinations variables), n_thread automatically set 1 attempting run R functions multiple threads cause R session crash.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"what-is-an-oblique-decision-tree-","dir":"Reference","previous_headings":"","what":"What is an oblique decision tree?","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Decision trees developed splitting set training data two new subsets, goal similarity within new subsets . splitting process repeated resulting subsets data stopping criterion met. new subsets data formed based single predictor, decision tree said axis-based splits data appear perpendicular axis predictor. linear combinations variables used instead single variable, tree oblique splits data neither parallel right angle axis Figure : Decision trees classification axis-based splitting (left) oblique splitting (right). Cases orange squares; controls purple circles. trees partition predictor space defined variables X1 X2, oblique splits better job separating two classes.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"what-is-a-random-forest-","dir":"Reference","previous_headings":"","what":"What is a random forest?","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Random forests collections de-correlated decision trees. Predictions tree aggregated make ensemble prediction forest. details, see Breiman el, 2001.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"training-out-of-bag-error-and-testing","dir":"Reference","previous_headings":"","what":"Training, out-of-bag error, and testing","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"random forests, tree grown bootstrapped version training set. bootstrap samples selected replacement, bootstrapped training set contains two-thirds instances original training set. '--bag' data instances bootstrapped training set. tree random forest can make predictions --bag data, --bag predictions can aggregated make ensemble --bag prediction. Since --bag data used grow tree, accuracy ensemble --bag predictions approximate generalization error random forest. Generalization error refers error random forest's predictions applied predict outcomes data used train , .e., testing data.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"missing-data","dir":"Reference","previous_headings":"","what":"Missing data","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Data passed aorsf functions allowed missing values. user impute missing values using R package purpose, recipes mlr3pipelines.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"First load relevant packages entry-point aorsf standard call orsf(): printing fit provides quick descriptive summaries:","code":"set.seed(329730) suppressPackageStartupMessages({ library(aorsf) library(survival) library(tidymodels) library(tidyverse) library(randomForestSRC) library(ranger) library(riskRegression) library(obliqueRSF) }) fit <- orsf(pbc_orsf, Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 20.98 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"model-control","dir":"Reference","previous_headings":"","what":"Model control","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"examples make use orsf_control_ functions build compare models based --bag predictions. also standardize --bag samples using input argument tree_seeds","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"accelerated-linear-combinations","dir":"Reference","previous_headings":"","what":"Accelerated linear combinations","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"accelerated ORSF ensemble default nice balance computational speed prediction accuracy. runs single iteration Newton Raphson scoring Cox partial likelihood function find linear combinations predictors.","code":"fit_accel <- orsf(pbc_orsf, control = orsf_control_survival(), formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-cox-regression","dir":"Reference","previous_headings":"","what":"Linear combinations with Cox regression","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"orsf_control_cph runs Cox regression non-terminal node survival tree, using regression coefficients create linear combinations predictors:","code":"control_cph <- orsf_control_survival(method = 'glm', scale_x = TRUE, max_iter = 20) fit_cph <- orsf(pbc_orsf, control = control_cph, formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-penalized-cox-regression","dir":"Reference","previous_headings":"","what":"Linear combinations with penalized cox regression","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"orsf_control_net runs penalized Cox regression non-terminal node survival tree, using regression coefficients create linear combinations predictors. can really helpful want feature selection within node, lot slower options.","code":"# select 3 predictors out of 5 to be used in # each linear combination of predictors. control_net <- orsf_control_survival(method = 'net', target_df = 3) fit_net <- orsf(pbc_orsf, control = control_net, formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-your-own-function","dir":"Reference","previous_headings":"","what":"Linear combinations with your own function","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Let’s make three customized functions identify linear combinations predictors. first uses random coefficients second derives coefficients principal component analysis. third uses orsf() inside orsf(). can plug functions orsf_control_custom(), pass result orsf(): fit seems work best example? Let’s find evaluating --bag survival predictions. AUC values, highest lowest: indices prediction accuracy: inspection, net, accel, rlt high discrimination index prediction accuracy. rando pca less well, aren’t bad.","code":"f_rando <- function(x_node, y_node, w_node){ matrix(runif(ncol(x_node)), ncol=1) } f_pca <- function(x_node, y_node, w_node) { # estimate two principal components. pca <- stats::prcomp(x_node, rank. = 2) # use the second principal component to split the node pca$rotation[, 1L, drop = FALSE] } # This approach is known as reinforcement learning trees. # some special care is taken to prevent your R session from crashing. # Specifically, random coefficients are used when n_obs <= 10 # or n_events <= 5. f_aorsf <- function(x_node, y_node, w_node){ colnames(y_node) <- c('time', 'status') colnames(x_node) <- paste(\"x\", seq(ncol(x_node)), sep = '') data <- as.data.frame(cbind(y_node, x_node)) if(nrow(data) <= 10 || sum(y_node[,'status']) <= 5) return(matrix(runif(ncol(x_node)), ncol = 1)) fit <- orsf(data, time + status ~ ., weights = as.numeric(w_node), n_tree = 25, importance = 'permute') out <- orsf_vi(fit) # drop the least two important variables n_vars <- length(out) out[c(n_vars, n_vars-1)] <- 0 # ensure out has same variable order as input out <- out[colnames(x_node)] matrix(out, ncol = 1) } fit_rando <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_rando), tree_seeds = 329) fit_pca <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_pca), tree_seeds = 329) fit_rlt <- orsf(pbc_orsf, time + status ~ . - id, control = orsf_control_survival(method = f_aorsf), tree_seeds = 329) risk_preds <- list( accel = 1 - fit_accel$pred_oobag, cph = 1 - fit_cph$pred_oobag, net = 1 - fit_net$pred_oobag, rando = 1 - fit_rando$pred_oobag, pca = 1 - fit_pca$pred_oobag, rlt = 1 - fit_rlt$pred_oobag ) sc <- Score(object = risk_preds, formula = Surv(time, status) ~ 1, data = pbc_orsf, summary = 'IPA', times = fit_accel$pred_horizon) sc$AUC$score[order(-AUC)] ## model times AUC se lower upper ## 1: net 1788 0.9134593 0.02079935 0.8726933 0.9542253 ## 2: rlt 1788 0.9129537 0.01979016 0.8741657 0.9517417 ## 3: accel 1788 0.9112315 0.02098077 0.8701099 0.9523530 ## 4: cph 1788 0.9063871 0.02165434 0.8639453 0.9488288 ## 5: rando 1788 0.9023489 0.02218936 0.8588586 0.9458393 ## 6: pca 1788 0.8994220 0.02201713 0.8562692 0.9425748 sc$Brier$score[order(-IPA), .(model, times, IPA)] ## model times IPA ## 1: net 1788 0.4916038 ## 2: accel 1788 0.4879683 ## 3: cph 1788 0.4751883 ## 4: rlt 1788 0.4640282 ## 5: pca 1788 0.4370592 ## 6: rando 1788 0.4258344 ## 7: Null model 1788 0.0000000"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"tidymodels","dir":"Reference","previous_headings":"","what":"tidymodels","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"example uses tidymodels functions stops short using official tidymodels workflow. working getting aorsf pulled censored package update real workflows happens!","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"comparing-orsf-with-other-learners","dir":"Reference","previous_headings":"","what":"Comparing ORSF with other learners","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Start recipe pre-process data Next create 10-fold cross validation object pre-process data: Define functions ‘workflow’ randomForestSRC, ranger, aorsf. Run ‘workflows’ fold: Next unnest column get back tibble testing data predictions. finish aggregating predictions computing performance testing data. Note computing one statistic predictions instead computing one statistic fold. approach fine smaller testing sets /small event counts. inspection, aorsf obtained slightly higher discrimination (AUC) aorsf obtained higher index prediction accuracy (IPA)","code":"imputer <- recipe(pbc_orsf, formula = time + status ~ .) %>% step_rm(id) %>% step_impute_mean(all_numeric_predictors()) %>% step_impute_mode(all_nominal_predictors()) # 10-fold cross validation; make a container for the pre-processed data analyses <- vfold_cv(data = pbc_orsf, v = 10) %>% mutate(recipe = map(splits, ~prep(imputer, training = training(.x))), train = map(recipe, juice), test = map2(splits, recipe, ~bake(.y, new_data = testing(.x)))) analyses ## # 10-fold cross-validation ## # A tibble: 10 x 5 ## splits id recipe train test ## ## 1 Fold01 ## 2 Fold02 ## 3 Fold03 ## 4 Fold04 ## 5 Fold05 ## 6 Fold06 ## 7 Fold07 ## 8 Fold08 ## 9 Fold09 ## 10 Fold10 rfsrc_wf <- function(train, test, pred_horizon){ # rfsrc does not like tibbles, so cast input data into data.frames train <- as.data.frame(train) test <- as.data.frame(test) rfsrc(formula = Surv(time, status) ~ ., data = train) %>% predictRisk(newdata = test, times = pred_horizon) %>% as.numeric() } ranger_wf <- function(train, test, pred_horizon){ ranger(Surv(time, status) ~ ., data = train) %>% predictRisk(newdata = test, times = pred_horizon) %>% as.numeric() } aorsf_wf <- function(train, test, pred_horizon){ train %>% orsf(Surv(time, status) ~ .,) %>% predict(new_data = test, pred_type = 'risk', pred_horizon = pred_horizon) %>% as.numeric() } # 5 year risk prediction ph <- 365.25 * 5 results <- analyses %>% transmute(test, pred_aorsf = map2(train, test, aorsf_wf, pred_horizon = ph), pred_rfsrc = map2(train, test, rfsrc_wf, pred_horizon = ph), pred_ranger = map2(train, test, ranger_wf, pred_horizon = ph)) results <- results %>% unnest(everything()) glimpse(results) ## Rows: 276 ## Columns: 23 ## $ id 1, 8, 15, 17, 23, 35, 56, 68, 92, 94, 97, 109, 116, 130, 1~ ## $ trt d_penicill_main, placebo, d_penicill_main, placebo, placeb~ ## $ age 58.76523, 53.05681, 64.64613, 52.18344, 55.96715, 48.61875~ ## $ sex f, f, f, f, f, f, f, f, f, f, m, f, f, f, f, f, f, f, f, f~ ## $ ascites 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0~ ## $ hepato 1, 0, 0, 1, 1, 0, 1, 0, 0, 1, 1, 0, 0, 1, 0, 0, 1, 0, 1, 0~ ## $ spiders 1, 0, 0, 0, 1, 0, 1, 0, 0, 1, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0~ ## $ edema 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0.5, 0, 0.5, 0, 0, 0, 0.5, 0~ ## $ bili 14.5, 0.3, 0.8, 2.7, 17.4, 1.2, 1.1, 0.7, 1.4, 3.2, 2.0, 0~ ## $ chol 261, 280, 231, 274, 395, 314, 498, 174, 206, 201, 420, 120~ ## $ albumin 2.60, 4.00, 3.87, 3.15, 2.94, 3.20, 3.80, 4.09, 3.13, 3.11~ ## $ copper 156, 52, 173, 159, 558, 201, 88, 58, 36, 178, 62, 53, 74, ~ ## $ alk.phos 1718.0, 4651.2, 9009.8, 1533.0, 6064.8, 12258.8, 13862.4, ~ ## $ ast 137.95, 28.38, 127.71, 117.80, 227.04, 72.24, 95.46, 71.30~ ## $ trig 172, 189, 96, 128, 191, 151, 319, 46, 70, 69, 91, 52, 382,~ ## $ platelet 190, 373, 295, 224, 214, 431, 365, 203, 145, 188, 344, 271~ ## $ protime 12.2, 11.0, 11.0, 10.5, 11.7, 10.6, 10.6, 10.6, 12.2, 11.8~ ## $ stage 4, 3, 3, 4, 4, 3, 2, 3, 4, 4, 3, 3, 3, 3, 2, 2, 3, 2, 3, 2~ ## $ time 400, 2466, 3584, 769, 264, 2847, 1847, 4039, 388, 750, 611~ ## $ status 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 0, 0, 1, 0, 0, 1, 0, 1, 0~ ## $ pred_aorsf 0.95858574, 0.05070837, 0.22924369, 0.47048899, 0.94442624~ ## $ pred_rfsrc 0.85474291, 0.05480510, 0.31751746, 0.45156052, 0.85784657~ ## $ pred_ranger 0.77897322, 0.04599438, 0.30267242, 0.43467381, 0.77914735~ Score( object = list(aorsf = results$pred_aorsf, rfsrc = results$pred_rfsrc, ranger = results$pred_ranger), formula = Surv(time, status) ~ 1, data = results, summary = 'IPA', times = ph ) ## ## Metric AUC: ## ## Results by model: ## ## model times AUC lower upper ## 1: aorsf 1826 90.7 86.4 95.0 ## 2: rfsrc 1826 89.9 85.6 94.2 ## 3: ranger 1826 89.7 85.5 94.0 ## ## Results of model comparisons: ## ## times model reference delta.AUC lower upper p ## 1: 1826 rfsrc aorsf -0.8 -2.2 0.5 0.2 ## 2: 1826 ranger aorsf -1.0 -2.5 0.5 0.2 ## 3: 1826 ranger rfsrc -0.1 -1.3 1.0 0.8 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The higher AUC the better. ## ## Metric Brier: ## ## Results by model: ## ## model times Brier lower upper IPA ## 1: Null model 1826.25 20.5 18.1 22.9 0.0 ## 2: aorsf 1826.25 10.8 8.6 13.0 47.3 ## 3: rfsrc 1826.25 11.8 9.7 13.9 42.5 ## 4: ranger 1826.25 11.9 9.8 14.0 41.9 ## ## Results of model comparisons: ## ## times model reference delta.Brier lower upper p ## 1: 1826.25 aorsf Null model -9.7 -12.3 -7.1 2.179169e-13 ## 2: 1826.25 rfsrc Null model -8.7 -11.0 -6.4 3.915661e-14 ## 3: 1826.25 ranger Null model -8.6 -10.9 -6.2 8.869452e-13 ## 4: 1826.25 rfsrc aorsf 1.0 0.3 1.7 5.383491e-03 ## 5: 1826.25 ranger aorsf 1.1 0.5 1.7 7.890574e-04 ## 6: 1826.25 ranger rfsrc 0.1 -0.4 0.6 6.310608e-01 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The lower Brier the better, the higher IPA the better."},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"mlr-pipelines","dir":"Reference","previous_headings":"","what":"mlr3 pipelines","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Warning: code may may run depending current version mlr3proba. First load additional mlr3 libraries. Next ’ll define tasks learners engage . Now can make benchmark designed compare three favorite learners: Let’s look overall results: inspection, aorsf higher expected value ‘surv.cindex’ (higher better) aorsf lower expected value ‘surv.graf’ (lower better)","code":"suppressPackageStartupMessages({ library(mlr3verse) library(mlr3proba) library(mlr3extralearners) library(mlr3viz) library(mlr3benchmark) }) # Mayo Clinic Primary Biliary Cholangitis Data task_pbc <- TaskSurv$new( id = 'pbc', backend = select(pbc_orsf, -id) %>% mutate(stage = as.numeric(stage)), time = \"time\", event = \"status\" ) # Veteran's Administration Lung Cancer Trial data(veteran, package = \"randomForestSRC\") task_veteran <- TaskSurv$new( id = 'veteran', backend = veteran, time = \"time\", event = \"status\" ) # NKI 70 gene signature data_nki <- OpenML::getOMLDataSet(data.id = 1228) task_nki <- TaskSurv$new( id = 'nki', backend = data_nki$data, time = \"time\", event = \"event\" ) # Gene Expression-Based Survival Prediction in Lung Adenocarcinoma data_lung <- OpenML::getOMLDataSet(data.id = 1245) task_lung <- TaskSurv$new( id = 'nki', backend = data_lung$data %>% mutate(OS_event = as.numeric(OS_event) -1), time = \"OS_years\", event = \"OS_event\" ) # Chemotherapy for Stage B/C colon cancer # (there are two rows per person, one for death # and the other for recurrence, hence the two tasks) task_colon_death <- TaskSurv$new( id = 'colon_death', backend = survival::colon %>% filter(etype == 2) %>% drop_na() %>% # drop id, redundant variables select(-id, -study, -node4, -etype), mutate(OS_event = as.numeric(OS_event) -1), time = \"time\", event = \"status\" ) task_colon_recur <- TaskSurv$new( id = 'colon_death', backend = survival::colon %>% filter(etype == 1) %>% drop_na() %>% # drop id, redundant variables select(-id, -study, -node4, -etype), mutate(OS_event = as.numeric(OS_event) -1), time = \"time\", event = \"status\" ) # putting them all together tasks <- list(task_pbc, task_veteran, task_nki, task_lung, task_colon_death, task_colon_recur, # add a few more pre-made ones tsk(\"actg\"), tsk('gbcs'), tsk('grace'), tsk(\"unemployment\"), tsk(\"whas\")) # Learners with default parameters learners <- lrns(c(\"surv.ranger\", \"surv.rfsrc\", \"surv.aorsf\")) # Brier (Graf) score, c-index and training time as measures measures <- msrs(c(\"surv.graf\", \"surv.cindex\", \"time_train\")) # Benchmark with 5-fold CV design <- benchmark_grid( tasks = tasks, learners = learners, resamplings = rsmps(\"cv\", folds = 5) ) benchmark_result <- benchmark(design) bm_scores <- benchmark_result$score(measures, predict_sets = \"test\") bm_scores %>% select(task_id, learner_id, surv.graf, surv.cindex, time_train) %>% group_by(learner_id) %>% filter(!is.infinite(surv.graf)) %>% summarize( across( .cols = c(surv.graf, surv.cindex, time_train), .fns = ~mean(.x, na.rm = TRUE) ) ) ## # A tibble: 3 x 4 ## learner_id surv.graf surv.cindex time_train ## ## 1 surv.aorsf 0.150 0.734 0.383 ## 2 surv.ranger 0.164 0.716 2.04 ## 3 surv.rfsrc 0.155 0.724 0.757"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating Yield Medical Tests. JAMA 1982; 247(18):2543-2546. DOI: 10.1001/jama.1982.03320430047030 Breiman L. Random forests. Machine learning 2001 Oct; 45(1):5-32. DOI: 10.1023/:1010933404324 Ishwaran H, Kogalur UB, Blackstone EH, Lauer MS. Random survival forests. Annals applied statistics 2008 Sep; 2(3):841-60. DOI: 10.1214/08-AOAS169 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29 Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique random survival forests. Annals applied statistics 2019 Sep; 13(3):1847-83. DOI: 10.1214/19-AOAS1261 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":null,"dir":"Reference","previous_headings":"","what":"Oblique random forest control — orsf_control","title":"Oblique random forest control — orsf_control","text":"Oblique random forest control","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Oblique random forest control — orsf_control","text":"","code":"orsf_control( tree_type, method, scale_x, ties, net_mix, target_df, max_iter, epsilon, ... ) orsf_control_classification( method = \"glm\", scale_x = TRUE, net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... ) orsf_control_regression( method = \"glm\", scale_x = TRUE, net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... ) orsf_control_survival( method = \"glm\", scale_x = TRUE, ties = \"efron\", net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Oblique random forest control — orsf_control","text":"tree_type (character) type tree. Valid options \"classification\", .e., categorical outcomes \"regression\", .e., continuous outcomes \"survival\", .e., time-event outcomes method (character function) identify linear linear combinations predictors. method character value, must one : 'glm': linear, logistic, cox regression 'net': 'glm' penalty terms 'pca': principal component analysis 'random': random draw uniform distribution method function, used identify linear combinations predictor variables. method must case accept three inputs named x_node, y_node w_node, expect following types dimensions: x_node (matrix; n rows, p columns) y_node (matrix; n rows, 2 columns) w_node (matrix; n rows, 1 column) addition, method must return matrix p rows 1 column. scale_x (logical) TRUE, values predictors scaled prior instance finding linear combination predictors, using summary values data current node decision tree. ties (character) character string specifying method tie handling. relevant modeling survival outcomes using method engages tied outcome times. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. net_mix (double) elastic net mixing parameter. value 1 gives lasso penalty, value 0 gives ridge penalty. multiple values alpha given, penalized model fit using alpha value prior splitting node. target_df (integer) Preferred number variables used linear combination. example, mtry 5 target_df 3, sample 5 predictors look best linear combination using 3 . max_iter (integer) iteration continues convergence (see eps ) number attempted iterations equal iter_max. epsilon (double) using modeling based method, iteration continues algorithm relative change kind objective less epsilon, absolute change less sqrt(epsilon). ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Oblique random forest control — orsf_control","text":"object class 'orsf_control', used input control argument orsf. Components : tree_type: type trees fit lincomb_type: method linear combinations lincomb_eps: epsilon convergence lincomb_iter_max: max iterations lincomb_scale: scale . lincomb_alpha: mixing parameter lincomb_df_target: target degrees freedom lincomb_ties_method: method ties survival time lincomb_R_function: R function custom splits","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Oblique random forest control — orsf_control","text":"Adjust scale_x risk. Setting scale_x = FALSE reduce computation time also make orsf model dependent scale data, default value TRUE.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":null,"dir":"Reference","previous_headings":"","what":"Cox regression ORSF control — orsf_control_cph","title":"Cox regression ORSF control — orsf_control_cph","text":"Use coefficients proportional hazards model create linear combinations predictor variables fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Cox regression ORSF control — orsf_control_cph","text":"","code":"orsf_control_cph(method = \"efron\", eps = 1e-09, iter_max = 20, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Cox regression ORSF control — orsf_control_cph","text":"method (character) character string specifying method tie handling. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. eps (double) using Newton Raphson scoring identify linear combinations inputs, iteration continues algorithm relative change log partial likelihood less eps, absolute change less sqrt(eps). Must positive. default value 1e-09 used consistency survival::coxph.control. iter_max (integer) iteration continues convergence (see eps ) number attempted iterations equal iter_max. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Cox regression ORSF control — orsf_control_cph","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Cox regression ORSF control — orsf_control_cph","text":"code survival package modified make routine. details Cox proportional hazards model, see coxph /Therneau Grambsch (2000).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Cox regression ORSF control — orsf_control_cph","text":"Therneau T.M., Grambsch P.M. (2000) Cox Model. : Modeling Survival Data: Extending Cox Model. Statistics Biology Health. Springer, New York, NY. DOI: 10.1007/978-1-4757-3294-8_3","code":""},{"path":[]},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Custom ORSF control — orsf_control_custom","text":"","code":"orsf_control_custom(beta_fun, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Custom ORSF control — orsf_control_custom","text":"beta_fun (function) function define coefficients used linear combinations predictor variables. beta_fun must accept three inputs named x_node, y_node w_node, expect following types dimensions: x_node (matrix; n rows, p columns) y_node (matrix; n rows, 2 columns) w_node (matrix; n rows, 1 column) addition, beta_fun must return matrix p rows 1 column. conditions met, orsf_control_custom() let know. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Custom ORSF control — orsf_control_custom","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Custom ORSF control — orsf_control_custom","text":"Two customized functions identify linear combinations predictors shown . first uses random coefficients second derives coefficients principal component analysis.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"random-coefficients","dir":"Reference","previous_headings":"","what":"Random coefficients","title":"Custom ORSF control — orsf_control_custom","text":"f_rando() function get random coefficients: can plug f_rando orsf_control_survival(), pass result orsf():","code":"f_rando <- function(x_node, y_node, w_node){ matrix(runif(ncol(x_node)), ncol=1) } library(aorsf) fit_rando <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_rando), n_tree = 500) fit_rando ## ---------- Oblique random survival forest ## ## Linear combinations: Custom user function ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 19.682 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.83 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"principal-components","dir":"Reference","previous_headings":"","what":"Principal components","title":"Custom ORSF control — orsf_control_custom","text":"Follow steps , starting custom function: plug function orsf_control_survival() pass result orsf():","code":"f_pca <- function(x_node, y_node, w_node) { # estimate two principal components. pca <- stats::prcomp(x_node, rank. = 2) # use the second principal component to split the node pca$rotation[, 2L, drop = FALSE] } fit_pca <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_pca), n_tree = 500)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"evaluate","dir":"Reference","previous_headings":"","what":"Evaluate","title":"Custom ORSF control — orsf_control_custom","text":"well two customized ORSFs ? Let’s compute indices prediction accuracy based --bag predictions: PCA ORSF quite well! (higher IPA better)","code":"library(riskRegression) ## riskRegression version 2023.09.08 library(survival) risk_preds <- list(rando = 1 - fit_rando$pred_oobag, pca = 1 - fit_pca$pred_oobag) sc <- Score(object = risk_preds, formula = Surv(time, status) ~ 1, data = pbc_orsf, summary = 'IPA', times = fit_pca$pred_horizon) sc$Brier ## ## Results by model: ## ## model times Brier lower upper IPA ## 1: Null model 1788 20.479 18.090 22.868 0.000 ## 2: rando 1788 11.872 9.771 13.972 42.031 ## 3: pca 1788 12.990 10.971 15.009 36.569 ## ## Results of model comparisons: ## ## times model reference delta.Brier lower upper p ## 1: 1788 rando Null model -8.607 -10.809 -6.406 1.832790e-14 ## 2: 1788 pca Null model -7.489 -9.213 -5.765 1.664802e-17 ## 3: 1788 pca rando 1.118 0.258 1.979 1.087482e-02 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The lower Brier the better, the higher IPA the better."},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":null,"dir":"Reference","previous_headings":"","what":"Accelerated ORSF control — orsf_control_fast","title":"Accelerated ORSF control — orsf_control_fast","text":"Fast methods identify linear combinations predictors fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Accelerated ORSF control — orsf_control_fast","text":"","code":"orsf_control_fast(method = \"efron\", do_scale = TRUE, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Accelerated ORSF control — orsf_control_fast","text":"method (character) character string specifying method tie handling. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. do_scale (logical) TRUE, values predictors scaled prior instance Newton Raphson scoring, using summary values data current node decision tree. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Accelerated ORSF control — orsf_control_fast","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Accelerated ORSF control — orsf_control_fast","text":"code survival package modified make routine. Adjust do_scale risk. Setting do_scale = FALSE reduce computation time also make orsf model dependent scale data, default value TRUE.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":null,"dir":"Reference","previous_headings":"","what":"Penalized Cox regression ORSF control — orsf_control_net","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"Use regularized Cox proportional hazard models identify linear combinations input variables fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"","code":"orsf_control_net(alpha = 1/2, df_target = NULL, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"alpha (double) elastic net mixing parameter. value 1 gives lasso penalty, value 0 gives ridge penalty. multiple values alpha given, penalized model fit using alpha value prior splitting node. df_target (integer) Preferred number variables used linear combination. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"df_target less mtry, separate argument orsf indicates number variables chosen random prior finding linear combination variables.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"Simon N, Friedman J, Hastie T, Tibshirani R. Regularization paths Cox's proportional hazards model via coordinate descent. Journal statistical software 2011 Mar; 39(5):1. DOI: 10.18637/jss.v039.i05","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF Individual Conditional Expectations — orsf_ice_oob","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"Compute individual conditional expectations ORSF model. Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. can compute individual conditional expectations three ways using random forest: using -bag predictions training data using --bag predictions training data using predictions new set data See examples details","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"","code":"orsf_ice_oob( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... ) orsf_ice_inb( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... ) orsf_ice_new( object, pred_spec, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"object (orsf_fit) trained oblique random survival forest (see orsf). pred_spec (named list data.frame). pred_spec named list, item list vector values used points partial dependence function. name item list indicate variable modified take corresponding values. pred_spec data.frame, columns indicate variable names, values indicate variable values, partial dependence computed using inputs row. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction expand_grid (logical) TRUE, partial dependence computed possible combinations inputs pred_spec. FALSE, partial dependence computed variable pred_spec, separately. boundary_checks (logical) TRUE, pred_spec checked make sure requested values 10th 90th percentile object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. ... arguments passed methods (currently used). new_data data.frame, tibble, data.table compute predictions . na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'omit' : rows new_data incomplete data dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"data.table containing individual conditional expectations specified variable(s) specified prediction horizon(s).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"Begin fitting ORSF ensemble Use ensemble compute ICE values using --bag predictions: Much detailed examples given vignette","code":"library(aorsf) set.seed(329) fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 21.026 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## ----------------------------------------- pred_spec <- list(bili = seq(1, 10, length.out = 25)) ice_oob <- orsf_ice_oob(fit, pred_spec, boundary_checks = FALSE) ice_oob ## id_variable id_row pred_horizon bili pred ## 1: 1 1 1788 1 0.1264442 ## 2: 1 2 1788 1 0.1739727 ## 3: 1 3 1788 1 0.3904517 ## 4: 1 4 1788 1 0.2874752 ## 5: 1 5 1788 1 0.4398522 ## --- ## 6896: 25 272 1788 10 0.3076971 ## 6897: 25 273 1788 10 0.4942110 ## 6898: 25 274 1788 10 0.6407498 ## 6899: 25 275 1788 10 0.3871298 ## 6900: 25 276 1788 10 0.6479179"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF partial dependence — orsf_pd_oob","title":"ORSF partial dependence — orsf_pd_oob","text":"Compute partial dependence ORSF model. Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model's prediction. can compute partial dependence three ways using random forest: using -bag predictions training data using --bag predictions training data using predictions new set data See examples details","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF partial dependence — orsf_pd_oob","text":"","code":"orsf_pd_oob( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... ) orsf_pd_inb( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... ) orsf_pd_new( object, pred_spec, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF partial dependence — orsf_pd_oob","text":"object (orsf_fit) trained oblique random survival forest (see orsf). pred_spec (named list data.frame). pred_spec named list, item list vector values used points partial dependence function. name item list indicate variable modified take corresponding values. pred_spec data.frame, columns indicate variable names, values indicate variable values, partial dependence computed using inputs row. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction expand_grid (logical) TRUE, partial dependence computed possible combinations inputs pred_spec. FALSE, partial dependence computed variable pred_spec, separately. prob_values (numeric) vector values 0 1, indicating quantiles used summarize partial dependence values set inputs. prob_values length prob_labels. quantiles calculated based predictions object set values indicated pred_spec. prob_labels (character) vector labels length prob_values, label indicating corresponding value prob_values labelled summarized outputs. prob_labels length prob_values. boundary_checks (logical) TRUE, pred_spec checked make sure requested values 10th 90th percentile object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. ... arguments passed methods (currently used). new_data data.frame, tibble, data.table compute predictions . na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'omit' : rows new_data incomplete data dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF partial dependence — orsf_pd_oob","text":"data.table containing partial dependence values specified variable(s) specified prediction horizon(s).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF partial dependence — orsf_pd_oob","text":"Partial dependence number known limitations assumptions users aware (see Hooker, 2021). particular, partial dependence less intuitive >2 predictors examined jointly, assumed feature(s) partial dependence computed correlated features (likely true many cases). Accumulated local effect plots can used (see ) case feature independence valid assumption.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF partial dependence — orsf_pd_oob","text":"Begin fitting ORSF ensemble:","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"three-ways-to-compute-pd-and-ice","dir":"Reference","previous_headings":"","what":"Three ways to compute PD and ICE","title":"ORSF partial dependence — orsf_pd_oob","text":"can compute partial dependence ICE three ways aorsf: using -bag predictions training data using --bag predictions training data using predictions new set data -bag partial dependence indicates relationships model learned training. helpful goal interpret model. --bag partial dependence indicates relationships model learned training using --bag data simulates application model new data. want test model’s reliability fairness new data don’t access large testing set. new data partial dependence shows model predicts outcomes observations seen. helpful want test model’s reliability fairness.","code":"pd_train <- orsf_pd_inb(fit, pred_spec = list(bili = 1:5)) pd_train ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7932390 0.2177461 0.9060625 0.9816153 ## 2: 1826.25 2 0.7642403 0.1988035 0.8717127 0.9710504 ## 3: 1826.25 3 0.7240284 0.1770122 0.8303501 0.9480047 ## 4: 1826.25 4 0.6744615 0.1615326 0.7599508 0.9088882 ## 5: 1826.25 5 0.6313355 0.1553589 0.7152580 0.8658139 pd_train <- orsf_pd_oob(fit, pred_spec = list(bili = 1:5)) pd_train ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7840481 0.2727537 0.8694252 0.9809905 ## 2: 1826.25 2 0.7549406 0.2525478 0.8333524 0.9693362 ## 3: 1826.25 3 0.7158234 0.2364582 0.7890158 0.9461864 ## 4: 1826.25 4 0.6656823 0.2260407 0.7158336 0.9151153 ## 5: 1826.25 5 0.6225353 0.2071656 0.6734005 0.8681677 pd_test <- orsf_pd_new(fit, new_data = pbc_orsf_test, pred_spec = list(bili = 1:5)) pd_test ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7524101 0.1868769 0.8121185 0.9803382 ## 2: 1826.25 2 0.7234050 0.1759562 0.7754099 0.9653244 ## 3: 1826.25 3 0.6816975 0.1581292 0.7224945 0.9403449 ## 4: 1826.25 4 0.6339907 0.1467816 0.6598026 0.9000773 ## 5: 1826.25 5 0.5911775 0.1387876 0.6186801 0.8504577"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"ORSF partial dependence — orsf_pd_oob","text":"Giles Hooker, Lucas Mentch, Siyu Zhou. Unrestricted Permutation forces Extrapolation: Variable Importance Requires least One Model, Free Variable Importance. arXiv e-prints 2021 Oct; arXiv-1905. URL: https://doi.org/10.48550/arXiv.1905.03151","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":null,"dir":"Reference","previous_headings":"","what":"Scale input data — orsf_scale_cph","title":"Scale input data — orsf_scale_cph","text":"functions exported users may access internal routines used scale inputs orsf_control_cph used.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Scale input data — orsf_scale_cph","text":"","code":"orsf_scale_cph(x_mat, w_vec = NULL) orsf_unscale_cph(x_mat)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Scale input data — orsf_scale_cph","text":"x_mat (numeric matrix) matrix values scaled unscaled. Note orsf_unscale_cph accept x_mat inputs attribute containing transform values, added automatically orsf_scale_cph. w_vec (numeric vector) optional vector weights. weights supplied (default), observations equally weighted. supplied, w_vec must length equal nrow(x_mat).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Scale input data — orsf_scale_cph","text":"scaled unscaled x_mat.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Scale input data — orsf_scale_cph","text":"data transformed first subtracting mean multiplying scale. inverse transform can completed using orsf_unscale_cph dividing column corresponding scale adding mean. values means scales stored attribute output returned orsf_scale_cph (see examples)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Scale input data — orsf_scale_cph","text":"","code":"x_mat <- as.matrix(pbc_orsf[, c('bili', 'age', 'protime')]) head(x_mat) #> bili age protime #> 1 14.5 58.76523 12.2 #> 2 1.1 56.44627 10.6 #> 3 1.4 70.07255 12.0 #> 4 1.8 54.74059 10.3 #> 5 3.4 38.10541 10.9 #> 7 1.0 55.53457 9.7 x_scaled <- orsf_scale_cph(x_mat) head(x_scaled) #> bili age protime #> [1,] 3.77308887 1.0412574 1.9694656 #> [2,] -0.75476469 0.7719344 -0.1822316 #> [3,] -0.65339483 2.3544852 1.7005035 #> [4,] -0.51823502 0.5738373 -0.5856748 #> [5,] 0.02240421 -1.3581657 0.2212116 #> [6,] -0.78855464 0.6660494 -1.3925613 attributes(x_scaled) # note the transforms attribute #> $dim #> [1] 276 3 #> #> $dimnames #> $dimnames[[1]] #> NULL #> #> $dimnames[[2]] #> [1] \"bili\" \"age\" \"protime\" #> #> #> $transforms #> mean scale #> [1,] 3.333696 0.3378995 #> [2,] 49.799661 0.1161396 #> [3,] 10.735507 1.3448108 #> x_unscaled <- orsf_unscale_cph(x_scaled) head(x_unscaled) #> bili age protime #> [1,] 14.5 58.76523 12.2 #> [2,] 1.1 56.44627 10.6 #> [3,] 1.4 70.07255 12.0 #> [4,] 1.8 54.74059 10.3 #> [5,] 3.4 38.10541 10.9 #> [6,] 1.0 55.53457 9.7 # numeric difference in x_mat and x_unscaled should be practically 0 max(abs(x_mat - x_unscaled)) #> [1] 3.552714e-15"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF summary; univariate — orsf_summarize_uni","title":"ORSF summary; univariate — orsf_summarize_uni","text":"Summarize univariate information ORSF object","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF summary; univariate — orsf_summarize_uni","text":"","code":"orsf_summarize_uni( object, n_variables = NULL, pred_horizon = NULL, pred_type = NULL, importance = NULL, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF summary; univariate — orsf_summarize_uni","text":"object (orsf_fit) trained oblique random survival forest (see orsf). n_variables (integer) many variables summarized? Setting input lower number reduce computation time. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction importance (character) Indicate method variable importance: 'none': variable importance computed. 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance details methods, see orsf_vi. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF summary; univariate — orsf_summarize_uni","text":"object class 'orsf_summary', includes data importance individual predictors. expected values predictions specific values predictors.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF summary; univariate — orsf_summarize_uni","text":"pred_horizon left unspecified, median value time--event variable object's training data used. recommended always specify prediction horizon, median time may especially meaningful horizon compute predicted risk values . object already variable importance values, can safely bypass computation variable importance function setting importance = 'none'.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF summary; univariate — orsf_summarize_uni","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 25) # since anova importance was used to make object, it is also # used for ranking variables in the summary, unless we specify # a different type of importance orsf_summarize_uni(object, n_variables = 3) #> #> -- ascites (VI Rank: 1) ------------------------ #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3040873 0.1956687 0.04602941 0.5045504 #> 1 0.4974976 0.4638980 0.32045574 0.6810480 #> #> -- bili (VI Rank: 2) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.80 0.2288651 0.1434553 0.04150904 0.3468400 #> 1.40 0.2487791 0.1674784 0.05434565 0.3729538 #> 3.52 0.3911358 0.3464777 0.20956700 0.5310261 #> #> -- edema (VI Rank: 3) -------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3004761 0.1916197 0.04602941 0.5019744 #> 0.5 0.4213227 0.4141359 0.16768999 0.6226272 #> 1 0.4210003 0.4080320 0.17669578 0.6328263 #> #> Predicted risk at time t = 1788 for top 3 predictors # if we want to summarize object according to variables # ranked by negation importance, we can compute negation # importance within orsf_summarize_uni() as follows: orsf_summarize_uni(object, n_variables = 3, importance = 'negate') #> #> -- bili (VI Rank: 1) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.80 0.2288651 0.1434553 0.04150904 0.3468400 #> 1.40 0.2487791 0.1674784 0.05434565 0.3729538 #> 3.52 0.3911358 0.3464777 0.20956700 0.5310261 #> #> -- copper (VI Rank: 2) ------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 42.8 0.2777923 0.1678304 0.04222316 0.4476773 #> 74.0 0.2907817 0.1767469 0.04488256 0.4685898 #> 129 0.3327518 0.2343686 0.08382702 0.5373931 #> #> -- sex (VI Rank: 3) ---------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> m 0.3380225 0.2689282 0.08670841 0.5455287 #> f 0.3055802 0.1815720 0.04748219 0.5132384 #> #> Predicted risk at time t = 1788 for top 3 predictors"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":null,"dir":"Reference","previous_headings":"","what":"Estimate training time — orsf_time_to_train","title":"Estimate training time — orsf_time_to_train","text":"Estimate training time","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Estimate training time — orsf_time_to_train","text":"","code":"orsf_time_to_train(object, n_tree_subset = 50)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Estimate training time — orsf_time_to_train","text":"object untrained aorsf object n_tree_subset (integer) many trees fit order estimate time needed train object. default value 50, usually gives good enough approximation.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Estimate training time — orsf_time_to_train","text":"difftime object.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Estimate training time — orsf_time_to_train","text":"","code":"# specify but do not train the model by setting no_fit = TRUE. object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 500, no_fit = TRUE) # grow 50 trees to approximate the time it will take to grow 500 trees time_estimated <- orsf_time_to_train(object, n_tree_subset = 50) print(time_estimated) #> Time difference of 0.1932049 secs # let's see how close the approximation was time_true_start <- Sys.time() fit <- orsf_train(object) time_true_stop <- Sys.time() time_true <- time_true_stop - time_true_start print(time_true) #> Time difference of 0.2313173 secs # error abs(time_true - time_estimated) #> Time difference of 0.0381124 secs"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF variable importance — orsf_vi","title":"ORSF variable importance — orsf_vi","text":"Estimate importance individual variables using oblique random survival forests.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF variable importance — orsf_vi","text":"","code":"orsf_vi( object, group_factors = TRUE, importance = NULL, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_negate( object, group_factors = TRUE, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_permute( object, group_factors = TRUE, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_anova(object, group_factors = TRUE, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF variable importance — orsf_vi","text":"object (orsf_fit) trained oblique random survival forest (see orsf). group_factors (logical) TRUE, importance factor variables reported overall aggregating importance individual levels factor. FALSE, importance individual factor levels returned. importance (character) Indicate method variable importance: 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance oobag_fun (function) used evaluating --bag prediction accuracy negating coefficients (importance = 'negate') permuting values predictor (importance = 'permute') oobag_fun = NULL (default), evaluation statistic selected based tree type survival: Harrell's C-statistic (1982) classification: Area underneath ROC curve (AUC-ROC) regression: Traditional prediction R-squared use oobag_fun note following: oobag_fun three inputs: y_mat, w_vec, s_vec survival trees, y_mat two column matrix first column named 'time' second named 'status'. classification trees, y_mat matrix number columns = number distinct classes outcome. regression, y_mat matrix one column. s_vec numeric vector containing predictions oobag_fun return numeric output length 1 oobag_fun used created object initial value --bag prediction accuracy consistent values computed variable importance estimated. details, see --bag vignette. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF variable importance — orsf_vi","text":"orsf_vi functions return named numeric vector. Names vector predictor variables used object Values vector estimated importance given predictor. returned vector sorted highest lowest value, higher values indicating higher importance.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF variable importance — orsf_vi","text":"orsf_fit object fitted importance = 'anova', 'negate', 'permute', output vector importance values based requested type importance. However, may still want call orsf_vi() output want group factor levels one overall importance value. orsf_vi() general purpose function extract compute variable importance estimates 'orsf_fit' object (see orsf). orsf_vi_negate(), orsf_vi_permute(), orsf_vi_anova() wrappers orsf_vi(). way functions work depends whether object given already variable importance estimates (see examples).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"variable-importance-methods","dir":"Reference","previous_headings":"","what":"Variable importance methods","title":"ORSF variable importance — orsf_vi","text":"negation importance: variable assessed separately multiplying variable's coefficients -1 determining much model's performance changes. worse model's performance negating coefficients given variable, important variable. technique promising b/c require permutation emphasizes variables larger coefficients linear combinations, also relatively new studied much permutation importance. See Jaeger, (2023) details technique. permutation importance: variable assessed separately randomly permuting variable's values determining much model's performance changes. worse model's performance permuting values given variable, important variable. technique flexible, intuitive, frequently used. also several known limitations analysis variance (ANOVA) importance: p-value computed coefficient linear combination variables decision tree. Importance individual predictor variable proportion times p-value coefficient < 0.01. technique efficient computationally, may effective permutation negation terms selecting signal noise variables. See Menze, 2011 details technique.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"anova-importance","dir":"Reference","previous_headings":"","what":"ANOVA importance","title":"ORSF variable importance — orsf_vi","text":"default variable importance technique, ANOVA, calculated fit ORSF ensemble. ANOVA default fast, may decisive permutation negation techniques variable selection.","code":"fit <- orsf(pbc_orsf, Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 21.114 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"raw-vi-values","dir":"Reference","previous_headings":"","what":"Raw VI values","title":"ORSF variable importance — orsf_vi","text":"‘raw’ variable importance values can accessed fit object ‘raw’ values factors aggregated single value. Currently one value k-1 levels k level factor. example, can see edema_1 edema_0.5 importance values edema factor variable levels 0, 0.5, 1.","code":"attr(fit, 'importance_values') ## NULL"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"collapse-vi-across-factor-levels","dir":"Reference","previous_headings":"","what":"Collapse VI across factor levels","title":"ORSF variable importance — orsf_vi","text":"get aggregated values across levels factor, access importance element orsf fit: use orsf_vi() group_factors set TRUE (default) Note can make default returned importance values ungrouped setting group_factors FALSE orsf_vi functions orsf function.","code":"fit$importance ## ascites bili edema copper age albumin protime ## 0.49306931 0.40601166 0.30339953 0.26839623 0.26685796 0.25804901 0.22825024 ## chol stage ast spiders hepato sex trig ## 0.19290780 0.18941048 0.17435648 0.16943522 0.15678670 0.13905325 0.12965799 ## alk.phos platelet trt ## 0.11338661 0.09012876 0.06778770 orsf_vi(fit) ## ascites bili edema copper age albumin protime ## 0.49306931 0.40601166 0.30339953 0.26839623 0.26685796 0.25804901 0.22825024 ## chol stage ast spiders hepato sex trig ## 0.19290780 0.18941048 0.17435648 0.16943522 0.15678670 0.13905325 0.12965799 ## alk.phos platelet trt ## 0.11338661 0.09012876 0.06778770"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"add-vi-to-an-orsf","dir":"Reference","previous_headings":"","what":"Add VI to an ORSF","title":"ORSF variable importance — orsf_vi","text":"can fit ORSF without VI, add VI later","code":"fit_no_vi <- orsf(pbc_orsf, Surv(time, status) ~ . - id, importance = 'none') # Note: you can't call orsf_vi_anova() on fit_no_vi because anova # VI can only be computed while the forest is being grown. orsf_vi_negate(fit_no_vi) ## bili copper sex protime albumin age ## 0.122344895 0.047850279 0.035986359 0.023711711 0.021831451 0.021503160 ## stage ascites chol ast spiders hepato ## 0.019718835 0.012550534 0.011115307 0.009845811 0.007601474 0.007055077 ## edema trt alk.phos trig platelet ## 0.006411580 0.003666224 0.002388178 0.001156845 -0.001214167 orsf_vi_permute(fit_no_vi) ## bili copper protime age ascites ## 5.513908e-02 2.181846e-02 1.246900e-02 1.192659e-02 1.176139e-02 ## albumin stage chol spiders edema ## 1.175554e-02 9.479348e-03 6.215674e-03 5.752179e-03 4.960035e-03 ## ast hepato sex trig alk.phos ## 4.647971e-03 3.594325e-03 2.477936e-03 1.162558e-03 6.778008e-05 ## platelet trt ## -1.132546e-03 -1.376816e-03"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"orsf-and-vi-all-at-once","dir":"Reference","previous_headings":"","what":"ORSF and VI all at once","title":"ORSF variable importance — orsf_vi","text":"fit ORSF compute vi time can still get negation VI fit, needs computed","code":"fit_permute_vi <- orsf(pbc_orsf, Surv(time, status) ~ . - id, importance = 'permute') # get the vi instantly (i.e., it doesn't need to be computed again) orsf_vi_permute(fit_permute_vi) ## bili copper protime albumin age ## 0.0582460338 0.0255992039 0.0130100780 0.0129532316 0.0121027391 ## ascites stage chol ast edema ## 0.0119289124 0.0084185175 0.0071302967 0.0053592731 0.0051471990 ## spiders hepato sex trig alk.phos ## 0.0046418826 0.0036776097 0.0026334550 0.0024978806 0.0013078222 ## platelet trt ## 0.0003504423 -0.0013892173 orsf_vi_negate(fit_permute_vi) ## bili copper sex protime age albumin ## 0.1259391254 0.0507141085 0.0363834330 0.0235136073 0.0233592840 0.0225371677 ## stage chol ascites ast spiders edema ## 0.0211978251 0.0141956334 0.0141890702 0.0108977272 0.0073762768 0.0070333453 ## hepato alk.phos trig trt platelet ## 0.0050661672 0.0048879157 0.0044980321 0.0039418881 0.0007189274"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"ORSF variable importance — orsf_vi","text":"Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating Yield Medical Tests. JAMA 1982; 247(18):2543-2546. DOI: 10.1001/jama.1982.03320430047030 Breiman L. Random forests. Machine learning 2001 Oct; 45(1):5-32. DOI: 10.1023/:1010933404324 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":null,"dir":"Reference","previous_headings":"","what":"Variable selection — orsf_vs","title":"Variable selection — orsf_vs","text":"Variable selection","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Variable selection — orsf_vs","text":"","code":"orsf_vs(object, n_predictor_min = 3, verbose_progress = FALSE)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Variable selection — orsf_vs","text":"object (orsf_fit) trained oblique random survival forest (see orsf). n_predictor_min (integer) minimum number predictors allowed verbose_progress (logical) implemented yet. progress printed console?","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Variable selection — orsf_vs","text":"data.table four columns: n_predictors: number predictors used stat_value: --bag statistic predictors_included: names predictors included predictor_dropped: predictor selected dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Variable selection — orsf_vs","text":"tree_seeds specified object successive run orsf evaluated --bag samples initial run.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Variable selection — orsf_vs","text":"","code":"object <- orsf(formula = time + status ~ ., data = pbc_orsf, n_tree = 25, importance = 'anova') orsf_vs(object, n_predictor_min = 15) #> n_predictors stat_value #> 1: 15 0.8340018 #> 2: 16 0.8294703 #> 3: 17 0.8167613 #> 4: 18 0.8307204 #> predictors_included predictor_dropped #> 1: age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... trig #> 2: age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... platelet #> 3: trt_placebo,age,sex_f,ascites_1,hepato_1,spiders_1,... trt_placebo #> 4: id,trt_placebo,age,sex_f,ascites_1,hepato_1,... id"},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"data light modification survival::pbc data. modifications :","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"","code":"pbc_orsf"},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"format","dir":"Reference","previous_headings":"","what":"Format","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"data frame 276 rows 20 variables: id case number time number days registration earlier death, transplantion, study analysis July, 1986 status status endpoint, 0 censored transplant, 1 dead trt randomized treatment group: D-penicillmain placebo age years sex m/f ascites presence ascites hepato presence hepatomegaly enlarged liver spiders blood vessel malformations skin edema 0 edema, 0.5 untreated successfully treated, 1 edema despite diuretic therapy bili serum bilirubin (mg/dl) chol serum cholesterol (mg/dl) albumin serum albumin (g/dl) copper urine copper (ug/day) alk.phos alkaline phosphotase (U/liter) ast aspartate aminotransferase, called SGOT (U/ml) trig triglycerides (mg/dl) platelet platelet count protime standardized blood clotting time stage histologic stage disease (needs biopsy)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"source","dir":"Reference","previous_headings":"","what":"Source","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"T Therneau P Grambsch (2000), Modeling Survival Data: Extending Cox Model, Springer-Verlag, New York. ISBN: 0-387-98784-3.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"removed rows missing data converted status 0 censor transplant, 1 dead converted stage ordered factor. converted trt, ascites, hepato, spiders, edema factors.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"data copied lightly modified penguins data palmerpenguins R package. modification removal rows missing data. data include measurements penguin species, island Palmer Archipelago, size (flipper length, body mass, bill dimensions), sex.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"","code":"penguins_orsf"},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"format","dir":"Reference","previous_headings":"","what":"Format","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"tibble 333 rows 8 variables: species factor denoting penguin species (Adélie, Chinstrap Gentoo) island factor denoting island Palmer Archipelago, Antarctica (Biscoe, Dream Torgersen) bill_length_mm number denoting bill length (millimeters) bill_depth_mm number denoting bill depth (millimeters) flipper_length_mm integer denoting flipper length (millimeters) body_mass_g integer denoting body mass (grams) sex factor denoting penguin sex (female, male) year integer denoting study year (2007, 2008, 2009)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"source","dir":"Reference","previous_headings":"","what":"Source","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"Adélie penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Adélie penguins (Pygoscelis adeliae) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 5. Environmental Data Initiative. doi:10.6073/pasta/98b16d7d563f265cb52372c8ca99e60f Gentoo penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Gentoo penguin (Pygoscelis papua) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 5. Environmental Data Initiative. doi:10.6073/pasta/7fca67fb28d56ee2ffa3d9370ebda689 Chinstrap penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Chinstrap penguin (Pygoscelis antarcticus) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 6. Environmental Data Initiative. doi:10.6073/pasta/c14dfcfada8ea13a17536e73eb6fbe9e Originally published : Gorman KB, Williams TD, Fraser WR (2014) Ecological Sexual Dimorphism Environmental Variability within Community Antarctic Penguins (Genus Pygoscelis). PLoS ONE 9(3): e90081. doi:10.1371/journal.pone.0090081","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":null,"dir":"Reference","previous_headings":"","what":"Compute predictions using ORSF — predict.ObliqueForest","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"Predicted risk, survival, hazard, mortality ORSF model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"","code":"# S3 method for ObliqueForest predict( object, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", boundary_checks = TRUE, n_thread = 1, verbose_progress = FALSE, pred_aggregate = TRUE, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"object (orsf_fit) trained oblique random survival forest (see orsf). new_data data.frame, tibble, data.table compute predictions . pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'pass' : output NA rows new_data 1 NA value predictors used object 'omit' : rows new_data incomplete data dropped 'impute_meanmode' : missing values continuous categorical variables new_data imputed using mean mode, respectively. clarify, mean mode used impute missing values training data object, new_data. boundary_checks (logical) TRUE, pred_horizon checked make sure requested values less maximum observed time object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. pred_aggregate (logical) TRUE (default), predictions aggregated trees taking mean. FALSE, returned output contain one row per observation one column tree. length pred_horizon two pred_aggregate FALSE, result list matrices, 'th item list corresponding 'th value pred_horizon. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"matrix predictions. Column j matrix corresponds value j pred_horizon. Row matrix corresponds row new_data.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"new_data must columns equivalent types data used train object. Also, factors new_data must levels data used train object. pred_horizon values exceed maximum follow-time object's training data, truly want , set boundary_checks = FALSE can use pred_horizon large want. Note predictions beyond maximum follow-time object's training data equal predictions maximum follow-time, aorsf estimate survival beyond maximum observed time. unspecified, pred_horizon may automatically specified value used oobag_pred_horizon object created (see orsf).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"Begin fitting ORSF ensemble: Predict risk, survival, cumulative hazard one several times: Predict mortality, defined number events forest’s population observations characteristics like current observation. type prediction require specify prediction horizon","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5) # predicted risk, the default predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'risk', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.45965512 0.73309199 0.89715078 ## [2,] 0.03235764 0.09091330 0.18045864 ## [3,] 0.12091603 0.25919883 0.39403239 ## [4,] 0.01488893 0.03745896 0.07571412 ## [5,] 0.01279842 0.02623832 0.06015808 # predicted survival, i.e., 1 - risk predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'surv', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.5403449 0.2669080 0.1028492 ## [2,] 0.9676424 0.9090867 0.8195414 ## [3,] 0.8790840 0.7408012 0.6059676 ## [4,] 0.9851111 0.9625410 0.9242859 ## [5,] 0.9872016 0.9737617 0.9398419 # predicted cumulative hazard function # (expected number of events for person i at time j) predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'chf', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.65381651 1.28606246 1.75476570 ## [2,] 0.03531788 0.10967272 0.24697387 ## [3,] 0.15371784 0.36989220 0.65462524 ## [4,] 0.01549537 0.04229610 0.09352493 ## [5,] 0.01290261 0.02687956 0.06916273 predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'mort') ## [,1] ## [1,] 79.795533 ## [2,] 22.393743 ## [3,] 38.749709 ## [4,] 13.552788 ## [5,] 9.984989"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":null,"dir":"Reference","previous_headings":"","what":"Inspect your ORSF model — print.ObliqueForest","title":"Inspect your ORSF model — print.ObliqueForest","text":"Printing ORSF model tells : Linear combinations: identified? N observations: Number rows training data N events: Number events training data N trees: Number trees forest N predictors total: Total number columns predictor matrix N predictors per node: Number variables used linear combinations Average leaves per tree: proxy depth trees Min observations leaf: See leaf_min_obs orsf Min events leaf: See leaf_min_events orsf OOB stat value: --bag error fitting trees OOB stat type: --bag error computed? Variable importance: variable importance computed?","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Inspect your ORSF model — print.ObliqueForest","text":"","code":"# S3 method for ObliqueForest print(x, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Inspect your ORSF model — print.ObliqueForest","text":"x (orsf_fit) oblique random survival forest (ORSF; see orsf). ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Inspect your ORSF model — print.ObliqueForest","text":"x, invisibly.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Inspect your ORSF model — print.ObliqueForest","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 5) print(object) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 20.8 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.78 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"Print ORSF summary — print.orsf_summary_uni","title":"Print ORSF summary — print.orsf_summary_uni","text":"Print ORSF summary","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Print ORSF summary — print.orsf_summary_uni","text":"","code":"# S3 method for orsf_summary_uni print(x, n_variables = NULL, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Print ORSF summary — print.orsf_summary_uni","text":"x object class 'orsf_summary' n_variables number variables print ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Print ORSF summary — print.orsf_summary_uni","text":"invisibly, x","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Print ORSF summary — print.orsf_summary_uni","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id) smry <- orsf_summarize_uni(object, n_variables = 3) print(smry) #> #> -- ascites (VI Rank: 1) ------------------------ #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3054245 0.1943058 0.0669212 0.5210500 #> 1 0.4642809 0.3931239 0.2667095 0.6482154 #> #> -- bili (VI Rank: 2) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.80 0.2330790 0.1596352 0.06235256 0.3619985 #> 1.40 0.2540362 0.1809254 0.07558882 0.3929548 #> 3.52 0.3718914 0.3116138 0.18216413 0.5269286 #> #> -- edema (VI Rank: 3) -------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0 0.3001416 0.1839553 0.06611975 0.5104195 #> 0.5 0.4042295 0.3595143 0.20304881 0.6188152 #> 1 0.4030578 0.3599751 0.17563269 0.6173294 #> #> Predicted risk at time t = 1788 for top 3 predictors"},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-012-unreleased","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.2 (unreleased)","title":"aorsf 0.1.2 (unreleased)","text":"Added orsf_control functions classification, regression, survival (https://github.com/ropensci/aorsf/pull/25). optimization implemented matrix multiplication prediction (https://github.com/ropensci/aorsf/pull/20)","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-011","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.1","title":"aorsf 0.1.1","text":"CRAN release: 2023-10-26 fixed uninitialized value pd_type","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-010","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.0","title":"aorsf 0.1.0","text":"CRAN release: 2023-10-13 Re-worked internal C++ routines following design ranger. Re-worked progress printed console verbose_progress TRUE, following design ranger. Messages now indicate action taken, % complete, approximate time finishing action. Improved variable importance, following design ranger. Importance now computed tree--tree instead aggregate. Additionally, mortality type prediction used importance survival trees, since mortality depend pred_horizon. Allowed multi-threading performed orsf(), predict.orsf_fit(), functions orsf_vi() orsf_pd() family. Allowed sampling without replacement sampling specific fraction observations orsf() Included Harrell’s C-statistic option assessing goodness splits growing trees. Fixed issue uninformative error message occur pred_horizon > max(time) orsf_summarize_uni. Thanks @JyHao1 @DustinMLong finding !","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-007","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.7","title":"aorsf 0.0.7","text":"CRAN release: 2023-01-12 Additional changes internal testing avoid problems ATLAS","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-006","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.6","title":"aorsf 0.0.6","text":"CRAN release: 2023-01-06 Minor fix internal tests failing run ATLAS","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-005","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.5","title":"aorsf 0.0.5","text":"CRAN release: 2022-12-14 orsf() longer throws errors warnings try give single predictor. note added documentation details ?orsf explains using single predictor orsf() somewhat useless. done resolve https://github.com/mlr-org/mlr3extralearners/issues/259. predict.orsf_fit now accepts pred_horizon = 0 returns sensible values. Thanks @mattwarkentin feature request. added function perform variable selection, orsf_vs(). Made variable importance consistent respect group_factors. Originally, output orsf ungrouped VI values orsf_vi grouped values. update, orsf defaults grouped values. ungrouped values can still recovered. Fixed issue orsf_pd functions output data returned original scale.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-004","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.4","title":"aorsf 0.0.4","text":"CRAN release: 2022-11-07 orsf formulas now accepts Surv objects (see https://github.com/ropensci/aorsf/issues/11) Added verbose_progress input orsf, prints messages console indicating progress. Allowance missing values orsf. Mean mode imputation performed observations missing data. values can also used impute new data missing values. Centering scaling predictors now done prior growing forest.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-003","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.3","title":"aorsf 0.0.3","text":"CRAN release: 2022-10-09 Included rOpenSci reviewers Christopher Jackson, Marvin N Wright, Lukas Burk DESCRIPTION reviewers. Thank ! Added clarification docs pros/cons different variable importance techniques Added regression tests aorsf versus obliqueRSF (similar) Additional support tests functions long right hand sides Updated --bag vignette appropriate custom functions. Allow status values input data general, .e., just 0 1. Allow missing values predict functions, including partial dependence.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-002","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.2","title":"aorsf 0.0.2","text":"CRAN release: 2022-09-05 Modified unit tests compatibility extra checks run CRAN.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-001","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.1","title":"aorsf 0.0.1","text":"CRAN release: 2022-08-23 Added orsf_control_custom(), allows users submit custom functions identifying linear combinations inputs growing oblique decision trees. Added weights input orsf, allowing users fit orsf specific data training set. Added chf mort options predict.orsf_fit(). Mortality predictions fully implemented yet - supported partial dependence --bag error estimates. features added future update.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-0009000","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.0.9000","title":"aorsf 0.0.0.9000","text":"Core features implemented: fit, interpret, predict using oblique random survival forests. Vignettes + Readme covering usage core features. Website hosted GitHub pages, managed pkgdown.","code":""}]