From b697c842dd79b7069c3c71dd7a29d24a3bc62d65 Mon Sep 17 00:00:00 2001 From: bcjaeger Date: Thu, 16 Nov 2023 02:12:38 +0000 Subject: [PATCH] =?UTF-8?q?Deploying=20to=20gh-pages=20from=20@=20ropensci?= =?UTF-8?q?/aorsf@6e6b1a2ae679bf14973ded402adcd0068fa5014b=20=F0=9F=9A=80?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- articles/aorsf.html | 52 +++++++++--------- articles/fast.html | 8 +-- articles/oobag.html | 6 +- .../figure-html/unnamed-chunk-2-1.png | Bin 28771 -> 28852 bytes pkgdown.yml | 2 +- reference/as.data.table.orsf_summary_uni.html | 16 +++--- reference/orsf_control_custom.html | 14 ++--- reference/orsf_summarize_uni.html | 40 +++++++------- reference/orsf_time_to_train.html | 6 +- reference/orsf_vs.html | 14 ++--- reference/print.ObliqueForest.html | 4 +- reference/print.orsf_summary_uni.html | 16 +++--- search.json | 2 +- 13 files changed, 90 insertions(+), 90 deletions(-) diff --git a/articles/aorsf.html b/articles/aorsf.html index 58f7aa70..0e7b8056 100644 --- a/articles/aorsf.html +++ b/articles/aorsf.html @@ -136,10 +136,10 @@

Oblique RFs for #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 -#> Average leaves per tree: 22.4 +#> Average leaves per tree: 21.4 #> Min observations in leaf: 5 #> Min events in leaf: 1 -#> OOB stat value: 0.76 +#> OOB stat value: 0.79 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> @@ -159,9 +159,9 @@

Oblique RFs for #> N trees: 5 #> N predictors total: 7 #> N predictors per node: 3 -#> Average leaves per tree: 5.6 +#> Average leaves per tree: 5.2 #> Min observations in leaf: 5 -#> OOB stat value: 0.98 +#> OOB stat value: 0.99 #> OOB stat type: AUC-ROC #> Variable importance: anova #> @@ -181,9 +181,9 @@

Oblique RFs for #> N trees: 5 #> N predictors total: 10 #> N predictors per node: 4 -#> Average leaves per tree: 5.2 +#> Average leaves per tree: 5 #> Min observations in leaf: 5 -#> OOB stat value: 0.64 +#> OOB stat value: 0.73 #> OOB stat type: RSQ #> Variable importance: anova #> @@ -220,14 +220,12 @@

Variable importance
 
 orsf_vi_negate(pbc_fit)
-#>          bili         stage        copper           sex           ast 
-#>  0.1796153443  0.0654718662  0.0377992169  0.0300985949  0.0184556866 
-#>       albumin           age         edema      alk.phos          chol 
-#>  0.0177062224  0.0172170446  0.0130478892  0.0083611824  0.0069716249 
-#>       ascites       spiders           trt      platelet          trig 
-#>  0.0063832024  0.0063499175  0.0015016478  0.0007794253  0.0007182015 
-#>       protime        hepato 
-#> -0.0006160457 -0.0065521643
+#> bili stage ascites copper edema sex +#> 0.160185833 0.042419910 0.037004321 0.029450477 0.025523886 0.021037248 +#> ast age hepato albumin trt chol +#> 0.020497704 0.020317763 0.020162922 0.015865138 0.007418603 0.005756730 +#> alk.phos protime spiders trig platelet +#> 0.003328945 -0.002559019 -0.006195550 -0.007907720 -0.009315955

  • You can also compute variable importance using @@ -237,12 +235,14 @@

    Variable importance
     
 orsf_vi_permute(pbc_fit)
-#>         bili       copper        edema      ascites      albumin         chol 
-#>  0.076377458  0.027301164  0.017138302  0.012935499  0.012645786  0.010981566 
-#>        stage     platelet          age     alk.phos          sex      spiders 
-#>  0.008385515  0.006916673  0.006300806  0.006115436  0.005605453  0.002729921 
-#>          ast      protime       hepato         trig          trt 
-#>  0.001706344  0.001490477 -0.002072969 -0.003145736 -0.003454973
    +#> bili ascites copper age ast +#> 0.0770176686 0.0286127351 0.0222179569 0.0158979928 0.0105580692 +#> alk.phos hepato trt edema chol +#> 0.0074408002 0.0054291589 0.0052311839 0.0050824237 0.0038163615 +#> sex stage spiders trig protime +#> 0.0027274412 0.0002958220 -0.0001345556 -0.0034778432 -0.0042680518 +#> albumin platelet +#> -0.0130420884 -0.0152792851

  • A faster alternative to permutation and negation importance is @@ -251,12 +251,12 @@

    Variable importance
     
 orsf_vi_anova(pbc_fit)
-#>      edema    ascites       bili     copper      stage       chol   alk.phos 
-#> 0.42139078 0.37500000 0.31818182 0.28000000 0.26923077 0.26315789 0.25000000 
-#>        age    albumin    protime   platelet        sex        ast       trig 
-#> 0.25000000 0.22222222 0.21428571 0.19047619 0.16666667 0.10714286 0.09090909 
-#>     hepato    spiders        trt 
-#> 0.04761905 0.00000000 0.00000000
    +#> ascites bili stage edema albumin sex platelet +#> 0.54545455 0.40909091 0.31818182 0.31746032 0.31250000 0.26666667 0.24137931 +#> age copper spiders trt trig alk.phos protime +#> 0.22727273 0.20000000 0.20000000 0.15789474 0.15000000 0.13043478 0.12500000 +#> chol hepato ast +#> 0.12500000 0.10714286 0.04166667

    • diff --git a/articles/fast.html b/articles/fast.html index e23df40f..81ee1d59 100644 --- a/articles/fast.html +++ b/articles/fast.html @@ -126,8 +126,8 @@

    Don’t specify a control# control_fast() is much faster time_net['elapsed'] / time_fast['elapsed'] -#> elapsed -#> 52.71429 +#> elapsed +#> 56.2

    Use n_thread @@ -155,7 +155,7 @@

    Use n_thread#> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 -#> Average leaves per tree: 20.8 +#> Average leaves per tree: 20 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.75 @@ -206,7 +206,7 @@

    Do less#> N trees: 5 #> N predictors total: 18 #> N predictors per node: 5 -#> Average leaves per tree: 6.4 +#> Average leaves per tree: 5.6 #> Min observations in leaf: 5 #> Min events in leaf: 10 #> OOB stat value: none diff --git a/articles/oobag.html b/articles/oobag.html index 29271892..7f8225ad 100644 --- a/articles/oobag.html +++ b/articles/oobag.html @@ -139,10 +139,10 @@

    Out-of-bag predictions and error # what is the output from this function? fit$eval_oobag$stat_values -#> [,1] -#> [1,] 0.796875

    +#> [,1] +#> [1,] 0.7755585

    The out-of-bag estimate of 1 (the default method to evaluate -out-of-bag predictions) is 0.796875.

    +out-of-bag predictions) is 0.7755585.

    Monitoring out-of-bag error diff --git a/articles/oobag_files/figure-html/unnamed-chunk-2-1.png b/articles/oobag_files/figure-html/unnamed-chunk-2-1.png index cf38cab875129d23ddd279aeeef751eb01eb0237..ed6c0c42fd29aa85a45b0f6014baa5aeb1b73b2c 100644 GIT binary patch literal 28852 zcmeFY2UOG9_b(c-4+4&kqSD5h0HPEX=}mu(Vi1TBdRGLbO9>%B5=KTCML+}6o6-}S zR0$7hvpB_ZT~6K8&F-v599_r0~=U2omD)<0`OSm*4s&pG?-^4a?w zp4>4t6#nk)cOVc*7;@_ua}emjH4tcD>*0ey%ZB^l2=I0A-fhEQfN$WlW6+2JzK%S+ zWg7$nNyhMg1QMoK-9VrpL6BdrTZCpV(vWXC7AWPtEriRlV*+N^t{waS#q|%rYW-*m z|6|_HzTb&M(P9o?7#^L_;*_4k59b(B>}s3EDwqLMb^-5gEq)jZJ9$ikap%Uv{bugl zXbh$lmAx`knW!r>!k%h!A}7vHErPwvvKH^l%Ar zXeQtx)%>8jU!fD zZl?>pVif3yy`AWgJ@p7&B!|3><-V8-fv71Jre=+uBXJU&E|AVZl#FbZ^>3~9f}ti= z+_T+6sei1N=zX6N5_-GC&Et(;`u&C9Kf}Crlv6(lV|T-Ea!sv8J+7u!prV-fo4FHI z_SQ;NN&&&Ic<`^uAKGB41r90DKs~}0homV_h#JD8H}(o<{Bss;s{XRfr%T%JiK+) zzn@reW0sz@51W~IJYvkR(+zQZZ4~Tm((sC2r!*;|Eu*O@bE#?aw=SI@rxnY?p&Hzu z*6a}buL;=Pw3NFbe#*8unWjQ&KIM2AG}jkay5iaK8go0g7h^lFMv{+J`X#FFwr2=q zSw*2yej2jjntZ7O4gviDN^X;;7&juYOEA;d*3tC&*LOgmOONR$fm5%A`k!NN1+p~< zw?nbwindM*SkQTpLJUs3PTFKG4Q!3D{s9CUeuI!h-ZGNY)-HS>uO>6{GYN%_@af>YER_5RXZ(&r`ONX2VSrHckV&5vj(zfH8QXfdK5al zNAYFAhvM}ajGsmVBK}WTHw~}%yW%jXyA^isWEqk-ZD8c6RhNl*)^_0N`yI)X}Tng?9P2G zH)~2RMrw_R-MyCGS9bUAfksEuR3nJ0wR(RIVzz07W} znyZS>VIn?;(1_;>X!RXnJJ*Ir)QvQqXo@6Bb2Pp&f1`7^Ac;QB zhIJB?B~m|R>#HI;RSL|`Fun4!8~R2K@2))YPTcjy!Y&p%kKB4v7~~t}xrCiEJ2|MA z+z)N_gRDJEn*4A+!E`M_s8{I0HQI?>vgf57QTO1Lu#1N#;vlA_@?FD8E)%+if39yQ z88s;N;66K@$j998yzV=2mHu*ml(`+uppNuLA#rPsI#g$8b;z2uYv;}~SljqcO91q> zPtNh*%DNWBAj?D7oF;3U%VyxgSbwNlOHQG~{kZCL6kYq4huu{xr8dh#_?hsjz8Y_@ z&In%}(O zdJ&|Hy1~3XMpYVou>Q7gE~w+iEb-`a4r7Irl)Ns*+&{M>_5C}#{!cdwb)S4poua4|hI`7cNR~4wzd;LXzF%V= zS$D7ngxS!hPr6d%7Gd889}6y!Yl2X_exCUgZ)!c}Wt9QTzL&v7gn2Qbm(+(8!oQ?e zHP_#3puAj@?l#+d`Ps^~^9sIhc;$LfeuFCQz_pAC(b&rUi_I@4!>)&daL4_EdIGVVZ%wQA=btteg z-i1qzJh>b?&idj9*~^hnX+UM=HIeZ#dBIUS6B!og59^$-a zCspL-w#N#_PwHtDJUTP&n#Sqvb%c%nkuekp8$C$)khIej*12Onu1H!TSB{69D>sh{uPPMG|7xT*+FO#SdW9XOg?~`Al{aGwGGiE1vxGkVeUaWxi zat9eBYHFLD7@gc4a%uMh$wNi!0m8R)^-BS4W-w{2X#6b!g%vN9z=+;j3y->z^>RRM zHQ@!f8D`Z-?EB!&JX@l-S%VFK3Fyg zm(HyPTxsb0U47Dhxe0cDlPR3~{a}a*T>G+g=iCZWlj7@_eYH>l-n{NBX-u5{kuGU& zn%&-99$f^BIn3AHB$C=vzfn=D76iq`r!(t63Y@)-UI>8~aWt%ei5jU?LlSvL50~xeQSUtT=#}Qzoz8Ch}(;$89SqZ0e1{eADZD zBZQD$wW8pfOI{5z#C5NwfbFzct>&}I>wR0VaLlagu{AWt>a-a`TM74 zHBC(#mkPY9$xVFuxw$mgvhy+fN{b+!vNQO0t?a0YBeBM|q8ryUIr^F` zIo638C=7Q$qo*~Ei0Juk-YI*kByBIcS7*i%T9nV4Uy^KB(Dut=Nvn44^$V^Gp1q<3 z((1Y74cb^s(te6x!ZJ>b1YKM!A%yBw6#68F8TBBFy&D&LPj)$Eu&7@dg1K~v=3U37 z%yhT9!i~L_(N)!Ts;;Mfy$L3XQTH<2u6kS^He(5YG|sF`x1woWl2kATAk7y&S5a!jeaXx4m4^h zslT*R3HZk})tx4lyabrIir!&6k5OM|DtfX4CYS>cG2$e;m{7I`(G}$jTT125qvh6w zD+>X>{j>2VGsIK-a_wQ+zv$@En%&0Vhp}$mTv=%xR#0J-J*P-nSMREbrHb`EcRL)Z zSL@!8V4)D?i-QK@mP7S*r}OVyacy5Lzx~b=_94(7MnB=^2&(aFAha{NdH2$qy_1m+ zCOeEePuh{TcCdbhZHR^F#$fi3h~~0FW>k8_X0febN78rjp+IZ*VEYG_JI@xTe3D%{ zvsHI=9~z@gSl3N7(;bKxai&vFYIJJqtrYg>8piT7Y1o@?q-xhtvq++tq5GMSxBP$OY1jWcRfRtEtei|)C?wOHLz_D)W#8O*0Jl-ldS zJG1HY?C#Xrr*30b_@(CzIb~C*XHHS)$&!}S<9d{=kY`nHPmztAdBzhP?F&|ljS35h z=&OvgXLu!cNjH68*tC_Tr za)WZw#BQOZR(274{F9&S+)t+?I+A21ZZ^ApjFy%~S{V)AQSYoPychzR|9!d5H5mgh zCrS_1rs$Eja8H%NR1B^f$eEhmv_HKoRWjj_KHX5s-yyae>z|({C0G~K?Ax47qT1|f zk|ZxAk2K0QQ{5xJewjJh)jQC(eWRoWZ&9y=KWkK>9ZC)?ZMfuy8rH0Kx1*4j@{>L7 zP3&8MY!LT|4)F~4GVhWA(J}+STq0Gn)CqsdDPVM5RK4)3Id>?@T7;Ms*pES$6ZI`e zFz-F!(3ObS?sn$O$(XQi9TU&I__SZB>_zpWOfKhSj&$0BelxrA>XM5ozALb{ z)?Xp9d|?}c;rTdtM+w>ZPOnlt41RqEQ6QmAeeH&$XSASgEt;=9VLo(N$U9M`7)rP- z(?^724fDrKO9B_bQ11qx73h4-ms9e@`D$~&d;X-lA~~`#a_rN*>ilB%@fyhxx1QaL zOOn)*aKX(l2WD!Qk3S!J$SVltRr4%0DwN!0BbnQD$*0=Z1x_dd&0%s z7alY1Yu-rv8L!F7i=muvBQG#TVS@YBO^_cRhC1UKt95alRswYwm)(2TYHNQ)BA{Ez zJ)*GD%8Yh5$b`jZUwFm1rLL5;f2i>o2?x@+T~!S zQs$RoNh`2>znWkE$HKj4^1WnVN_63{BkhUT0Bu3J%Uy9#%|o>ZK}!uB*p2SSB;Grf zmGy+#jmnaoP_MV+ z2~dG@d)DFJ;~B6wE2Xes$qYSAVpdJ~DfXSx1<#nMF-u(&{MZ z;Y&Z523DDEdD%O%t?_XSJ=@8!{95B=H;$6sAp3KU403MqL)xGI-i0)uN7JG{#S)1R z2!K+juop{xp(x$FF)x}r>0H!mjHN<&AjAJ_PhJl%cq=3-Eo^)8Blo&g5h3*CTR%sO zT4%y31sG?do!Rvh$*!^k!L`mU6is&tclK>R{dNz>hz8s`};_w>a(vQ>wbE z&~lf_TM|Vi&O=vh3bmWPnDlAV$iCpBo75JA>;)Ig?TEJxF_0Z=G4aO5r@gRI=k{TPAg41!vEn6f$)wi{+ZVo>GaE4HaMMfVCdTjw>HAA9J(bCfEo885 z#j`4@1aFhH8pkc$Xtm*$rmXGYg5{ZkVsSmVzwda7`)G*jAThaLy_L|-JK4wcJ|>=( zY$17Qkd6w;*L<|H#EZ<>G?=t5WK9+027hCgF7L;}@0!DH`g&3Pu}+yZCzLIXEtfce%fS zN4zX&?0I7&>hF#ECNA1mFJ71L_^r+nDA)A1oWU4)I{8wz7Ru26IH$DXE0WYxlBLeU zd%mMeq~QIZV8jO(0No&UEp^}32XqI< zUNw=de%*zt6Bd)%Y5kpyFlAnhkSpZOIF6pTPGPrSu??1VF5pGI&~>h5M9aAXbyj&( zsrx9=ZFiw;OlD^xeLfbqLRqP%TpXNZ{gs!~e{(gD4}wcR79M+ErA(0&ThMB1ypD6G zR5S`CCrvV-i8^YDx)fIa5dFQD>wAxsd={yj-ZS@UvK?GePMVcGnS)3Z>x=Bj&m2!U zn?2~FCtddEB+NBA{HDncP9$9p+~6#W3C2tddN98}wOn6HUc()7fa%9h?;GI-4jL52pj$V?9eb`g|5+ECYa;L4pQ$dJV=-*NQ{OgF-49q;8pmAQNwPEdtg?68X#gz>U z%xoD%@2V_Od`N+vls>IimcCUl|87@%ir|Y}PBkYsA&fPNDU70EQM~OkHtEw;=UyE- zwQ0ht{)$$wP%6w36zpB-pWDFbg{27eQAJ;J;^gJV)yeRSzY5F8ZEztbtUM>7(0e_* zvxS*W;}6g0ESa0Wmr9*d#LujRgMvptYnSM~OP$^toUTj%FzD5(zVy)CL~qOQQchWk zXd#${F@4^yIugN+64N{3@DqWXWMJ# zCoDk06Q5gLJCT9=kPa_dMX$wPh+T>a5a{!a0epY2io^4M=yyK18qRy&b37911Y}r3 zZpn0L%9z(F@x;v0Ya_j;O#JVV9ZBx}&a3)1usUGqtZ^E3p(9@%Uq0+VPyu>CL5B_; z_2fAA)DU7{IjSI^d%0<-Q$?MQikbj500@ERF?O_A7x70G-S_F$jPw43(~Lm6O*Ck3 zK5fynonkQf&6&~6QHvF4d%G4pN^HqdGe?Hvg(B7dy-yKfu|t4OGuGZFE9~(!hV1PC z3Qqq_mi^QJj9@NC|GFmPmZpBDTn=RH`SO(txaWv;TXgLrE=efIOm`B1DrKLfwH5nE z1H%eMcX#h%E7Tq0-RM^K=7PhPl0n8_YQV%qmKvqp1m4EYi%=l_d?kD(s^T^(+{kg> zi=%`u+-jT6C#*j)o5-Ge44WZ-!GaCt8hrlPQ8xArFD>h}Ot-S;=Q+M<`QLM6u@NOp zk4gvlwv+tsBt+`v0F0SGT0Dslw%l^goKiX?4R%{W=Qp(k;?E>I3Y8mc282CqcRuZaohnaT0oU~ckqZw~ zI=Yh0qK|tKjn}>=W#=eox$Kb(f^!2ur0(p=xHa|!9S?^g5u_x5Ykc7-TcS!Qd+N#qZ?L1yE zIbr2=>x`OjdVV8ETS<$1V-#B@?4LX(d_oCES#~$~Yq9`#O?oj~Fy53s9AiFO%o)49 zbCm7d*@GkgIW=pP0||7&ibAcMOxNuYvh$aPhVexOP0;~!E*e*+->*a_)dhu^BKLEx z<$cYwvI0A%tL245p^OZ9M1p_%z)Y`W;`n8f??I%)i@+;uOG$}z<-+lkcJGgT{V76& zv@9=|z6JH9`Vo^7V_~qcbDa9%pwBIfV~mX?`rLK-g@xXzwdIsR?CM}r>{}p1WrT&u zR%}~G=uB^Mi^0T{z}NM+jT#MCpq`C0V?pSIlgbcUqRER>g1RFq*AJ+ceQA|b17z%rSlPF zKt%)Ovm6|rSBVl;r$cM!0N{|b7B(#<4}V89AO7&Ye84Tycx7)M3Ie&j^pI^ZV2q{N1w81yh|J5rx$QZAHQF{*@P|lB zT^DoVv3KHP^Pm6f$C%CtM7C&MC|K$ZO4QLTSjx|;Qv5M2Dk)^k>2j(E`)RP$%MbO< zhd_OYV&b<)W3Yz(aIGI1x5Co z-dY>IAtngQHMFX4*b84R6qY;&IskfGo|vekUa$l#GCe5ehFBz%cTYHn*EdBz=ETcq zos)by)e2^VM>I(%A!zK>0;CtR_5=)UCqlsO!2hN@;{O$!_!Q9lzuyA|eR zxbAL0|BU7uOdy*M!RJoT4}gh|!RL6SE{fVJB&#-a5o_6o+swi|Q8i@(pM@@B7Chpb zpnJ+uB-$ZtzMx^P^I|Cgu_RX{jp9-TTQdNu}TLe zKfaw4{_-dIkXq(U!1w%-xo*6sGZ3fj`>=hU%|DV(U?UoTt>N*^ zO$MD${0Lk@2^YX22J^h8RvWGB{1yFszW>_={Wrn?!;||zQc$B!bAr!>AtA<9Fsuor z+yuD&zlim5bZOvegG&!k44#MvBaGH^!3oBJW9dk;(OL^w8nQMGwzpH3bUueZ&KnN}@!cX#mfVa`pFL z8{2ySYLzO7G&6#(41UB;6+leSvKC1}$wEAqVNg&FszW%A7}{IoWcNae*LLX<=m9(a z^jYG=-Ws&iKibOAo~2*)uxlGzc&a(bGnmMU6Chu@r@>?lIc?ZCx?Nx0!;Z(HFI+Hp zN!#tg?i6^8oZ1@_HEmeHpYGX@pwX6kx3L9=p^WCwq*t)QfLqwXL?XK)=@Q;$><_wp!@B&_@5SK7`)YzA2KGIi+; z`na_m(iYo{Z7TX4$P?N%f23fIy_gL0y3w(X=U||~b`;YEX3LFSo_@Kro){rVLPGTP zx3zuy_$Dx{E714htrkf$iZ>Ya;EDC8|G5uS^o>-Sh)(KF2r;UXC)GlfZqFa}ToCNy zdphrI(1R^Ca03i`NCtTyJ2u=MZiU_Ay@FDf8yN`WyQy5m{nr|qePC|Ved3W>{lH7R zCRibC=JToM)%!em3uu&hF74yd%>hDB-}daxEe|`OAZcXa*~9)p zfk$U-EO+bwjq*DE>Q4u9uB55KD6W6b)Hs+9T^j~_6gHhg2N<~o1z~B}#jN9BBaE?8 z)&)C#;FMa&hrD@h7J%bjO-srif|BaufAf1WwF4`xmLaV|Onpo5^CEjY%8_ zlb*=ywm~NuVCCCY*4VA94t&F%Q-nr_EW8FQ-#YS03OkjWl>OO1?LHT*UD$L5gT}6a zHI+%ThcHFL={)0Y1q$MX)7EmD9+!B`L5i#2>F~b$>;-dq-`D()MDn9zbAfPQ?W__+ z?Pxpk?Vpc$eXUg|K#t+2x2tF_5eBqpyr#+tbpDCL`Fr3kN~^wp}i;y)V>8BBI4{XJxU ze+eoDj2v>=O+Pp=_U6~CJWei-$3RQ%jpD}Mx1&6HE4)_mUvBI_!j%6bgWdlx7s&^F zBhT-5fVE{tlBPz%DKZT|k%kX^i(11v0)5NAw*rfJ5#mp9eOcO8DR|}f+6%C=X;lGp zfPZWWhXG@F1=*7)p-=Q;rd+l&z+zy{bENP|5+7}*{;qbd@y$6>1~wDR_%!Q}-Szp3 zNJ3$ov`O0c8hI>Qf7w4kSjB=9q*>fQz+|JqU$Bnmb#3L4&9l2SjqTm9U`+Pf#_Ur= z8RU%x8Q#<7NU38$Kx~0z>uzv`VA+BwOKcFd>(5?J~H z$Q3~#mI2`4pb}>>D6Ck)#)e*;BE%_uD*qKZTgQVBM{>7#E^fSUJ9gH1q2S~^-z0wq zobt-=uU3VCw%LES;a;tp1Qn__HJ7KVDDwEv0pV#gOYJIpJJXZq{$MvKsE{9Unt>+* zEwJczsA(1F*}RXs4cdYa>{|~5p*!5ZuDKj-fmOjuXt|vQ-WTeU`lGlNrfbPJjSlg+ z>eeCq57-~9I0Il8$2t!gT~g&YN`|j<;TJVGcpnvlkcx2Mb5fnC7Leu#K<<3 zE z96V^kJ4P28;H;kE6Ejs#4?kkdAidI&_qKn3M|Tvz#Sd6sM5$v;7cN4&w9WHR zo_QE((>Gb$^jT>2l!6-1f7mNMIKY#Aq@7@Hmv2XsZ?Gq}Oh}d?Mfow(PG+mE0iV7%W=cl8Z7nK89V}M1)pAnU) zqUiF?w_s(j;%|Y~+vLDCdh+qNC+;-2IAWVZ=D5`$LZ>aqd7zh!i7Lpo6+ zxoRTh_S%ZU`na5o2Epx8gz_|Vt3srJUCA2`s!d1VTQ8JfvfaBPlZ&99TC?$%(!07> z1GX0CVBkir8jyI2UEOm9gL#y4$#ew#FMTsPAm{&b>OD9`7`6Eoc)7h}Yh z?U=LNNMqC$_bbPPCnVX`7w?%#R*a@ow$n1l2--x9Qvpf=Hxa ziZ3)`FDHFxIeV&FUN@iqnrU9UPy?P7ZATadhIF2&q(j!ql3G{NChtGRIH24|9cuQ(M?0Ddss1cH|UN7&9meRhuBm`N`xgV2M^fOc{JtWj9 z_hF9T(~+l&ka+Q3$AH+RBA3L0wEk6y61lGEUOm*-*+V4S8axv4V8?Klkadx_M9|MQ zXF$!@ja*h1!Q8a9UnV!BJX2(lW>^kZB5`U`9;%O4A)QE+cs?Z_g;W=waqMb&F{K7+ z(fYF9W}dxlY-DJLu}$o?lwXR>9(}mON5oB!(PVs!ufn@l)`{f#LOwc zwIsWT%W=03^0O__a9W{YF2esjKLd?yFI_I+|COtr9wrzJ!xjm*E1Ry(97$oXj10H2 z7qAY4caXeQfX)gES!J z{6W~OVxVSf-!`JiW|?g;sb$Vz^jV4pXk*x5GR5@G_%x9Csal-kQAdJ%0Ktf#rC$La ze8sf;5B-A)XQXdi1g20=>)VzQe#wtMKSF{8`jkcD=w45!{VreKD~RsobLX3OM@%~x zXwO!?y7%Uv?cu=UQl{P>Np65*i;i-*oB!;rz-DS}aAUAdS4nY(-HnD=G1;A|K936H zz`F)+e5u~T`uJTcJCO(&9}vuPbWbbYT4N?neD+VdPq*wssgi=uD)58bHSA0_$OMZ| z9RHa_!t2rHNc&(;vCfja5io3{Xfl5T4=fS|`oIkrcv_h}r3z7!yi6{L@~nrf{RXyH zbKqeCo=jQ<^%uv%;?Mnrrhj1!6USZ1QdZkwawZ8h`lLR z;<;>agC$@Jiy9vS%;qe6{K=Zp2@`ixQx%&@*T01+T911wAtWs7M(A zwAGSic>`J<(!YyD%aFKdo^dO{+Nw$XWTmwmXq6=;Vw;pn6Og^1NiT#8g?Z$cYI}qW z)_bqpX^ZX=;aGog!+BB~L@Dc1mZ6#jKf{P@7tBq#RYe2t=%H(o(QCX>pj4y8idKFc zQ+QdJ4Qjsot+ofcT37;_dnsJN@9I1K7frJai1*KDpbaZvyA>feSp8dpWWZT8y!*87 z7(Ju;BWW{gbwze$)SPb&k#O8RXf7_XNs+{nOWj(AOlY0P*kDDkI`FmMCCeL-d`6)T zNmF9C>8<-7LS_fBv08}QRhw_-0jyZuJp0qQ?^kXK#4q{&7TDTaA;<)K;?U$FuqNSE zRV$Y~(cE!6WEkGU4IVghPT=^B!^Us_R6PB!(;6|c52k)n`SHiRd!SXd+_pcxe~9iX z&W%69h|F_{zW!N5EA*zw;p=AvUI?5#eO;pUvzOr6ml@|i%cfjAd}Lk^Q_7g9WKGb* z5td7qjVunjnPCZ~pc%HrWn3+u(U?=q7i#e-u}E|fdtdjKg=m@5*!xK*eJ>38kr)3+ zd7XP-i#aDKwHXoP9fnImVitVtbglL+Xak+M87{&a`D}&Yb{38Pr zbX*9xVZLExQB-h^60f+LlpP8exA#g*S;c_2cbCCaXCl#M1ZU=>ew4ayF?pZX!8Ur?%3oG$aW zQTnS}4|w+>vzkIxSC|W0XFQ93xRMn8Y2D!V=q64xFKl#f^MG*mwH$j#3sl2sc%SQL z?=tai*j_1@{0zM}#Tf3A=VP$pjt~hWlx5qq4ruVALh#kiyu8iWv%Q=KioxEN1sRvE zPFM*D8s;CaH@N|vvT`nOQ@KZTxLWNrpMl1Hfw?sra;PPu_l;ijySKd6wVqpa>eE1Y z+ssEetvI!w#?LUK*R!o8=?^v7{bvsiTlZWR;n7K)01mVzPwTG0q{2_XII3c-P}EXX z2y;TSUCVn2y&y5k=XUwsxvyPY>1ON?lqZIoy+^7$q`mk!`O~pes{1x#MjcYa%;71~ zFZ=y98dt3GTMEVTmK#+Js`%a#!aG%wJ;yMxKRwyaD4@_h>MKf|s#?$TPf}6w0toft z6q{?o9B0VkI;^;FSc{LmY*no-Maw628c|e66eULdUp)vlh4_t~XqO-a+zwvN$QHgk zza)Bg{VwHYmlEHNhY)TY$hC)?FyBX~#fkbH7Fe-C`MwTIUQ(nOh>O_kqeJMvxSX*s z8sRuYOMe?1H{Ql7+Y5CL%}p>$syBV{>$0V8+Ph}(M248SRW$vnH_o}-v;yt_4$fO@ z>u9>y!8tvQu9yDnupNuXK8a*YefqIS*|u3@l~;C`aQ14MavM0t00SGn{#%Q0NHgVI zRWlw5JCsX(Hp=y>x==?~rQE3QGJTj39aO7yul;L%cRAFl)rPm0hc*D6+_TXlW2*y( zYeUgN2}%QLLQN#DIYoXJ8_aWll3EB|H3mMis ztC~sT8AH)G5<)CftesOUlc5&GhTJ#HACE<%eXmdQcM}bqyIxCAkI1+s3I*pf(0S~N zaA#4^!1uxg*r(exdrg(^1^P^;G4xkE{#@vA6ew5)-f^Xj}`{okW zN*~=vCYtLuoI8(tzu2-K2t2C+J{qO+qQB}}Womk1+@kd8m%a2kms~lE#T=TUBXHFV zn8?rjbGy`?B)swl_mBGywM+rsoMO~gUO9hn@!t#fO|u)#*zMvQnw~=~GnZT)wY@Mj zGiyF>=r{}*Cug;olPk>H{ZNeha<}~~S+;qx_#)4tV>3D+<~!j>+}v zrF&>RLma2?dsw^TG!uD)S;{yid~TkDYd#cLjSt(L+q{?ppX0Z=Ys&GyNmx9(s zapG~y+`^IRJEmH5oB9@_4-O~sdHifMbnYt^KLMjvvaT6aB8$HU<#gdNPMnqKk+>D# z)RPU%6ArYRFeB!OqR#S)xchGtg{%yjp>LklleZ;HTIev^q3!OdVc=5fN~8FrLFrP! z2$-c+6>1VQdpWo%F8UKb!EMuk;&K-o;}dK z353%!rP4j%An$yZ<55)p5SuALAWtw9tGh(4iY(MiLoBT=oYR^7@isWO{kg8;;(}yl zMWi;59z=aJXTZPq0a>+IxkpZvg#7}iM+ZG}!h~>zZ=(DhvoyT9z9O-FkblajUtlgy z{FHv!Cs`KSn>k?1cDAT+e8|T&t(W~?#I(|D?#j+;>;iAaSk5-6kYV)owx1yUnS`o~ zLBZB-M|%g|>*;qmiHrrDw_0d773Z8;>+eVlx?amCvxpVCMr_~+%!K1&tWtcx1XM`Z z5XUG|2$FjWHE|j79TJm$ly=1 ztq}ZQ{Yfxh$Mq9P9A6*8q=sE_|M$-#uDnxl-Ocn!B>hVB@wDmcxzU zAO4|mR{zFlto!h_Vsg&a(&OC5C1-_sMM{NYB_BFOdc6^tqvF_>%BN|F!6=qa?mp`$ zn7hnY#^`}z{^{OPR0EX}3d8Qf#~5jpS&{zPP5>X3GCDjGzMcMC+U>JjZ4`2^lALO$ z*v8xF^$0EMH?>g&c;UjTztKCtQ^lR^L+H;pA^` zJ8bL)`Q>;Q-y`3)Ut3#xgxqI5zXevY@D-XB4a7gz{NVxiI_ zVU#_bUJ}b&Sja(v^A1#b;JGT7qdl7$R9OBv4T@sGns=v_D+up~_(q}K(IhapBrXEc z{kWPj7jzz@@1a|HX{&*Z(pqU+FI0+3i&bt3b>=6Am7ePdb5j(G$$E|Pb^IHq$SB)y z_ggmhhAR6uP=-4iBEHsbUXya_nOdJl8J!HA*UE3-P**(S>h&4jQ%)b=xLL!u81I0C zL1-G&MJ+0DPR`Bvo}Ak!d8_`@xOZu@lJS_Ls5ZjQ9GTu_R56}VRy^FlVg9EGE6lW7#!oAt^S*>n*bP5+Y6S@&P{>IucHK&oy&YGrXR7C%d7al7Yc zq2+$fnf!Zj7u4ZvDJzDCOJbJf2R8Gli<|!u*F!;s2+=dO7|-4}*|mQ|c;2Aiyv^yL zc;>utJ71kdt^-Yw{_>ZO0HoxbOVzUy3#Df4vY>cAwKtD##hF@X zhpf<~$;?aPyRZJiM%kPDnSsDhn4tzwb!b$Fg~Q1sOWwE?g?ud@QybUDBBf8KA6ha$ zF?y=U5M_EcsJCIB%--k^FZAfge3r{i@qWX{LiGp)&UIJ4QbOR!V_s#T)l?2dlkzW- z8h!YY)$;hcAB;18s$&GEiwkS};{uN&Qg!Co_R_i`#RTWP*!uFb`eZsI1wV+V+dp*V z&0Ja64Wc>a;L$DT_Ul$_)!%j79FooX-4zmfQqDhJAH{|i-j zL>sJ#U3T5h@Ssxd|3=k_z^z;4`^n zv+0Z~MZFoTyiNUJ+P4@O*>(&V=z-5rl{m=7Q-sDMo+IIG(H!FRm)m?vG66|WH~KPP z+X8?o+=G8@0=g{=a%`!v;1&`L;hu0)CW1mFAN@Ar1%bKEoi2tNMVai!{TEYR_*ecW zD)$TaEdlUsgRuytFV{9Wlpx%Ki48x!ER_+MyQ);)i_2DPePC;rM*4M1AW2^L%gbK48bOl6#)>|5XENvYLgzYqQ{lqpV8 z#OYV~Sv0@WLU+FA%dhA}WO;HI&L5A?z55Q#ZxR7?FmmCeeRC;GnxZRL&R6S@s{(Tj zR!8(PJ~-7d`nM4OD>ogeUA`L zBB3A%~fH@Y;~Sqef;72=w_%pGqr!I z3twb~DEI68sxw}!g$hB9FYZ<2=6L6xGXbW-(dEmXxm(JnG&vL94_if z*KXu~VeC}z>8r4I67lxRMc>R!nwJyyo3U?DRL)w3(Vyy4s&TV%%i-gh-=Z4d9~j(R za!wB__3*vK&&wVj1_m{*7o&DET~T3C{8wj@20Z(x+IJ%451clCqk*kTXUJL)ZFEil!Q{CNARa(}K*d!u{GjZh~8P}uaNcD^$fK5`9_ z4ZFFd47K9>n?(>18lro&@vI6;5x$wi#uZr?`QCj-wscPC2Rfd6_shvCRVqj4v!X{( zh!UVAiDR`qVest$Fh`nHLOFW+lD_^c7LD-%Y06ux%iZ66yAaI`b;Ek)GAUm4dd7$m zx3Z}S^I@*(DDy}vk3FiJ4tHUTDX}ctkk{xRkA+Z^%FN z*caHb-)k<^nyBWjUl(@wUwja%ae=4KA+ek-E2xjg{+8&rnVgJo9=pyMfF&sjqjElL zm&5TL78PkUv^lf;!0@+<39p>#sNnrDU3?L^b^wk@O>VP*s#@KOx%tivG-dZ}9 z0D#w1hQQLp@pQ*Nn;cJ@qenm=8(M-Gf*_KzUE8B#X6t zeLS&QS8qwX&#-$NpJ9;|zTA)%#wdYN|L6_}M6J}kF;LP4veD$tk&4`IlLnkcmOA`Q zw?oA02e#lHtDzIwUw>N;F48t}Jg5T2um%t0f?_^Je5(_T^2=N{knqjL5vtDr=lSojE^7>ih%SYU>gyosPvKqREj_-LK2E0*kJS(G6P7F5)`E*K#(c~ z5+Djg7bKL#5ReiKgis8Dge32Y^Y8oht@W(+eQQ1EPtH0k=j?sI*m=Z9A9hxCvNK_^ zvq`|lm*~oXOn#S2w7fRm$-0rq6fHStwf!C0>FKyVF`q*G8L0n1l`#$Q|DeSf<_(4( z+Qr+Lh%>}1xVt;~087WMcL81NT|nYwoxoB9RDBLQoEV!AffM2xcxNXoINK|GvsKpm zvws$NL@6+Da6Axe1vh`uypj^0*96>QRtyNvjbw&! zg1@x2Hh^tXz0z;a$}77Lc;Y+H*XpFU_kW@GJ*Spi9iwjZQk;*pZF9`~$#WU|19W)o zK;?&T&ryAr?&<|qQW)qfdmwSUWqXN@=sOOEWb|4gJY(iN=0I|6p5*9V&eeq0XlZ6diO!#7YIQ9PxI?BKVQ;-w-Lr zH&r*`s&PL-a4!&${g-2vn%zUIR(FTR@60>n+$f6!sA=)nylL1-85QMi@0&mz=T+`} zQRkw*H7OhaC3nI|YIf0szq^7XKmA&e^=lNTj>3$d*z89lHfOV(eB^|S@w$M;-V*jc zUu`bWJWXh>UKNvrnPM%i3Sn*KLwWOEUY1%uN*GZzx z63QI&qRRW?JbCjwF`H04x^D99k=ao^+7K>Xv2U&4_$%oX-qSfiik*Pe>9K*<=HS%G zdiEzOPnnG!l~eA&CkXlFXo#m6%kH4sIUi}?hHwpZ#a39GN1jog|B-~6dkp61b=b2$ zvU7157ieDnVfp*HL72wNSx8G`=|KLCF0FwIw!+t_m;pAdx?kE3h|O?ih_=&ioTK&w~v?xFP$P~P0*C1C__2*``hQdugBCNyxq8>74_kn-(P zgU$SV=FJwr*jecvpwPZcI6@s-ku~U3S z=acV+3gp#43-Nolqc8%DhM;s_E-`w%oS53P!1Np-{TlY4V9tX7)Hbu~G`Py!@ zupOxG-lLKHs$F77LFH@~84`V$p_Kt2EZ z{}^y`3YtJ37qHgz%4W?dVRxW(Fy)1NLnlb0Pb`BmRi?jh$f9BE*@X5FDv_^xAOQ!C3Q3fKaf-*2C+$LCbW@bjuT}nx+mm zD0st**t%2&qvkN?=tJzYevj4lk_5C&Y9#+&OwmMqb`LsqL%&&`{xlZG3gI8H9qZp% zolR0OtO|Df&KIGrKi2OoEKe)rXVu^_s(!+Fyy=;H!YWs1j$xp?x=lNR?>6e@N9O7n1V+Vwlk=gV5B+}|7D$f z+O)JkpK3HAc2KNEnJFva#pQx`N!+7>Zlm1R(eDP^KbJ9?AOW8v*|{b*vCjH3kSajE znaUb={Hog<@)Alk4MKmYX_#s*)UR`;1t$2Jh<~T9>^bjg<-DY)Ws)}?#r%NISyQYQ zNMGJaIXs-QdD!&+MIN$v=H9B)jAVB@5~ zCSh2j#rkTZLotw%_TOXwJtNEUV>I&ZADzkpA4BgtQJ!Ok=b~l90NEXa5V>k~PV{0} z`xQ5TtT`!;S1x+N4p%fY(do_*_EfT2whib?L3`ev_G*X5ffsy?Rqi|)IV}E|M^DNR zaJ5$0-dTmFipk~YLJo<@_l6}AefPsTVA& z-f2VR04>~pM*tZa>f7=c;MNgq+!QM#R z<(p8VWA)(dQ5+fJge$NKfqIK*X$`Wr20ZI1A0F=KvL;JaA@g3h$p2hCr>}9F{_RZe++vg`A&qp7BK&w5x#Z;~%d90LF5Vqlt_HCR?1!~G z8u3VbBU=4bkmoKkQR2uS*}02Vz$?0K0xm@Gc(6Vp;u-x>->W$6IP!052_3yub~d@S z=34PrXhM`xKc=@sFh5Va1TLUQ1nJrPv-#PmO6Ia{eaiYvas^PI*oUj2D%f}c&H#stb*TOXS8noZAyHfogDhEa8wTc zz>)-r{{o!J7S)I`urb0DbJdXI3HNPr4#JX`%&0>mBz$s8wM3O9?3TK#U;+b7UAr<( zuAaJNTK>FjJ;%0RP4X#8uTUj&_c{FCZhm&)F{2T@#nxpE3nNI-s5zh00gOnW?X(Y= zv8s>45GIV+k`43vUwW#0FHO30EDzguN!65mtj=`p6L)g01RVP}1WyFC=Tr*<6JnOZ zwyU8ZK}-g}t=d~W7U&p~&GV#Kue>WdDpRaK8{f-Rj}~^SDBd6c`^y!Mw|hzddzhJ* z^O7OcCK!4HwWW_DR3t=43%7tKEeB7bl5fjPRaGICmb-bqcf;ofnlY$;+med#gWy+b z46q2o%O2-sxnP!-p>Du{EgB*Tj(K%Zy1rpxQ4hx!Bixu5qv3}Ei2$P=)m4geu!X$i z19OjUgQQE9o>XK!YrR%cw4Q4^C^=EI-iJ$PjhQSO;a876H{Wx9ylcWbSkih@AX&R9 zuR#;dQX%0~*kHLDn7{PX}kNVW(+cNN`cl6%>keXD^^bT&w$83(HS4%A}4& zq08zOsx9`sd8WN6c7Nd^Wyd%&_p359I-At#s(y?o$~^V~7{FlyBVCF*A6)1sb_D0% z#%=~4iM&E z!F0sY4hTjfaDS{=Pby(iMWLKBC^i}qXSVyjWL}s5qL2y0q2}VROrz>3*wN(= zY`G$F_$#Sz@7Z@gq|OHLkADydq!BUHfQwuDDt`GkeCVP2eZCtLnZ2UM6i1bc1SVle z>U$0gds8fz^M#U$oDosb4g@%na7Q8etr|08;w#fC zNGQ3TE-~>)0+cvix&J9KyjRc7#sviyN@5~z!3peRvM`C*dxPJGFsFfr`DkBTCCMkr z)hs4=*>HQpgJJ&f^bg=MM|#V^3(4)KhA9eVN)e$14U37ET=pm}n+Qz33`{j%KUhT- zi-rvgt(3!<=-BU>V*e^t046AW1waBAQcp#z>Wo#&i}I(gGL8EgzUP<{%<}b@>Syjw0OBSb=gdflHi4sd&o3)QG4^4Zeak?rqrt3r6)9J9&Zg-Z$!1i4TCUiH zYQ5HxwEss`?xLi3(Xc$JLT6tixB3tLAy(V5em1Q9e{AlVJrpUJsCGwVlPD&-ILK(# z&=1>@Afmn=0X(KG+!s0lOaYyEx{1!e*Z*K!DhFIelcxUsXgge-6SlOR($$tn9|Eq5IJr3~^O-bXKR-9RwbR8J+ zAs3*}qCHV%O>v0W(b5655(7=q9Ic5*_=Tv^#H{(R&q8wApK&C7a_~2ROQhJHdJ2|kM*NQJf@1r|aSr3)dpEUX(4f1_{ayMrN|@i~iB0;wYIE{{V!7RX1x6Xdcv z)LeW6K#qxmNrllW4~Ntt5wVkbcR0!^yi|aFwa6|i>QwuFpKiY36UZDFOG?6XKV)j> zjfv5ckdr`K&-ZmN5Hp!sOh?5fggxS*@9@Mr!N6v%~Hvc*)6&CAxdFdtD2kIhc65v#wVu2sOq zHH*)v3a)@-8QbqcZi)+q51s7vs0C9Qcosl%-XM#5%R97;w&*2C7bYXQqk~owlylO5mTk} z{;hp{cJW=lg>|JPx;)A(q@TgcvqG-tmjB)hLg%1fWPp2c_a&c~>(^yEp36rys zb}sB<1*zoS6Jp4{b5ctmNvS)Ss0I;<@?Kjb4kSWyx~AMEF(Ey1S*c|=(I=zq5(ZZ% ze$h7Et8jEM`ElCU(Kj6<8Z39Rlc9dRefNt`^<3`h(=Pah6(^c(;V&)xmD00yX)|4R z^$n$UY17iJeN|yC=8qF+V-L|FE_Dpz)K(~5OjG1rmj|QgJ~!%a|13U>opI2{3=RCC zslHtO8_lS^rx@VeVws+ob}%~SRZ7eS#pK&1nz5nR^exiwI(M^BFzQl?96aEbnk?b* zkn=5TNlr#*Db{j0fc9|QUU6XLYXPvsX?-C-_qq~&YI6CB_UN@Hb;;XvX=q38E0lA< z%l@|yn0&j{ZVgjcI7$DFqeKM3eqz2$cMeeCcdpIrh#~*5vofcK_ifK)*$2h@QR}rq zV7BgZyelXCYV~W2QCE-!_HNG~^(tvwAA*JN6nWyDF2k(?k2mFL)lj3rp|SZmqIXiaNHdq-yDCD-k6bs6>zZDpS#fSLKQEc<*C{4 z3Do+Y9F449xSwXA5^>z0@!6|oozt{f-HwbBBJ-5yxx?5&x){{I(0^3)_Ttr;e##Up>#`%V}eD(I>jF>04S|!s?ik z4ZARh@v8x8*YTrHs$Z4_udPkSt^A#_Z+G0L$8|p7ejr#Z5mLoP99y?KwZAURZ{|XX zb_v68`tC30v>n~D>SCO!EW5-wQS5@Z%bK=HH!xAZwnsC(EA>u{H&y&+k}_r5{5vs2 z!{*-LE>KMNeju^4*tF!Z`d7wyq29ICXBn+E^-gI{@1A%$1$pw5GC5+m7V8LmqPN$u zGDJOkVBaH>)vfJS;`iS0A247lt~nAO8p(azTby4UH^)`?hOBYfybI1a>RbE@Gp(A$ z3Qq_2?rvyc22$^M5d7%1yXN~}u$U)Jw}I4jrEZ-_5~gh#bR|0nkih9PlNy0{_wV3f ztKEWfJCoIeW0_CcyizbDeRXVAW4aQWTF-q4BkD$PZX&GQz|;qK)0mpE0X<$|?=C=| zBW6HKq*YL3+yw=`8>6{fl)&YBr>Ty96HvS+N(ycY2qP^aZZ`KtJsIa=+MOK->I!J9 zVkcUTquvEZN&SMqb#WYc;0>qREnT-mBBQi8oDh{Z%A;{#8cau-Jbq6{x1-p6%isoK zBuWOPHYe?W$n{Z)b-aF;5YNOizrE6WTTV2yYpD@JGl$A{(Ql0yJ9Jl0!UAxqcq&wD zbw0Ds(W65|8_R6-dW&&d3-F*oJX%O$*XmwHpB0zz6DD$Jl(bb&GSY_l$<;CI^CTs1 z!M=_)^Lq``TeY2sKx0p(X6gn#whN{_9?YWVf{ZKPkIfh#>gT2#;Ptd0j$kusWxI~> z68cZZQVc>+4LIKF9++uhWVY!UCJsW5yhsPWOXMLEuW642SLdxT|7?5l1#cL8>7A*A z8TrqHg(v;bK@DDu5`atwU?4j5GVQkBi{0h5k-Fuy)K?YA5boBx4i|k3s5@Bwnhd_d zkeoSDN%yGpyt=2t1QTSLyXt`=bAFeDvEyt)$N87=A@wB;!Cxx3wzob`7K^{(MviGe zWRx!G4SeG#g!YJasqd*)bIt+bsjDkE4rhGDau9G2^cAd~68Wiyq;Es%gRLBcA9aFu z%)M^Y_KE~)lsl7F-U}EMklG3X%N8;#X?cIG7+wG>?96Hq?8i~W1dWYv8Rx_KK(UwJ zJUpdP=E|_De5>I2n6}b6`Igs6E;B*W|nw_LcM|ETXjnoF9D^5Uc*2`S_2oRd-<# zfQkaUF3cxoU1u;ri!Z#e%)<{di%j>JetY7TP3;={(3j^C>iq{}wz3 zk4ke7jIKg@be~u*s${;J(e_k5?-buLIj1q2`rTQwasH%U@@LnI%1#@*iIF!@t#>+3 zpHBkStgCk;Q_7IY?ifzPXh|?Kx@oEvitk0auS`HI^YI z71|e8w9?P%aYn8)tTbN`|K*RE9LX411S>r-Ijsb|`#y}_>ZS(TJ~kZ57sMd0=(*}w zc!4o!W@d)*RWy{hP^}TD85>RLD;lx}I&H8k+$l%<0kk^?sN0aQ^nx|++V|LNT}tpw z1h<;jOrN|8i$37d?sZeIsET!pzZ2x)-!tw9r2l*?Vne$tSL{}kHTdPXp#Z~Bnrg2i z>69a6eShU-RzJDSJmQW&0VLFq12EGAx}&h%J@;07pZmM=hs5`MeohAbvXlKPYu`u& z>NkH87&Pe@7FGu^($ANud2!@h54VtzwJWrktz**8sOA1loa ke$wxN^Z&}DRbH&nQW)R6@C)^_^absHcf4GA(f85+0zI1082|tP literal 28771 zcmeFZ2UL^U+b6X5va*;)*#RxBM@j;$Ns&*lMU~oQQ%|mZ8PKFfKT9S^J+^h@Npo- z#4!v6l1$)#3#HDid4WJ@K+xZ=*gnWznnb*nu|q0vuPg-Z6*_W!*Zx1xohy2}%TlZB zK&jSlby%=@?$M%?8c(Jce@;5-{^HHe;Z`x++C8aPTHpSBbK&sX#WNQ^o_+dd|0|;* ziwLUWh(U0$;e`-&HWdHvTv|1W94Xx$+DPG{WL z4SKYzO7bI=o-RQSwXIGdjj|#*GkeK%pFK1j>3BA2huiX{K=pxi(8(GX7#j)0i}em2 zhAuywUO}}&2%FGKlTbTUB0BfQG#$Egkx+py&$7~VZnQyhWDpjpTC_`cjcZKqv_3RH z`wovD;@WXC#ftg(^V`mG=YHLFCIRfc_fWxjKY0)OttCp-Yjx%ROi1{nMR-6}b~%g6 z@#F2du0FNR5P>&0ue5Bnc}N{LW5lO%7&j}8GZM_udY1^z=?sK#NvdwEPZF~NdO*wV z#ixcYIrNg+*9iYGS8TW6lR>p8f9w3C8kg(fgS$@*<(IYJXyQq%YxtW%4f3aNt@rN- z)p^vXv(eF|*cuX{{n zGXvb1rJ8Id*F^cf!r$&FXiwaS8_f4CG_>EOrn;>h1gd)4rc8Kbqcb|HEfZd+Nf1Fz z=n@*^6=SJcvz3zjO4awN{Cymn(l-)V8;cT!^|pke&|-I8JJO`kwCf0Wm9FUO@ArRy zZyHsy70rm#p7kHudG?OF`QlRfc(o8VVG7BC_{y0idjC^L963agX;gk^xdo%xHg=`4 z??P(NURMad_$$2Cr$Z+_p=fU}UUud<3**Idc?Pd=(#d%#k~3G;k3{R8C3M>4m$+n2 zD?oS76QXSLUnO}4qKa%V>(sK0S%WsBvK1o{Y-qx01JB876(V2E>Uak|3=RElWhDm6vTT}fm!0{p4ViIal%<7z ze{pO!N}iBsBQ+wKGyM^&WXaeBm&$4@tm~f`yWn}^9o;%R@@;VUz5Dl2rKJ+ey>p)( zehExpL+>2+ab+nN*Kt^xU{Q1JeJ;5*l9cRetYfY!CsKY6+X8M1><)%ErnzO|vl%Vh zA*MTxa*)1gTtRkgtYccJmqr1(!Pw9O(V_a(0=jdVuyA|`7X&t*8Xfj3?_mbB?9a?q`-hAI8OL(Gz7)2fJZ5cngsAo`o zqtdL_@9o_F1?j9%YjKS}ws&i|zCpoOV1s{fK8ES~BCwI1jM|=i7TvB)uslB<>|l{5 zY4dv(d~pko8i!O>-tun4mB8<#R#Kni-Cs}K5vfh1g7YhqW@zF4_7`>=|2eMJUt#&YafRtG>S&6f-^kJ>Il5*aaLD;n6v z(wpn#4Q@~QitESAJ?mqwILW!ToogX@!1d*b4<;Y^#pMrrY_U&2+hMHwX!KNI9haB( zIEW3zH3%2N#pwR%R;;YFLV|8mRl8WybIMz>BmSt?@W1Zk{+@5^v}?;=ZA#PpwO#+4 zP6nV&>-^Q!n%=Bal#!501J~sP!NYXMs{DvuX$4ZF3@%^)S(clZpTBjmw>aC&N&?j= zYOB~-b7N;no`Kh!xNYJltAV9Qefh;V2pT0cP?Fl|8x-FF-gN9n-2DY&1s@WAG&p&l z-tMG>6==?Va%E0u)XCXzpi1HaW-B?F@zbQW>9c?V29KDz=~~toT@MdXG#yd{ytHWN zFsI&*MXiDGE-dV*%k0-#K==(J@oCeW=V$NDR58AOQtakH@#Jz`!F7WB5L>ynH6rW1 zBGG@nJv^7aH5X_>Q~0!`F~ub6fSe+B@H5Z6h?S1v8QM61yP*R|U8`-n_w*KZIm~j) z4EG*}GHQHP?L6gYZqNO3AcHC+Q>AU8JfK@TF`sh!x6R+W6%>7Z>cVfK7_YZpPWfDd zj+U;NBij6IrOiXX|FMXz+0ViBXQ#oIcWysbU(N_U*6ev+o0d*$M~cm8Ej0#rV@oRCi31&xdHDRhj%`gKqKeWB3@RVWh|SpE=F!YW1U++Ixy1}+Y*97Au?Yfl zG+$B2Y{tMjBR5aEsRcZf9UpW2ZJpA-uGurSN|x8KOR;1ak49R$<{bUyZ4|~|lA=1( z_eck4-ee-(^%W{*IID`z_Bv%#+ULpYKNYjB$g?y+zw0|x4qXUru(ShBErG>E9K$ma z)BYn}AJ5&bO_H9Acw1gk!z0Oa?n@Y#w5{7(yRGLjvE}Pk`)8s6$63D!yIy^|-`}E1 zorLSP(v7~~+nPJkxKu(}9S6Jr{iSfSByIfz)U&cwz7dKDf#-n97TP?iXVXX8^zzVy znrqdk+|ng(ss%bkwHj7tXwxhTADhkK?dinm;N?^Eig1FhBwBjQ?ui3V-3Bh>QI?U{EEQWAr+nCE~ zp=;_(@MM3~HnbsV&RK5LwQn1)aXg+rv{Kr-TTdE@C3DVdzMW%EeNb zyS9M|qQy(&^=+-oIiW{f8tI26s`8u3zV7Pa)bVwN)mlpXcqj0obyzyr+TS}Zp~~NS z(wq8Nqlc~r4wg0>-RXh2CwSMv?&YXsRb_qWGU<>dcCF0Jto#$*LM)9tKd!U3k;dZOAVPcq>4ZgFXdk2{?&DiBz*c?VMemnfribfXBGorWoUU1_@}%MX(z)x}l?U(s zT?Lxg>U=FUfVIxQP+8}UQNBaOIarbUruJwc#7SuX_N%Vrt`Tn>ylrUio!EnMZkeI) zng0?wRk@@L~;IT5m0J%XLYSTs!#P13 zvY$Nl(k$LOS4w-r9LN|! zf(k}lRm!0ZY_``vrjgXJeO$ZPNV0B%bZX*+6Dcwt9;yjd@gin3 z^*#RH%HEjDj#h6%X4tv@-FCYfcNwLb+If$pf6B1rcGf|^^s*?)`9HH~8q7EK?X&Gp zq3dFMN4PN*h&KhRgFys**j_2mq?O-g5SeokU=i z2Er1vXX5kt-X{hq(BSHb#?z8+&OJOi)qg}ckpxG zH|JFMK`GX1$btjprhrc@lBsTS^XvyldHTAoV*xGaoutjAZ`YZeuFS?j!@hZo;MQ9o zY7%RZ#+Uop5+C$ZJHew4YJoR$-Y;5Ddd}`C3yxZAO}oB64v-k{Ujn6Try7#kslc$E zal}eAE&MA*eKs<|@qKi1RDfc(Ch-!Gf5$I!7W-}HUbnA5J7^QzM*_%}pP^_d)ccr9 zaObNRD;5-dFV@9(kQL+R|5uQ_(6Zy9z}=66GY0?YENndF^HmO-pEsyJ%&e(jcsgmV z^NRER*^GNmVCti0)}ZmGo88*uJL67yftCIw=elE3=Cr57?uXoTu4MD5&ldKT3~xWM zFxB-iG(#lMT!IEUSNBph7TOFtABjQA9KumjAC)bbHpR_>j-(rrlY}T#Sf7micx^w~ zuf)!EBE|1Hi}ZF=e5T~}#qW7(4W-xX{}vj6%ZnW@I;0R=^e;Vmr+0nLPPj0m^{cbK-HP3rH|vnSF%i9+hAwNH&qo_r%hIsk zs4MY}kF+Z_*EO)7p3m!CKc;T!24I(Px>k9Ye>E7_vLfxtqUMCQPe@&|-lPDuuC@Ec z&GPtlC$YR|74L>L&WEVlD)wGja^%X3nx^11j`4>(d%V z^4-w=Oq<^uxRsSzu}y7LI&cjS<(#QzdwroBW2=89vG4eya%ykU$IA=O0K9oy{EZ}9 zPo4m=QF;~bdbtf#QT19Pwexo|JKAYCoHcurreqLfw}u#+LrbTqSlPLu2>y9W&aaUg zK|3*;e=)?!=Gd0Y&X)qHw@&~X0yaHO3mkjXieW>u13z!y>{f{9c3DrN=~w9cM%rd! zcDh)1SCQ|seXo)n)eWJ(ok0>XS%m+Gx)*JsFy;dnJLj;|fj{!GuOJ_PwjXtm$lqF6 z4Miv!043 zYsicB1$S?V%FABvz830SpFL~$u@2Fja@73fH2iphp{_H2MXD_5Q5B|Pw$3{XhmaOe zd{eeQ{~F&ZtKrHD#?>pg6cQM13!IE=EfM$J78@?fYy5^?mdE96g_Fna?c(Le_Zp$M zPFHqH{W4MKJw}{st+cZMrB$8`KdS`=smqf-ra~7+*Qu&I=+B(jtx}Ck5yxgdPn_U> zL!^<%X_20J4c)wRbnF${n7qWy?V@E;Lo*9!e|jWmt*^_(|G8o}E3XkC=6ERM8KG7U zWjJi!vbMj6TK6(K>D2-s3Z!b$4f;&_p&%@r3f{;5DD70eR8|(-0ZDe8#U}H;+VNxR zI^U}cSbC(7*beykD-3r~V6Ivqrx-U`d)4QWvqOEa2ah8sz7~nh!97t{WOMh|pu3Zu zRg?RoSue6T7qbUVP(^+vB0rfnH1XH?%k}kSu$3j^cYH+m;}6GB+h+0jcE*?XH8a22 zsNZCR2b!OxTtCs*E|2>#+;p|CuE4x$=Nc6T-)x!N-$Q1;*6wd;iRr78L`i5~cd{6l zD_Y6GyHzi}3ZULJU)N9YWoWser(bBS8$e{fzn!pO2+dDu+p4vm6q%n)P;5#2#0nnD zzUXc2hyZpi$0GuS=cpRjX(Y zTq_-op?ZJL?`HefIaVI3IZgDpI92b;hQ>PvP)RX5&>y7oW#L#0l-!7U0qY6* z)e4qb7K1`G4&(jmY*14QC4s#S^vX+(n`(cb)mUuu>8pd*!#hc{EZ6%Mk_m93)L0V+ zadgbyJ+>nA))mx?N+_f4sc)kh614j4?2u33m}-e(-ZgD+IcDWkVnM$3c<2q0;zaAQ zT{*>$)7T16&riLzNw`7#QD6?zw&pE%D1HBQeU+J96@Orct+m1NhBvZD%DXuv`*w(3 zWs?8%e*g8uBg80fZQWHAhiuMc9vW%VBpg)TPELP8)A8EciX+l=zHxxMQ)6WotKlhe z+=Yyh1^v|b-43G*ad3PF(-%Qne++&QO$IBAhh@bSo+lJW@TB-KQcvd>8WQBiP=R_K{$U*18I2cLdWI+CG>em`RtvKc1y0X#izO~! z>@P*!{tyb0LN)SU_(LQ^JW#|#j^1V;nt@V*s<&fK*V1dRb(IKlROyS(H+cc(In9%n(wv$TNQw~% z(~!{32jf0}H&YxNFFU!3sT4PZ=F^j?Mqwm$sphW2(v2BzpS;)vgiwF*VR72^tpaQG zP9a%1|ArcGQ(jD&Om`+8mKVD%YQkV0UyslS=`4o;F0CTF$*pU`$*$F9Zzt>Ky42=J zX}rz9R3=&iCd4K``=~J*+5e#P*@i4>gk^C;7c}<%-dj)1qo2gB`*q0+eJwWKk0~Fn zj@U$~ZOq2whtjj*7Pr&A%mtf@^#?r!@t`n&Hx=bR*wl(u`4XMf3eu~q)7j&wj z650-P_Tr8Eji@EA4}-_&KiSOsILO&rq_NS_IL#h*1F-LMtxPJSuRE#o{JRjiSSPN~ zz?G|{o$}N1_3{*3(EYKm23Hvfzg>%;pKUpPT6Yjrd3;M~;9deShNYTI?mLY=>DEC{ zvp?Gl7m}rDW4~rivxjEev)^ZfOCir1!)&-0Z(GN78A_}5rH)JoI)FA1o|TJfXBR9m z74)3@3Lq!AM84h?C!VcZ#j^KZc9PU$@e8bz671it6 z7SoLj(e;P`#a}@ip*sEJLrE#P3|52|hgb)>~YU*Y;r;llq|=dQw` zL-3jIw_|!ZnRPtBf>f%Z2-4|ag`6)BJ|bMm)BDvR!nDaC*IU1+;q2sWvwiV3T)fD5 zt%y9t;8EnqaTLSp9ljyEh~DFP%5Zhv2iiUvVsHZK9%y;M0S52A{8SA+ahVy22{eUw z@*YKBBy_4FRvrbLAfrqJef>E~7$8f}0qF7M3gyMLjAv!+=nOQ)GIZw8b$8St>vOpd z%-6|Pu-EDDzL5Og9Vpn=_W%8p#T*~Fj+9%4x|mv#in6Z>7R##vM|7{A`C8*%l3S{j z?U>R~FEayY-FjCF?ZdXZ(`PtmI=f%ot4F%!uQ$rSiA(shDWF8RiRT^QtA*7h2lE z(tTdvli$rimva}CZZ9fswU1?ndOjcz^JeY0EKmu>8{5$z_OHiYF5dNmd3Bc4n8wxY zyY^*9UhHdz)${8%V`J@!Zx*IPkfzF`J}FhpXd9hhvu3X^Mak1)cJTdmOU}>~ld`h< zs1JHYdoPTsm;(BU>h15o25ncplaC&ZnL7{YgAVA!C2ugFR^=`1?fMbsi(N8=%;+)O zjtuJR6$ki^&w`ar33EPO4$B*9Vg7lDbT+mr+TC~fpMXIenoUDKm;wi%zL$jwhoBi> zin~kFWR2aPF;*j8q|JPbSkejQrBrEaDSLf|B6o$n=hG!n0|PgflPejcW}50)<)nXU zMkDEJWao2vv6y|Y>+)*-O^&>>nf>hyYFDCGQFK9)xgtt4*shI>A*=$ zTW3#NXZs^Uy7z2-fEpAGo*fjcfxAmOKJSN=_I8;DzPJo9%34Ova74)}t3kEq*P%^6 z&S!_+i)cMnLWT9%q@L!C)_2!2T$!hhPSabhnUgWb-J5=twj|z# z8D_Wm>$E))(9sjduXABa7QRYTYVr^11xcC9tv#H|w3WaY3R8DE!0wzn*h)4`91{IF)-0$%5 z@qR$J0)adp`^Yv0(#Er#!cDpr5Rd%MZ=aJo-3cBB?eQpgz|te?vb?;kxM^= z_JH0t*r4?ci}`cR4l70Y#F2oA2WEgbK|JP$%jcbyd;vH(3tHokVnSo`r^liFW{fPb zyICkng26xT|DW@9QTQ!zG2q8tfd4ro{BI;xvO#_2(6eH&uH2{$0jQy)T(a&UQJ2Dc z0gnWMIzFePCe9KPQPH|Ge>-YK%Mr{_6PF3u+SAAR%^r6|p^Ty7efrq=0y%{3@ECCP z3j&?!wMI3T7<3>IDEEz>kv?|*8xesu6`!F)>1Sp?K=WTruYy~=fl`fG8&TAZk(4%8 z!0o}8yl~mY7jURLxKgq;`ktwe@stC48lf<#UHDE?StH3?gIh%TA;HU;W70JmcSnDlyVm0yc=yaD{;TuqZBK}9v4x=% z4Tdlp)qSzl{2>3ijuq%WtA9z{FuJ?$FkPJYEzMU5cx*IRkrT1k{^1ZxuN)HNhtl<` zA(JEKFHsAWfYz$-BeJ7mlq`=z1?z0(-6d6FC~QqVy+2q+`%bU=VM_+nrG-m$J>7dA zcv(f)y=NpUvh%hGtkl-Ns55;w@1fnde5e8bTdlMV!nhl{iUQ7dM>DMzB2vLoa@sls zPn1O6?NQ)F9~nN%SMBLK8E8<*Bk^8c>5ZmuPZdI$B$yn*2G#1-KYA;Ex6yc5K)3(m z(EUH^vxc<*7!Y z=F0>H)Y9>HK(K;9C$lV{jlq3UV#T|!h+2l4n-W(cRyDDvQ7;$KE@{($fyKa^)+;Mu zNjbifI)J^Gj;?*_m9Ha8ZE@{!X%M+lPV++u^Hm^+mV$e0HxyhRzeY3VH(myJl_FRyUd zZX=&yDws&;@MPrcjoi`Gtzg)laoAYnh5;`KMP|*$#!xqWWVJms1!js{{uz|lCbyAX zfSN9r*KbSp1nw-LawpiM=#n3CbwA(onfJ=)_BFtRN1*cch8aW1uW1X(w9jdWGqd++ zuA~pLS!dow}vOMxae{=w0K z-HS_T8t!3J%+vcHnQ362t_*Kz3kw#t3XR$I!=Wz;4UFol5jrEM667`wZC=CgQooCp zn)tZDWH$q@`s!D)BfPoE3kXa?v^7^1DR-uue z+W(Rq9R=Kexem27UpN&bA&zc6M{ooDJ*1s4p|Exs6i6~%?{C$Mqu5u1gA_v+K?zEf#Yn@5p zul&y+livf?w95K;%i@lp&3+f~YRehI^R~5d*(Sg44bAroO#aI%M{ylQ$|>X&hp2Fj z|Dfvh0l-y8ky8o%mjnP_^%MVrHgc-5z?qL&Adllm0pFBnCsUDbS^NiaBojH4+6V+{ zDsqaf{*2Nu@|r(g5cYS_U0n*d@9;zwRq)ONV|Nj%c0l<|UhwRkI59ySh`wvXieHFZok{{Z# zyVlGPhz^i&VQu5f;Anc9FLMRQv?&qrqdWj`qI_7%(gt2m39RJUd);;Xw+q*SG_z9I zzGj17(z>OiyOA!PCJ0%TIAFLoHD`C2;YGqI^zbRQdJiC%mnYNFj+qft;~ggB} z@#{YpRlN6Zi;@N7Roa>PchD5*!l|8ED9frQtXpASOr}YNum{>c%+U=R_=PVHIAj{w z1Vpq_s`TGFqvT4nPIoraxsw$Sf2aaLl%fZIC}T+OY@fKLD8Ea?Sy1QXt=LePHSADr%u45;~YxaFuZ3_PmZ6}_!PXc0GEWXTH+^obPj<9B|sAxy0lmqk24 z0a@CBkiTozF=rYIjY*%zfbmwL7APy(rYPM}KHA0w-Pl#9Pc&uFgbEDL6BZ+T+v7C2QVsb(}CX=znfp7+qclqm!a{@e#UDdu;DlRAU3|$mkyF&uD%{-Tyx2C`3Lq_Gas?FFgoax8QCcm3d9NGRO{HF4w{K2{H zYghCe-Ge{y;B75zV${3$+WaBo?0yA^b^9P>r$cCHrS==InKCIo4B4rF5+=xP*gpX0 zMivHdr-2gyMizpyiJA(gagnZj8&{fO!JA&v0T&c>G`C<;JNHxviFX-=&Zmj&)q<1HDV zz+LKZ-S{%%OfB}E!$BEMV73K9a>r5rA<;|Jl<|S$L$nMniYE)8bCs9lWzp*{qpeMF zlh=Qb#|Dov(XAI}nBM`|Ge*^`^$Oy@>Zkg(i(9k&>%%@kTrs|b4VQ9acwis!W*}+~ zJlgVDPp}@W(Rkp!9RtERN+Rv(etKgR3I+yNoPnCqCs^lX@hLi}xtI=`KRoI*wH{0E zjUa>FO+qbEIemICexs3G{c(`KN^$s{wDs6_YZSFkS+2<)m4}kZpB`@aO^^f9g#rDJ zfYHvQ9QPXG(9_?6+ti!5G?sqEl0}Ou!3@2WF`Wr6u&g;th~Qt!76R@_=R^bs|IkXc zx+KWeG!zTwrCX1$Ps-P8W#qj8GDc;_v(#CB5+J#PosP$G2l5S_sMo`+ z=v$^0{V|Jxb_mX>?fXgUyq4f-Vp*sFm&;8p_87%x4ZgdHueEV=<(Z?BkG*d48Z-Z) z7H1ow0WWcDzo>R?a^*X1d0e|d703K9g0`4IeUMRRZa-ezopAaGpLX!d{wa=9|MI?l z(U0;=aTmt|T50a9Yp2H75=iB7iTgvJx5eN_D@F%6)jSlNjUYl9@4y8nWnL|a*?-$+ z`CbGyYZ8Vcr!r&^KF#;|vj^u0`5R{{0_l?RCIH*?LK01Uy zsrkARVPDY&ao+orJ$V$!&Okh)=1;f$=`|$J9W^})6w_;*yJJ4<%baPATH#IdO&V@)oO-LRdTzq2QAC;Ri{WO4M%1Nip zQ7sr_lx^Zl&Q33QU$1Nnzx#kBV1?jONX&`n{*beDU>DL5#);0k+tw363tk zoId_Cc$)#N>Tb%sIQ~v|U5wrHA2iGeurF>SnR+{ECTIk*L*l=qxsi;^Q?1zH*2nyd z#Q~CHnuE7jfU^K#BUa#dK{;`@w|%X%)O>NEeNEZ&N6G5G8z4<|BiT@?sNM>(0=8P_ z@LWY^ygucQ@as&Ha^^k>6vm@LK~~s%7jU6*upEoat4=!{6{O`s5eFlnC?X5VqM1_- zW?x1AU+%`8fvudJY*TE*-i7>eao}b@J&p1;IPVVicn?yIuztF?>y=}{^h2ltmBZ77 z_FFNEz$+$<`m`@AUh)t7-~jumiRf;KHb*_Of4%t(4C~jK;w!hR&0iG+)Q%=mxu|Jn zjsdk4atQFB*h%Mxo_-TXVH$ZPL-*HaN0eAfR{t!xOHRA3I+q_WMhP0spSEj6p!v_H ztH3z3&<}Bl%6SW2b(tHH@J@t-t+Z8WQCfD5czkcm;72gdqy~m!Lvnvuv|QFdj-_iz zP>bxWgodvmV-S1yU4tc>p<6G=?2imVd0I!t;}Iw>dMTIDy?qU;WFC42rOez(5m)Cc zG|n#AUT7c&b_c#sf8Xf8(NGIiS1~|C+4J1VrhlWM_ToY}8e)lNp)Q@iQiCA^l&=yI zx^aC?6xyC!A*p3CWyMFmCXv?yJJs(t5+gIMb@ZJ~L!l^Y-(_V(=)zmf0SNR!oZHY1 zLH`@Rz|ct4#5qFDDO^RDjSo7H{?Qs`3`TgNcEQX!ZYZDP4OszhClxM$=G)M%+Jq~| zl&Bv-^OjJ9330p%VMt-tIcItoRLcG`Hyvt_K21e$UqkhY%nJCJPT3Q;whS&3Mf7HT z@qtZh1GM$3YfFZl*Z7yYh}uA_HJ%zF>~xPL-+uQUY&48SEfIlHqsnODpay~h!ahBI zq*h<2A$a@X@%5#gqegD5j}#t^wS%`r0cRlN6dnL(>0rFCQVw6lfIbkAyprJUr8LVR zP4zSuYgr08#dEz(EaH4LMEM63!A%zlYBs{fv16R2oAP}k{9d5r*^zs8c92uCr`{1` z_OX-Q?Jg5{ZG9|&p+^n^B=pWV3BH?jT>NAU+K6jkTY;o`! zUmLd)(93Q(H6~nyy3D2JW{3rO#?P;Y0XHtIej}vygaYaH|XgBW9-mgiA zi{=Zb-o)v=S2*l()qjR;GvAOap(?E=#gLl(m!hQYxZlRv_E@; zW*GsuBV*j`u+$Z@Kb|()lF!t`FOOka6snWIe#e2^7|_P~B9_Rp>I=uaTm;6; zJyY_Nk-LgtEcZ80r4Q1nW5lIZp|x14dSwUC@|M&w+^G3YzPONcnHNDwGiHH3or<;0 zxjP~A0J+aTmiLN=hxteh&RruV!00~V-~AsiV`9SY^FACK5lkad-45i$EFzg<$L)hF zmNmY9)*Wr9eJ$d!{k4!>cYB`-sqyiuH=kaJ7!SC)C_e$P}3AY z_HR?IcQr;9u$%}Su$yR(v|%>EQ`Ys5k!mMfi?-g;@a4+|Zrm0U-Ib((<=JsfJC78K zRR)pmAmOV=>Z7n6oRlD;j;Ppywp=A!jfgRgw7(DXa_{C-L#AhYFlxrBv75ATtx~B_ zUMC3>{v}NiJ02o7`NG6c+-q=4=4%>S{PQwW#P|MWsVmGC?FXG7;gPoa@e_1SX%^KkgXfyY<@8E z4@ct!q&-oCB)^)VgOB`;*+Fv?Avcsae|SSgkmRwfC~?aJf^}r}4hzkXk`7`M%8ORG zSh4ak>dm&$Z%%we#T}bSEA1#43IWe)ZMXU*?})()TDg6+vx_)_@PMm`aY%lB zGml0~#5&tWrB?NcVcgy7iP&YxO~I)Jh;(0Qo*aIrqxE&91N?(d183+ar$rVcSae~w z5{UcmCZ`K4KGHOqaGk!-+*Uy7j5J(9TZK0{sH^RbBeZ35${0KA&5uF-nn4>q*XfHX z_mXVn-UwFyg$H;Pcj*n1vA3aR^bPmj6F&j3c~f%Gh^hj3_229u7ta=5zy}NdAw{Ez zbrn)IIb}?TS^Q(zS2sDQNSCg&Q}6Gd-y~TjZSDV21%+B1kBe#DYQ(Y}NzT|PiI*$O zv?y#ul2nv6ocUWlUt=KKp*@9mR`d?I-ini}J+e+GaCnX=ZvTY$=&)k?Ml&r!wp=jd z!fZ_t_g7{iZM3MXU;8x?@UDw%#4;)CNtIgya08L*gzl0kv?ruIOew6uz`Vf!^zXzd zTf>Gi{@)IRJVIL0>=l7~dFq zo0&~Z#6UD$PYSGiqc2Ki07mFthW;aZTCWK>R4)KgSx8G^FD455!Y&8(KhW70fH>2NH;M`R=TI5d89Uu`F z=NqxjaOM}jE?@T_t{EJ$%G85=i>HZWt^VB$R^(SLbqs;2nbXD<=IboU>{B2aMGvUT&sh ztqpYT(fGD3Rp?|A37zcj*){sT9lK<-2aIJ4=xucyY#FN-;5&u`$T}m zB3+Naw`*KKWOxVrkGOT$^5d1#MixKMrjrg{XY)c{2`~wSSr8sDEH`NIE3j*8jC_z_ zSb>aS24W33uoT{XChuP+gs;}?LZ-H8J0vfWmva>um@ULUxO^v~9@iYjte2E%rQFaj zY!3Q|(9$K?pO;QJOV^^Mf$5Q~8voD}}wVLHr75WyJg|^^A>J<7(Y9KaOd;I~;Qzp7@D- zUQ#GBhIy>WK<-!2)+%iU3$e4pE+f-+*qD54ZYr&l^jKR}KpjQ`f#Ie|c-ML&hT=3i zwI3M)qmGB%pNg@mKST`5$t(3ijgbmM9HHq@u zS2=|s(`w>vnyti{o9pp*-*|<)5@p&dxAG1weoo1E-W6Sg&clvRYkB*4LJ!AO_*JjJ>AtGt|#P54H@cJLZ|3`nfIW*pxuhfm;}x zFBz?We)8tdyg|N`?P~6N!-eHY2txHlFkq-%MGfbTL|IR7asal|rPZHLVkL+R7ORy6 zAg!TfJu&xgZ}Ed$`z&F+Zdx)aBRC|f#SVvCZfpk9)ee}%50{SLE#M*piCBR2NV~KJ zyt$P}>o?EI*0Ug{U|a3cBWVWOLQ1|pF}*HV{y1k#RPt>DE%!&-Tr%l88n@GR_>WNIpNt;A z=Bu`2slo5aYvv!X<(`H?s_73%%yB!26oZ=@bUT3G?x2V52yO#LJ48uJm6)w|J(eW! zkVN?4CqX#|v}B$F(vM-;!vaEblqKs8CoHTU3czLL3}`a4pgd?i|$ZuUsE~+(SJz> z7>8mFSer!Rx??DlKmRGfOlOZ;<1>`vPIn?>8or^O%MPr`rw0Wyao9PSGIrUittj$3 zGmJDhry$sPru)!N_uxz)G_B zt}};76?00vJ#>%ox1k-X(LT(?FfpO3Nx?qK<5Z9v^SJxkas7>#qIoSRt}8XqziKjz zJC-fr$tR{OBij5^5xt(XN{@~RUFhvOXY#*_8R_{gpfS5Vr#$;Sm&qHhHm)#wPPHI$ zeO}vL*hQ_RVX?v3_R?ndX(X>9(wA9E%E5{^w(9WXCh8887-s)9JZv0L)aMl7eR3yu z&epxAe~0ZfnQ!fSQ@?tvNP=JB?p-X!a{66&gUS;?8{a?M>EpJ(YHYcP)Fn z@vh8ov~RRe+NS|(l1U`kSs}V@nx`aJv?4B*>#>`Nbdlf(ofBT50A1mMsi_4?i5NFW z?sX=Owo8P(Eg?;6!hX#zoU^04aLuoRoI1;7GhkL@-M<4lFJ*Rnowx#g7qlF*?>FEq zHJO1vr@P?17AM=cMn7>&HFJe|Nwh&)*yKhU3yJMg#^%@4cwt2=ygOI51pAiqE1+hk z6vU4g#H@>dL4kbxNP9)gD(aHL6Po#!^Z<0_yz;V$g$oERPfYn&<`*8Qh#=nNbX%k_ z*UtX{YKeHz{Y6(pfFlyBKN{i|HMIphMa6vJ@&8fgw*m%syXAbW)p|ufqL0<<~P{D`gZrE|a!+{i+Rrnp$5E7|m5THs6Pj9|(f!*ZHQL zY@eeo68u^GmBt;|Z{(Qjqv;ZL-;|yGK(KXqdqC*I;#zOK9j#Q$Z{1%!MHork?J1x) z*}DtNyToCQ@_MyrLEMSorUXxq959N=A2JR+dyYR~`K_nd0v+&Cws?1B>lm!9ZHr8D z6hApNMDl?__%C>f06sS7ZkJ(aXpQ_ttB!(M;SB7NE9P*4Gyr{5Q;lKx_K$3~ZR`zw zWy53qUYSW%fs2#nTcSmr3>bAV2I`PKFxo(gNFB3!Q^_xrU=v_OhsoGGS5;_p zf((&!#$!B^Em`m0avcv89qjPc&Adz+8{_J1E1-k|f112Eywj_*#WQE>Vp*QpIq+^l z;`TfTxDF(siq}qiB2wBx4jJ24JNi3c*B$W(j2bB~idgyZpjse6X~(e~!<+iZzq0w0 z`tk>#L1ZM4HBNMdL+q(GZ9#CJ54LpLM?e)8WzEMUd11rtoqHRBGEfCc2FtOku*@%% z<#*OPyB`ppV@&5rbg~L??Uj*4^%;Ic$CImoi&G5zVtX#9tToZvNeK{lK@lcbE1c-s zao|fg?J}0d%sDwHjlq@2L=GJn7~#OLKsT0MtjZ^cg1Zif4)A3;>?`dMs3&n|{|yi0 z&yB&Nj@jFW*yxb$(vq?X0jrrN-3JX2ZyQT_peoN!{*>VC13{cix!jy7zqS zc2{hxAwLnv1$O;UM|gks1Ta#EW)-$M0#2KF9C8dO2H+|ST7Cw3`0$IRMqG3Fr-^GJ zzX3bm%MnLF9sOWnZgI^vB(c~vu?W_v4-p_WWVfim734~kKXY9Oq;-OyA{`LhQ_|GO zVs2Uyr^;QzN4@lEH&e4)4uL!pYWE-I>-m2$m3sKJe2o`pL8Kj!grwpS8?qe^YhW10 zuMO4$d9_Mjdh>5%79`fcUq|beJ0@Qhm^BC#CTMd1{+AeL3xnIj^y{tnW?^sPdzA65 z5qQp|U1JWPj>TyMoG9}>x?p>{-;lT6)Z;NDql|!BMU4&3DgjR65q{zd-)^A);7C9% z%Hv^WGY!M-GqxAa#vMI8rHRE!7u5fB7~ap;jwd?)5!ON;zhYU05Uc`L;unfSAC#wHPHT%C2RUFgjD-UFR&lKL(l=$UL zX)lm0$}{*J>2rEz`xcGc7iGT!gd@mf-!VSV8XxR3+*!kfuTUnn=W^A;G?HBJeK-!N z9nc@h!xb;KVmx>}w ztq7%xsK~xVr4>;DTb2M}iJwA{06~$kCQ+$StHLLsVGCeEmIMe}h!B#XRFE|&gaiTv z1QQ5^h!6q^N#>26nKNhR%$zgdnZG9g!8z}}_kHg2{GNO7bKhhCMdANBYx%zgg#WhI zRlvS_no95lQj1x{0|W$No`AL(1`GxSvM&VS4c8kTD~V)Dy`(`UVxEtAwX!iWCU*KM z-*}~s}oVekKH=jYiuMQjJ=!EiC)g}Jqq6H?^I5o)< zZT?EUV4~DKYLDG*1RxMgJ7Y1}PvI5I6zIZy5>QfwA(oiDzh_v~7Wk2gVOVBcBD*ErTC+d*=Kf;}(cN--JcHydSAW=~sZgp(Ln}c0^v=Mn926HQtA~NL$8>7sw>EXe^}m=G=3fPb_dnLf#xRU$otR1`4aFCRYjm={sE zq-RAMo;7QO69*xptOM!%v4@KC9&xq%$c*p2OgE5qG^@1;abn1W+!zqdJt zDZR23zPEcPfYf9_5v9`w7DTy!!%CRI>eChSs-UL=23O($sfin4)(ERIM(5QTl()3P z$q#*t?{C9t)|B_!Q|Bxno&RLM0(As_q1%&hbA8ZB9~g z*(O8?fP5EjnIqzzYe_9kV9j8shKc_Q{o2YD=eM5ip`aGZs{v$WqdTw4`wPF_cC#V3 zG-UvQo}mv zIO)pLGpb&_h~h(f&0FmdnmW?9u)O$a79@jC7@=ZOyp z=61@%>i@U(f7r8@uyFlFjX*=!2gQhqO-r4>7X%3mqLn8?By1vy&HTkwP4@rdXWv=V zy#03MtO>E)+mN{0AFzF43*4Jhag4MIoRt^02&(9qh~Xb#aE>>C+9P6Fz2r9c+VYl2 zNtZA$7jXwa*$7Nyqd>5ZF=i15H+?@g#Pd>JTl@}??e_G0Yk~zQqd zFIu~|y)XUi90}t5@Xtn^e=oHBvjo&33&b7h)L#F(DpE!Nbl;D78{bafJWs)5m*_i& zJK_5|`{X;KU)j+Tqhmjf-D}gj5hbw%Fp>S6afmexO)r}we`(W_b-<~oz$xxvt@GN( z=N#Gph4TM-8nvEyf5)aoKgoSz1M2{>+$+v^vbEN)bH14hFFV>liarzc30odnU2;^1J^97K_A zW#VN?mC%d@Cm@JYFC7Rk7+-g9x&0j8Z=5QlrwT+|`!&b6B1*inIhY5Om)X{>m&MTO zRfHxo6?fb`Vt6Te(dqs7%MX!7hu%DXu$qJ`4e8RD zxI>#}m0V`zP4}F40Bvm1+W??gwfS<>gJvnNGXjR$^gZ`wfV>wEl*Jykg5|mQ`Kebe z;UGKd{DJ7Z_QVu0h)$EaunJQLZKK$38QJUo`VN5HddzX`X!O^tj4FPMTWohYJy5f} zE*T#C`rvXQpUKbxP!LdlEk~>~NW0$osg;79l z36SqJW8hBkaq;XM_Dz{}3C8gH+F|l;!M(oGe&#sz*0*CL?C8MDIb75z9CO`L`JC0Y z?eqwSKNjqM{Y8gBd4rcZzqek|2V}-=b&+Uw0qDJOeL4>*=H;#C2E6rU#cNHC`uP8b$RFSM~tt0ML?>H^Mps#-SE(}#qMZsRrGLSak z@y|y^_%6jT(nM{5@=&j0q}3&>et$8jXBGs|l35sk$>O%o)XLsw#sUFzU>j=)3PV=1eg>3!+T6RD8xQD2HQLxR)uDbo7C!m7?``LTiW! z>o3B?E^)q&Su_tm5ze5jQK!UPLYTVfvGi6&UyfK}tz(lG-EZ2#N(^ zBp`m%y8?O7+AJATLtm_(CfXk3MRZX>|9ZzfK;T-Fx z$o!#HaJ`}-6->vE)iTHaNQ6n!y;Yr73y@cO?xz6b0nz@@NPEIV>MP=6KhEiulg829 z&nhhh))k)KfxXe5AH_MwAB7tyvqctURXO%k0zem~l#4K7!4aus%>np&=!+A}1k$^<*4S`P1b*`H) zqw0YO&!eO(c@E)>YoCLaej(MG803j&3zcGTaQ4S6(e*_%e+ewpRcK-_0=(xJ+}s13w@(h3;P7AeK~SVeqhN`zvBg-r+s{pE#mI_l@fqFCh62L z)8IK$6ZiW*v4wJ=1J&?^4Z_PMn#F|R#Wr&s1vTS6qGVO@T(}z#Rs)t_h4x9t92-)= z1Hc$PHfK<_jTqz!Hv6e?41){rhF0A(f6yVEtLGv2UfjQwZA`70S zu6Vf`9oU{lfMm!RsH~WFA5J%@u}LaFGr8r)yl}hz+Tmrsuu$LERc58XVH_7Mp&=eh zf7J?b7V!)_6Q<&GuNK)-Q&hWTJ^3=7wk1pUd~c%f7loqGBNK+zaYZBJ(fC)uNyjgi zq?LT$v3aVc85{j(gICv&JrHpZ@FdRzHTS64UZxlL@;E^Q>tI8cCemQopA(X7Kh06zKVI1! z1W!K)Aca#BdC8*%i@3$f!95wMq?f76kXlQ%>(t*#kn)0Fyv6EWih!i4dZQbey4p6c z;+<4Qr}ff%cD1%noo!FbcqbkKa4zPcXau&wR9nnBL_kK`oRtw$J@*Dr)czng zX$r&G>;<%j9j*=I0LjGh=x+JA?&gvnBE_2&#z8JvOe((p=W*fx(?37BKpsUHmZ1Hi_M_g z?Id=R>Id&^;ENB|4a|hhT?QSx3RB+X>p~O^%}?_x!4uE;>y^ zQhV-{ocTtlUV^a7RAwo<)KUxT6}I@l{4D?664ev~Zp$O?8&fy7XwodfW%4JQgc=Ia2Y_-SXRt39Mv%^p$Cz9YRj-W$pDIP=|54{M3f1Ien7vD5(%y&ECrw1;0pH558N;u zs#9zr)(*Wy>ta%|muU^MG?tADVY$erEHRC&iI@r*Qh!~rUaRGxGN^sIq+Tm`UjbP; z*q3q3{uC%sjKZE8U3^;734ZtT-~{&iSE*LQ0ncJ-Rfiw3%#hO-PbK2?uM|LmBmbhX z(j_-3Sn^ajR zu&0ZH@K!t#&&W37Y&E^}`L9&O_0M;ih98l4-8O(YV!JLIQolM)>Yw>Y#I}}&(2jHt zRe-aajlkCvMEA1y-%EQq+dk#G81?g2mrQLRhKI%Rr1D zuQ=m#v$-$li&qM=nONfwR>E>EaxMyHmG!#8GVX8!Ix{6v!2hKKWn<%TwVRx|*aT~uCebQf=%+tQ~>8_ErcdV1`AMPqe5bibad4p%DwzPBk&!ftqznXQQPCePb z<*12USW*J3$rKbQJoZrz5h2glKeJgQ5JStY@`F7&)K_L zADy%xN;BDk2S2xqbLp;r@5avz$a=D^w=gL1DkSsjxyF3gPjyF?3#sg`g?gWNiZu%P z!~^HqzC)vUe{!?g;mi6g3bFp=w7SMpTT>kh%FA{Ok&)Jay6~pKqhVZ>hc{o@v%xdHpGL|>c%!CN~b1w@9sxHA+n}xc_yaCj)km+)aywjsj&CC3? z1;L-G`bnK0->0i-kSQqL}hf-E)&jFEcqWq4` zVK#8@Ckg%Y=NjiS;9T)L?URb7Euht1k*aUM1i>QLk=^MWvD;0gWFs{jieu!=WVkBv zGu3{ro*PD7Ppiz_nQr0I*XS<;F@_iHjWb7^HM^j4$ zD}fg>#pEyzki%)U&R2r~c4c)^(gO7I2HFnF~xo$kh(PF#Ke$gBpRJ<>Sn#oVCLKOmHTj!wxJ$a%Lcl~B)N z=|*g()Wp`Y>rjJy-!Ot>RlTXjWO^OfxlIGe14PTMv%dNy-^OIcLUsF;wxtlk<+kH>|H6pI(9Iwmy5; zyu07LbW4TnekR-_40~D42L$R_?aqdU9t`mrwZTCmUHXQ(6ZVWFJ#r7>k<4W5Y;%SW z8!P#Z9a%McwDeaW=($F`TXQv?hk`oiw@gr=tBM?ywYvlKLirk5# z8)hXc{XXOM(0}*e8jS&xSLCrbYq`ap>Tl%elrGQ%dApK-x=>6(W@dSY_Oq@G96S`R zwH2oL+d{#PsI-Xz>Z+x)sL8#8Z3S}6%z#TzFT9wL&vCPNJq^m)HEVWF8hZqu2@E%F zcI;ZVSPKwj0yD794@^iKH#g)yo9`>{#VlY=LOt(}$*8senCUfTUuZE@A-x48*PF>- zo|#R}#?Jy!v+w6kvk~1#2QgG=mV-$bhPE7IN*Ps^J}diNA%bb&(!X7pJD!q%FPqC2 zyKbwOr6a>A7F~~MMQ*WsGXosTGGaliB}R~pN>4+b#tKR{=+?0=ZDFC9^T43P z?pc_alMS78p4<>UaP2GTRc2blx4&%6if-1$^9=P2!p$gLwYVvX7s=S}(DT3z%$M_XSx^K^i7LK4p^*3_?!f}b?+-In5j2nm$y>vlhCa;CAc4Qe5z|Y8AwF8 zZYhH(lPHXI4k!4M`ZirR1eR)l3j2BQ9=d&q1L@MIRKWM%6ZlhRa&?DJThQdi5%lg- ztCp{hUa79Y{mg0YMsEW7jNC-+1L|_V2!qGK^>u zX)_4%kNw4fz!Na155rPmkePW`R+iqAYYZdo#ZL`Jyi40Y3Lupk02xp%Examples as.data.table(smry) #> variable importance value mean medn lwr upr -#> 1: ascites 0.4910000 0 0.6910482 0.8020607 0.4793900 0.9356229 -#> 2: ascites 0.4910000 1 0.5367928 0.6004745 0.3455624 0.7427543 -#> 3: bili 0.3959368 0.80 0.7671193 0.8562470 0.6435096 0.9406650 -#> 4: bili 0.3959368 1.40 0.7436993 0.8225277 0.6068565 0.9251464 -#> 5: bili 0.3959368 3.52 0.6198406 0.6856069 0.4653703 0.8110744 -#> 6: edema 0.3203407 0 0.6959783 0.8068156 0.4839991 0.9392233 -#> 7: edema 0.3203407 0.5 0.5898021 0.6275451 0.3877274 0.7929652 -#> 8: edema 0.3203407 1 0.5871225 0.6309284 0.3741667 0.8145640 +#> 1: ascites 0.4730483 0 0.6932660 0.7916641 0.4859274 0.9406494 +#> 2: ascites 0.4730483 1 0.5400248 0.6013855 0.3606726 0.7381156 +#> 3: bili 0.4091540 0.80 0.7645298 0.8521718 0.6246527 0.9474698 +#> 4: bili 0.4091540 1.40 0.7427138 0.8227958 0.5924513 0.9292095 +#> 5: bili 0.4091540 3.52 0.6296811 0.6935698 0.4653658 0.8270041 +#> 6: edema 0.3102631 0 0.6995667 0.8042188 0.4921150 0.9411968 +#> 7: edema 0.3102631 0.5 0.6015764 0.6593340 0.3891068 0.7962471 +#> 8: edema 0.3102631 1 0.5993817 0.6468171 0.3786302 0.8259274 #> pred_horizon level #> 1: 1788 0 #> 2: 1788 1 diff --git a/reference/orsf_control_custom.html b/reference/orsf_control_custom.html index 861619d7..f1b9cef4 100644 --- a/reference/orsf_control_custom.html +++ b/reference/orsf_control_custom.html @@ -121,10 +121,10 @@

    Random coefficients## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 -## Average leaves per tree: 19.76 +## Average leaves per tree: 19.682 ## Min observations in leaf: 5 ## Min events in leaf: 1 -## OOB stat value: 0.84 +## OOB stat value: 0.83 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## @@ -177,15 +177,15 @@

    Evaluate## ## model times Brier lower upper IPA ## 1: Null model 1788 20.479 18.090 22.868 0.000 -## 2: rando 1788 11.808 9.729 13.888 42.339 -## 3: pca 1788 12.861 10.833 14.889 37.199 +## 2: rando 1788 11.872 9.771 13.972 42.031 +## 3: pca 1788 12.990 10.971 15.009 36.569 ## ## Results of model comparisons: ## ## times model reference delta.Brier lower upper p -## 1: 1788 rando Null model -8.671 -10.813 -6.528 2.142609e-15 -## 2: 1788 pca Null model -7.618 -9.379 -5.857 2.300807e-17 -## 3: 1788 pca rando 1.053 0.241 1.865 1.106784e-02 +## 1: 1788 rando Null model -8.607 -10.809 -6.406 1.832790e-14 +## 2: 1788 pca Null model -7.489 -9.213 -5.765 1.664802e-17 +## 3: 1788 pca rando 1.118 0.258 1.979 1.087482e-02 ## ## NOTE: Values are multiplied by 100 and given in %. diff --git a/reference/orsf_summarize_uni.html b/reference/orsf_summarize_uni.html index bf7cadc5..a2d112b0 100644 --- a/reference/orsf_summarize_uni.html +++ b/reference/orsf_summarize_uni.html @@ -152,24 +152,24 @@

    Examples#> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % -#> 0 0.6828102 0.7768548 0.4716727 0.9346420 -#> 1 0.5579327 0.6105944 0.3471315 0.7721955 +#> 0 0.6985772 0.7778961 0.5076467 0.9625396 +#> 1 0.5357652 0.5899158 0.3432510 0.7223251 #> -#> -- bili (VI Rank: 2) -------------------------- +#> -- edema (VI Rank: 2) ------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % -#> 0.80 0.7458561 0.8378528 0.6073211 0.9468758 -#> 1.40 0.7198478 0.8099048 0.5737313 0.9291287 -#> 3.52 0.6214243 0.6784119 0.4142632 0.8398702 +#> 0 0.7023951 0.7910831 0.4997954 0.9625396 +#> 0.5 0.5466641 0.5299526 0.3376921 0.7933590 +#> 1 0.5309622 0.4879545 0.2887210 0.7964328 #> -#> -- edema (VI Rank: 3) ------------------------- +#> -- bili (VI Rank: 3) -------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % -#> 0 0.6892673 0.7786128 0.4716727 0.9346420 -#> 0.5 0.5370010 0.5273521 0.3228615 0.7637832 -#> 1 0.5433128 0.5246940 0.3033819 0.8003144 +#> 0.80 0.7781310 0.8665958 0.6715962 0.9702002 +#> 1.40 0.7403634 0.8295737 0.6265314 0.9312644 +#> 3.52 0.6284779 0.6885322 0.4583099 0.8284686 #> #> Predicted survival at time t = 1788 for top 3 predictors @@ -183,24 +183,24 @@

    Examples#> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % -#> 0.80 0.7458561 0.8378528 0.6073211 0.9468758 -#> 1.40 0.7198478 0.8099048 0.5737313 0.9291287 -#> 3.52 0.6214243 0.6784119 0.4142632 0.8398702 +#> 0.80 0.7781310 0.8665958 0.6715962 0.9702002 +#> 1.40 0.7403634 0.8295737 0.6265314 0.9312644 +#> 3.52 0.6284779 0.6885322 0.4583099 0.8284686 #> -#> -- copper (VI Rank: 2) ------------------------ +#> -- sex (VI Rank: 2) --------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % -#> 42.8 0.7281277 0.8198190 0.5729566 0.9505562 -#> 74.0 0.7125495 0.7977600 0.5713264 0.9353026 -#> 129 0.6411257 0.7000076 0.4974017 0.8797232 +#> m 0.6693552 0.7366514 0.4918090 0.8863393 +#> f 0.6913549 0.7745463 0.4792209 0.9625396 #> -#> -- sex (VI Rank: 3) --------------------------- +#> -- copper (VI Rank: 3) ------------------------ #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % -#> m 0.6584815 0.7560459 0.4623345 0.8749346 -#> f 0.6800629 0.7861048 0.4664926 0.9346420 +#> 42.8 0.7336237 0.8276291 0.5793735 0.9659481 +#> 74.0 0.7131908 0.7925953 0.5576385 0.9552043 +#> 129 0.6693603 0.7372459 0.4720362 0.9062475 #> #> Predicted survival at time t = 1788 for top 3 predictors diff --git a/reference/orsf_time_to_train.html b/reference/orsf_time_to_train.html index 5da1dbc6..ee6a3589 100644 --- a/reference/orsf_time_to_train.html +++ b/reference/orsf_time_to_train.html @@ -95,7 +95,7 @@

    Examplestime_estimated <- orsf_time_to_train(object, n_tree_subset = 50) print(time_estimated) -#> Time difference of 0.1956177 secs +#> Time difference of 0.1965189 secs # let's see how close the approximation was time_true_start <- Sys.time() @@ -105,11 +105,11 @@

    Examplestime_true <- time_true_stop - time_true_start print(time_true) -#> Time difference of 0.2299004 secs +#> Time difference of 0.2333381 secs # error abs(time_true - time_estimated) -#> Time difference of 0.03428268 secs +#> Time difference of 0.03681922 secs

    diff --git a/reference/orsf_vs.html b/reference/orsf_vs.html index adc0f62c..909c7172 100644 --- a/reference/orsf_vs.html +++ b/reference/orsf_vs.html @@ -106,14 +106,14 @@

    Examples orsf_vs(object, n_predictor_min = 15) #> n_predictors stat_value predictors_included -#> 1: 15 0.8343664 age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... -#> 2: 16 0.8337413 id,age,sex_f,ascites_1,hepato_1,spiders_1,... -#> 3: 17 0.8336893 id,age,sex_f,ascites_1,hepato_1,spiders_1,... -#> 4: 18 0.8355123 id,trt_placebo,age,sex_f,ascites_1,hepato_1,... +#> 1: 15 0.8431168 age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... +#> 2: 16 0.8213969 age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... +#> 3: 17 0.8266056 id,age,sex_f,ascites_1,hepato_1,spiders_1,... +#> 4: 18 0.8263972 id,trt_placebo,age,sex_f,ascites_1,hepato_1,... #> predictor_dropped -#> 1: trig -#> 2: id -#> 3: platelet +#> 1: spiders_1 +#> 2: alk.phos +#> 3: id #> 4: trt_placebo diff --git a/reference/print.ObliqueForest.html b/reference/print.ObliqueForest.html index d1109cce..60a2c715 100644 --- a/reference/print.ObliqueForest.html +++ b/reference/print.ObliqueForest.html @@ -136,10 +136,10 @@

    Examples#> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 -#> Average leaves per tree: 20.8 +#> Average leaves per tree: 19.8 #> Min observations in leaf: 5 #> Min events in leaf: 1 -#> OOB stat value: 0.77 +#> OOB stat value: 0.76 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> diff --git a/reference/print.orsf_summary_uni.html b/reference/print.orsf_summary_uni.html index 76ecf1ad..d0b2abfb 100644 --- a/reference/print.orsf_summary_uni.html +++ b/reference/print.orsf_summary_uni.html @@ -102,24 +102,24 @@

    Examples#> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % -#> 0 0.6920458 0.7998361 0.4865148 0.9340876 -#> 1 0.5332737 0.5944016 0.3339684 0.7316275 +#> 0 0.6914649 0.7872515 0.4616078 0.9362258 +#> 1 0.5213949 0.5816831 0.3364211 0.7130168 #> #> -- bili (VI Rank: 2) -------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % -#> 0.80 0.7607468 0.8475307 0.6170921 0.9395086 -#> 1.40 0.7401053 0.8265075 0.5942011 0.9260483 -#> 3.52 0.6251061 0.6835610 0.4731634 0.8224297 +#> 0.80 0.7547110 0.8421022 0.6093138 0.9420232 +#> 1.40 0.7356315 0.8169133 0.5716575 0.9264993 +#> 3.52 0.6362687 0.6947275 0.4532841 0.8392213 #> #> -- edema (VI Rank: 3) ------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % -#> 0 0.6963454 0.8047710 0.4898785 0.9361466 -#> 0.5 0.6006160 0.6514396 0.3851734 0.8085655 -#> 1 0.5965868 0.6466259 0.3865121 0.8204036 +#> 0 0.6971149 0.7986289 0.4863726 0.9372551 +#> 0.5 0.5944294 0.6334475 0.3869436 0.7921139 +#> 1 0.5915448 0.6250744 0.3754279 0.8237650 #> #> Predicted survival at time t = 1788 for top 3 predictors diff --git a/search.json b/search.json index b5de6c45..ec104282 100644 --- a/search.json +++ b/search.json @@ -1 +1 @@ -[{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":null,"dir":"","previous_headings":"","what":"Contributing to aorsf","title":"Contributing to aorsf","text":"Want contribute aorsf? Great! aorsf initially stable state development, great deal active subsequent development envisioned. outline propose change aorsf. detailed info contributing , tidyverse packages, please see development contributing guide.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"fixing-typos","dir":"","previous_headings":"","what":"Fixing typos","title":"Contributing to aorsf","text":"can fix typos, spelling mistakes, grammatical errors documentation directly using GitHub web interface, long changes made source file. generally means ’ll need edit roxygen2 comments .R, .Rd file. can find .R file generates .Rd reading comment first line.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"bigger-changes","dir":"","previous_headings":"","what":"Bigger changes","title":"Contributing to aorsf","text":"want make bigger change, ’s good idea first file issue make sure someone team agrees ’s needed. ’ve found bug, please file issue illustrates bug minimal reprex (also help write unit test, needed).","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"pull-request-process","dir":"","previous_headings":"Bigger changes","what":"Pull request process","title":"Contributing to aorsf","text":"Fork package clone onto computer. haven’t done , recommend using usethis::create_from_github(\"ropensci/aorsf\", fork = TRUE). Install development dependencies devtools::install_dev_deps(), make sure package passes R CMD check running devtools::check(). R CMD check doesn’t pass cleanly, ’s good idea ask help continuing. Create Git branch pull request (PR). recommend using usethis::pr_init(\"brief-description--change\"). Make changes, commit git, create PR running usethis::pr_push(), following prompts browser. title PR briefly describe change. body PR contain Fixes #issue-number. user-facing changes, add bullet top NEWS.md (.e. just first header). Follow style described https://style.tidyverse.org/news.html.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"code-style","dir":"","previous_headings":"Bigger changes","what":"Code style","title":"Contributing to aorsf","text":"New code follow tidyverse style guide. can use styler package apply styles, please don’t restyle code nothing PR. use roxygen2, Markdown syntax, documentation. use testthat unit tests. Contributions test cases included easier accept.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"code-of-conduct","dir":"","previous_headings":"","what":"Code of Conduct","title":"Contributing to aorsf","text":"Please note aorsf project released Contributor Code Conduct. contributing project agree abide terms.","code":""},{"path":"https://bcjaeger.github.io/aorsf/LICENSE.html","id":null,"dir":"","previous_headings":"","what":"MIT License","title":"MIT License","text":"Copyright (c) 2022 aorsf authors (Byron C. Jaeger, Sawyer Welden, Nicholas M. Pajewski) Permission hereby granted, free charge, person obtaining copy software associated documentation files (“Software”), deal Software without restriction, including without limitation rights use, copy, modify, merge, publish, distribute, sublicense, /sell copies Software, permit persons Software furnished , subject following conditions: copyright notice permission notice shall included copies substantial portions Software. SOFTWARE PROVIDED “”, WITHOUT WARRANTY KIND, EXPRESS IMPLIED, INCLUDING LIMITED WARRANTIES MERCHANTABILITY, FITNESS PARTICULAR PURPOSE NONINFRINGEMENT. EVENT SHALL AUTHORS COPYRIGHT HOLDERS LIABLE CLAIM, DAMAGES LIABILITY, WHETHER ACTION CONTRACT, TORT OTHERWISE, ARISING , CONNECTION SOFTWARE USE DEALINGS SOFTWARE.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"background","dir":"Articles","previous_headings":"","what":"Background","title":"Introduction to aorsf","text":"oblique random forest (RF) extension traditional (axis-based) RF. Instead using single variable split data grow new branches, trees oblique RF use weighted combination multiple variables.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"oblique-rfs-for-survival-classification-and-regression","dir":"Articles","previous_headings":"","what":"Oblique RFs for survival, classification, and regression","title":"Introduction to aorsf","text":"purpose aorsf (‘’ short accelerated) provide unifying framework fit oblique RFs can scale adequately large data sets. fastest algorithms available package used default often equivalent prediction accuracy computational approaches. Everything aorsf begins orsf() function. begin oblique RF survival using pbc_orsf data, oblique RF classification using penguins_orsf data, FILL REGRESSION. Note n_tree 5 convenience examples, >= 500 practice. may notice first input aorsf data. design choice makes easier use orsf pipes (.e., %>% |>). instance,","code":"library(aorsf) # An oblique survival RF pbc_fit <- orsf(data = pbc_orsf, n_tree = 5, formula = Surv(time, status) ~ . - id) pbc_fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 22.4 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.76 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> ----------------------------------------- # An oblique classification RF penguin_fit <- orsf(data = penguins_orsf, n_tree = 5, formula = species ~ .) penguin_fit #> ---------- Oblique random classification forest #> #> Linear combinations: Accelerated Logistic regression #> N observations: 333 #> N classes: 3 #> N trees: 5 #> N predictors total: 7 #> N predictors per node: 3 #> Average leaves per tree: 5.6 #> Min observations in leaf: 5 #> OOB stat value: 0.98 #> OOB stat type: AUC-ROC #> Variable importance: anova #> #> ----------------------------------------- # An oblique regression RF cars_fit <- orsf(data = mtcars, n_tree = 5, formula = mpg ~ .) cars_fit #> ---------- Oblique random regression forest #> #> Linear combinations: Accelerated Linear regression #> N observations: 32 #> N trees: 5 #> N predictors total: 10 #> N predictors per node: 4 #> Average leaves per tree: 5.2 #> Min observations in leaf: 5 #> OOB stat value: 0.64 #> OOB stat type: RSQ #> Variable importance: anova #> #> ----------------------------------------- library(dplyr) pbc_fit <- pbc_orsf |> select(-id) |> orsf(formula = Surv(time, status) ~ ., n_tree = 5)"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"interpretation","dir":"Articles","previous_headings":"","what":"Interpretation","title":"Introduction to aorsf","text":"aorsf includes several functions dedicated interpretation ORSFs, estimation partial dependence variable importance.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"variable-importance","dir":"Articles","previous_headings":"Interpretation","what":"Variable importance","title":"Introduction to aorsf","text":"multiple methods compute variable importance. compute negation importance, ORSF multiplies coefficient variable -1 re-computes --sample (sometimes referred --bag) accuracy ORSF model. can also compute variable importance using permutation, classical approach noises predictor assigned resulting degradation prediction accuracy importance predictor. faster alternative permutation negation importance ANOVA importance, computes proportion times variable obtains low p-value (p < 0.01) forest grown.","code":"orsf_vi_negate(pbc_fit) #> bili stage copper sex ast #> 0.1796153443 0.0654718662 0.0377992169 0.0300985949 0.0184556866 #> albumin age edema alk.phos chol #> 0.0177062224 0.0172170446 0.0130478892 0.0083611824 0.0069716249 #> ascites spiders trt platelet trig #> 0.0063832024 0.0063499175 0.0015016478 0.0007794253 0.0007182015 #> protime hepato #> -0.0006160457 -0.0065521643 orsf_vi_permute(pbc_fit) #> bili copper edema ascites albumin chol #> 0.076377458 0.027301164 0.017138302 0.012935499 0.012645786 0.010981566 #> stage platelet age alk.phos sex spiders #> 0.008385515 0.006916673 0.006300806 0.006115436 0.005605453 0.002729921 #> ast protime hepato trig trt #> 0.001706344 0.001490477 -0.002072969 -0.003145736 -0.003454973 orsf_vi_anova(pbc_fit) #> edema ascites bili copper stage chol alk.phos #> 0.42139078 0.37500000 0.31818182 0.28000000 0.26923077 0.26315789 0.25000000 #> age albumin protime platelet sex ast trig #> 0.25000000 0.22222222 0.21428571 0.19047619 0.16666667 0.10714286 0.09090909 #> hepato spiders trt #> 0.04761905 0.00000000 0.00000000"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"partial-dependence-pd","dir":"Articles","previous_headings":"Interpretation","what":"Partial dependence (PD)","title":"Introduction to aorsf","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. PD, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"individual-conditional-expectations-ice","dir":"Articles","previous_headings":"Interpretation","what":"Individual conditional expectations (ICE)","title":"Introduction to aorsf","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. ICE, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"what-about-the-original-orsf","dir":"Articles","previous_headings":"","what":"What about the original ORSF?","title":"Introduction to aorsf","text":"original ORSF (.e., obliqueRSF) used glmnet find linear combinations inputs. aorsf allows users implement approach using orsf_control_survival(method = 'net') function: net forests fit lot faster original ORSF function obliqueRSF. However, net forests still much slower cph ones.","code":"orsf_net <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, control = orsf_control_survival(method = 'net'))"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"aorsf-and-other-machine-learning-software","dir":"Articles","previous_headings":"","what":"aorsf and other machine learning software","title":"Introduction to aorsf","text":"unique feature aorsf fast algorithms fit ORSF ensembles. RLT obliqueRSF fit oblique random survival forests, aorsf faster. ranger randomForestSRC fit survival forests, neither package supports oblique splitting. obliqueRF fits oblique random forests classification regression, survival. PPforest fits oblique random forests classification survival. Note: default prediction behavior aorsf models produce predicted risk specific prediction horizon, default ranger randomForestSRC. think change future, computing time independent predictions aorsf helpful.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"learning-more","dir":"Articles","previous_headings":"","what":"Learning more","title":"Introduction to aorsf","text":"aorsf began dedicated package oblique random survival forests, papers published far focused survival analysis risk prediction. However, routines regression classification oblique RFs aorsf high overlap survival ones. See orsf details oblique random survival forests. see JCGS paper details algorithms used specifically aorsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"go-faster","dir":"Articles","previous_headings":"","what":"Go faster","title":"Tips to speed up computation","text":"Analyses can slow crawl models need hours run. article find tricks prevent bottleneck using orsf().","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"dont-specify-a-control","dir":"Articles","previous_headings":"","what":"Don’t specify a control","title":"Tips to speed up computation","text":"default control orsf() NULL , unspecified, orsf() pick fastest possible control depending type forest grown. default control run-time compared approaches can striking. example:","code":"time_fast <- system.time( expr = orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5) ) time_net <- system.time( expr = orsf(pbc_orsf, formula = time+status~. -id, control = orsf_control_survival(method = 'net'), n_tree = 5) ) # control_fast() is much faster time_net['elapsed'] / time_fast['elapsed'] #> elapsed #> 52.71429"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"use-n_thread","dir":"Articles","previous_headings":"","what":"Use n_thread","title":"Tips to speed up computation","text":"n_thread argument uses multi-threading run aorsf functions parallel possible. know many threads want, e.g. want exactly 5, just say n_thread = 5. aren’t sure many threads available want use many can, say n_thread = 0 aorsf figure number . R single threaded language, multi-threading applied orsf() needs call R functions C++, occurs customized R function used find linear combination variables compute prediction accuracy.","code":"# automatically pick number of threads based on amount available orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5, n_thread = 0) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 20.8 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.75 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"do-less","dir":"Articles","previous_headings":"","what":"Do less","title":"Tips to speed up computation","text":"defaults orsf() can adjusted make run faster: set n_retry 0 instead 3 (default) set oobag_pred_type ‘none’ instead ‘surv’ (default) set ‘importance’ ‘none’ instead ‘anova’ (default) increase split_min_events, split_min_obs, leaf_min_events, leaf_min_obs make trees stop growing sooner increase split_min_stat make trees stop growing sooner Applying tips: default values make orsf() run slower, also usually make predictions accurate make fit easier interpret.","code":"orsf(pbc_orsf, formula = time+status~., n_thread = 0, n_tree = 5, n_retry = 0, oobag_pred_type = 'none', importance = 'none', split_min_events = 20, leaf_min_events = 10, split_min_stat = 10) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 18 #> N predictors per node: 5 #> Average leaves per tree: 6.4 #> Min observations in leaf: 5 #> Min events in leaf: 10 #> OOB stat value: none #> OOB stat type: none #> Variable importance: none #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"show-progress","dir":"Articles","previous_headings":"","what":"Show progress","title":"Tips to speed up computation","text":"Setting verbose_progress = TRUE doesn’t make anything run faster, can help make feel like things running less slow.","code":"verbose_fit <- orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5, verbose_progress = TRUE) #> Growing trees: 100%. #> Computing predictions: 100%."},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"out-of-bag-data","dir":"Articles","previous_headings":"","what":"Out-of-bag data","title":"Out-of-bag predictions and evaluation","text":"random forests, tree grown bootstrapped version training set. bootstrap samples selected replacement, bootstrapped training set contains two-thirds instances original training set. ‘--bag’ data instances bootstrapped training set.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"out-of-bag-predictions-and-error","dir":"Articles","previous_headings":"","what":"Out-of-bag predictions and error","title":"Out-of-bag predictions and evaluation","text":"tree random forest can make predictions --bag data, --bag predictions can aggregated make ensemble --bag prediction. Since --bag data used grow tree, accuracy ensemble --bag predictions approximate generalization error random forest. --bag prediction error plays central role routines estimate variable importance, e.g. negation importance. Let’s fit oblique random survival forest plot distribution ensemble --bag predictions. surprisingly, survival predictions 0 1. Next, let’s check --bag accuracy fit: --bag estimate 1 (default method evaluate --bag predictions) 0.796875.","code":"fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, oobag_pred_type = 'surv', n_tree = 5, oobag_pred_horizon = 2000) hist(fit$pred_oobag, main = 'Ensemble out-of-bag survival predictions at t=3,500') # what function is used to evaluate out-of-bag predictions? fit$eval_oobag$stat_type #> [1] 1 # what is the output from this function? fit$eval_oobag$stat_values #> [,1] #> [1,] 0.796875"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"monitoring-out-of-bag-error","dir":"Articles","previous_headings":"","what":"Monitoring out-of-bag error","title":"Out-of-bag predictions and evaluation","text":"--bag data set contains one-third training set, --bag error estimate usually converges stable value trees added forest. want monitor convergence --bag error oblique random survival forest, can set oobag_eval_every compute --bag error every oobag_eval_every tree. example, let’s compute --bag error fitting tree forest 50 trees: general, least 500 trees recommended random forest fit. ’re just using 10 illustration.","code":"fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, n_tree = 20, tree_seeds = 2, oobag_pred_type = 'surv', oobag_pred_horizon = 2000, oobag_eval_every = 1) plot( x = seq(1, 20, by = 1), y = fit$eval_oobag$stat_values, main = 'Out-of-bag C-statistic computed after each new tree is grown.', xlab = 'Number of trees grown', ylab = fit$eval_oobag$stat_type ) lines(x=seq(1, 20), y = fit$eval_oobag$stat_values)"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"user-supplied-out-of-bag-evaluation-functions","dir":"Articles","previous_headings":"","what":"User-supplied out-of-bag evaluation functions","title":"Out-of-bag predictions and evaluation","text":"cases, may want control --bag error estimated. example, let’s use Brier score SurvMetrics package: two ways apply function compute --bag error. First, can apply function --bag survival predictions stored ‘aorsf’ objects, e.g: Second, can pass function orsf(), used place Harrell’s C-statistic:","code":"oobag_fun_brier <- function(y_mat, w_vec, s_vec){ # output is numeric vector of length 1 as.numeric( SurvMetrics::Brier( object = Surv(time = y_mat[, 1], event = y_mat[, 2]), pre_sp = s_vec, # t_star in Brier() should match oob_pred_horizon in orsf() t_star = 2000 ) ) } oobag_fun_brier(y_mat = pbc_orsf[,c('time', 'status')], s_vec = fit$pred_oobag) #> [1] 0.117498 fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, n_tree = 20, tree_seeds = 2, oobag_pred_horizon = 2000, oobag_fun = oobag_fun_brier, oobag_eval_every = 1) plot( x = seq(1, 20, by = 1), y = fit$eval_oobag$stat_values, main = 'Out-of-bag error computed after each new tree is grown.', sub = 'For the Brier score, lower values indicate more accurate predictions', xlab = 'Number of trees grown', ylab = \"Brier score\" ) lines(x=seq(1, 20), y = fit$eval_oobag$stat_values)"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"specific-instructions-on-user-supplied-functions","dir":"Articles","previous_headings":"User-supplied out-of-bag evaluation functions","what":"Specific instructions on user-supplied functions","title":"Out-of-bag predictions and evaluation","text":"User-supplied functions must: exactly three arguments named y_mat, w_vec, s_vec. return numeric output length 1 either conditions true, error occur. simple test make sure user-supplied function work aorsf package :","code":"# Helper code to make sure your oobag_fun function will work with aorsf # time and status values test_time <- seq(from = 1, to = 5, length.out = 100) test_status <- rep(c(0,1), each = 50) # y-matrix is presumed to contain time and status (with column names) y_mat <- cbind(time = test_time, status = test_status) # s_vec is presumed to be a vector of survival probabilities s_vec <- seq(0.9, 0.1, length.out = 100) # see 1 in the checklist above names(formals(oobag_fun_brier)) == c(\"y_mat\", \"w_vec\", \"s_vec\") #> [1] TRUE TRUE TRUE test_output <- oobag_fun_brier(y_mat = y_mat, w_vec = w_vec, s_vec = s_vec) # test output should be numeric is.numeric(test_output) #> [1] TRUE # test_output should be a numeric value of length 1 length(test_output) == 1 #> [1] TRUE"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"notes","dir":"Articles","previous_headings":"","what":"Notes","title":"Out-of-bag predictions and evaluation","text":"evaluating --bag error: oobag_pred_horizon input orsf() determines prediction horizon --bag predictions. prediction horizon needs specified evaluate prediction accuracy cases, examples . sure check case using functions, , sure oobag_pred_horizon matches prediction horizon used custom function. functions expect predicted risk (.e., 1 - predicted survival), others expect predicted survival. cases, also able use function whatsoever compute --bag prediction error estimating negation permutation importance, assuming passes tests . Unfortunately, exception riskRegression::Score(), one favorites. experimented riskRegression::Score found work try run C++. sure case.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"partial-dependence-pd","dir":"Articles","previous_headings":"","what":"Partial dependence (PD)","title":"PD and ICE curves with ORSF","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. Begin fitting ORSF ensemble. Set prediction horizon 5 years fit ensemble aorsf function pass ensemble assume want compute predictions 5 years.","code":"library(aorsf) pred_horizon <- 365.25 * 5 set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, n_tree = 50, oobag_pred_horizon = pred_horizon) fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 150 #> N events: 52 #> N trees: 50 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 10.26 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.82 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"three-ways-to-compute-pd","dir":"Articles","previous_headings":"","what":"Three ways to compute PD","title":"PD and ICE curves with ORSF","text":"can compute PD three ways aorsf: using -bag predictions training data using --bag predictions training data using predictions new set data -bag PD indicates relationships model learned training. helpful goal interpret model. --bag PD indicates relationships model learned training using --bag data simulates application model new data. want test model’s reliability fairness new data don’t access large testing set. new data PD shows model predicts outcomes observations seen. helpful want test model’s reliability fairness. Let’s re-fit ORSF model available data proceeding next sections.","code":"pd_inb <- orsf_pd_inb(fit, pred_spec = list(bili = 1:5)) pd_inb #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.7907730 0.2481813 0.8937603 0.9844993 #> 2: 1826.25 2 0.7601163 0.2197790 0.8682995 0.9727126 #> 3: 1826.25 3 0.7285689 0.2036100 0.8217230 0.9565828 #> 4: 1826.25 4 0.6746859 0.1718164 0.7566957 0.9123469 #> 5: 1826.25 5 0.6432024 0.1594598 0.7325270 0.8812735 pd_oob <- orsf_pd_oob(fit, pred_spec = list(bili = 1:5)) pd_oob #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.7881621 0.2863629 0.8597642 0.9894571 #> 2: 1826.25 2 0.7555353 0.2442537 0.8200408 0.9748819 #> 3: 1826.25 3 0.7255229 0.2015414 0.8066997 0.9652856 #> 4: 1826.25 4 0.6627814 0.1825518 0.7251021 0.9222259 #> 5: 1826.25 5 0.6312946 0.1513669 0.6887701 0.9008661 pd_test <- orsf_pd_new(fit, new_data = pbc_orsf_test, pred_spec = list(bili = 1:5)) pd_test #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.7431989 0.2273887 0.7909497 0.9839732 #> 2: 1826.25 2 0.7109910 0.1997981 0.7468900 0.9641052 #> 3: 1826.25 3 0.6810310 0.2020585 0.7197035 0.9462750 #> 4: 1826.25 4 0.6286608 0.1842981 0.6652184 0.8986032 #> 5: 1826.25 5 0.5963168 0.1735789 0.6239932 0.8723134 set.seed(329730) fit <- orsf(pbc_orsf, Surv(time, status) ~ . -id, n_tree = 50, oobag_pred_horizon = pred_horizon)"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"one-variable-one-horizon","dir":"Articles","previous_headings":"","what":"One variable, one horizon","title":"PD and ICE curves with ORSF","text":"Computing PD single variable straightforward: output shows expected predicted mortality risk men substantially higher women 5 years baseline.","code":"pd_sex <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\"))) pd_sex #> pred_horizon sex mean lwr medn upr #> 1: 1826.25 m 0.6435480 0.07603602 0.7117799 0.9703216 #> 2: 1826.25 f 0.6856422 0.05828848 0.8006676 0.9897476"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"one-variable-moving-horizon","dir":"Articles","previous_headings":"","what":"One variable, moving horizon","title":"PD and ICE curves with ORSF","text":"effect predictor varies time? PD can show . inspection, can see males higher risk females difference risk grows time. can also seen viewing ratio expected risk time:","code":"pd_sex_tv <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\")), pred_horizon = seq(365, 365*5)) ggplot(pd_sex_tv, aes(x = pred_horizon, y = mean, color = sex)) + geom_line() + labs(x = 'Time since baseline', y = 'Expected risk') library(data.table) ratio_tv <- pd_sex_tv[ , .(ratio = mean[sex == 'm'] / mean[sex == 'f']), by = pred_horizon ] ggplot(ratio_tv, aes(x = pred_horizon, y = ratio)) + geom_line(color = 'grey') + geom_smooth(color = 'black', se = FALSE) + labs(x = 'time since baseline', y = 'ratio in expected risk for males versus females') #> `geom_smooth()` using method = 'gam' and formula = 'y ~ s(x, bs = \"cs\")'"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"multiple-variables-marginally","dir":"Articles","previous_headings":"","what":"Multiple variables, marginally","title":"PD and ICE curves with ORSF","text":"want compute PD marginally multiple variables, just list variable values pred_spec specify expand_grid = FALSE. Now tedious wanted variables? bet. ’s made function . bonus, printed output sorted least important variables. ’s easy enough turn ‘summary’ object data.table downstream plotting tables.","code":"pd_two_vars <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\"), bili = 1:5), expand_grid = FALSE) pd_two_vars #> pred_horizon variable value level mean lwr medn upr #> 1: 1826.25 sex NA m 0.6435480 0.07603602 0.7117799 0.9703216 #> 2: 1826.25 sex NA f 0.6856422 0.05828848 0.8006676 0.9897476 #> 3: 1826.25 bili 1 0.7578522 0.14149456 0.8228529 0.9879458 #> 4: 1826.25 bili 2 0.7007216 0.09924444 0.7792010 0.9688718 #> 5: 1826.25 bili 3 0.6463678 0.08210453 0.7216161 0.9398680 #> 6: 1826.25 bili 4 0.6058594 0.06268395 0.6709035 0.9324928 #> 7: 1826.25 bili 5 0.5760493 0.05933883 0.6265555 0.9027867 pd_smry <- orsf_summarize_uni(fit, n_variables = 4) pd_smry #> #> -- ascites (VI Rank: 1) ----------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.6881650 0.7943433 0.4746425 0.9449489 #> 1 0.5111958 0.5708393 0.3199671 0.7159134 #> #> -- bili (VI Rank: 2) -------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0.80 0.7651622 0.8323025 0.6370644 0.9563400 #> 1.40 0.7343138 0.8090864 0.5983719 0.9342372 #> 3.52 0.6271650 0.6967314 0.4420082 0.8455518 #> #> -- edema (VI Rank: 3) ------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.6941026 0.8006676 0.4662736 0.9449489 #> 0.5 0.5978522 0.6289791 0.3879660 0.8228830 #> 1 0.5981885 0.6461966 0.3858379 0.8131762 #> #> -- copper (VI Rank: 4) ------------------------ #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 42.8 0.7397492 0.8450985 0.5764946 0.9533662 #> 74.0 0.7168641 0.8286188 0.5265654 0.9448001 #> 129 0.6565337 0.7409069 0.4453135 0.8936874 #> #> Predicted survival at time t = 1826.25 for top 4 predictors head(as.data.table(pd_smry)) #> variable importance Value Mean Median 25th % 75th % #> 1: ascites 0.5225225 0 0.6881650 0.7943433 0.4746425 0.9449489 #> 2: ascites 0.5225225 1 0.5111958 0.5708393 0.3199671 0.7159134 #> 3: bili 0.3807339 0.80 0.7651622 0.8323025 0.6370644 0.9563400 #> 4: bili 0.3807339 1.40 0.7343138 0.8090864 0.5983719 0.9342372 #> 5: bili 0.3807339 3.52 0.6271650 0.6967314 0.4420082 0.8455518 #> 6: edema 0.2965828 0 0.6941026 0.8006676 0.4662736 0.9449489 #> pred_horizon level #> 1: 1826.25 0 #> 2: 1826.25 1 #> 3: 1826.25 #> 4: 1826.25 #> 5: 1826.25 #> 6: 1826.25 0"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"multiple-variables-jointly","dir":"Articles","previous_headings":"","what":"Multiple variables, jointly","title":"PD and ICE curves with ORSF","text":"PD can show expected value model’s predictions function specific predictor, function multiple predictors. instance, can estimate predicted risk joint function bili, edema, trt: inspection, model’s predictions indicate slightly lower risk placebo group, seem change much different values bili edema. clear increase predicted risk higher levels edema higher levels bili slope predicted risk function bili appears highest among patients edema 0.5. effect bili modified edema 0.5? quick sanity check coxph suggests .","code":"pred_spec = list(bili = seq(1, 5, length.out = 20), edema = levels(pbc_orsf_train$edema), trt = levels(pbc_orsf$trt)) pd_bili_edema <- orsf_pd_oob(fit, pred_spec) library(ggplot2) ggplot(pd_bili_edema, aes(x = bili, y = medn, col = trt, linetype = edema)) + geom_line() + labs(y = 'Expected predicted risk') library(survival) pbc_orsf$edema_05 <- ifelse(pbc_orsf$edema == '0.5', 'yes', 'no') fit_cph <- coxph(Surv(time,status) ~ edema_05 * bili, data = pbc_orsf) anova(fit_cph) #> Analysis of Deviance Table #> Cox model: response is Surv(time, status) #> Terms added sequentially (first to last) #> #> loglik Chisq Df Pr(>|Chi|) #> NULL -550.19 #> edema_05 -546.83 6.7248 1 0.009508 ** #> bili -513.59 66.4689 1 3.555e-16 *** #> edema_05:bili -510.54 6.1112 1 0.013433 * #> --- #> Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"individual-conditional-expectations-ice","dir":"Articles","previous_headings":"","what":"Individual conditional expectations (ICE)","title":"PD and ICE curves with ORSF","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. Just like PD, can compute ICE using -bag, --bag, testing data, principles apply. ’ll use --bag estimates .","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"visualizing-ice-curves","dir":"Articles","previous_headings":"","what":"Visualizing ICE curves","title":"PD and ICE curves with ORSF","text":"Inspecting ICE curves observation can help identify whether heterogeneity model’s predictions. .e., effect variable follow pattern data, groups variable impacts risk differently? going turn boundary checking orsf_ice_oob setting boundary_checks = FALSE, allow generate ICE curves go beyond 90th percentile bili. id_variable identifier current value variable(s) data. redundant one variable, helpful multiple variables. id_row identifier observation original data. used group observation’s predictions together plots. plots, helpful scale ICE data. subtract initial value predicted risk (.e., bili = 1) observation’s conditional expectation values. , Every curve start 0 plot shows change predicted risk function bili. Now can visualize curves. inspection figure, individual slopes cluster around overall trend - Good! small number individual slopes appear flat. may helpful investigate .","code":"pred_spec <- list(bili = seq(1, 10, length.out = 25)) ice_oob <- orsf_ice_oob(fit, pred_spec, boundary_checks = FALSE) ice_oob #> id_variable id_row pred_horizon bili pred #> 1: 1 1 1826.25 1 0.1256531 #> 2: 1 2 1826.25 1 0.1266534 #> 3: 1 3 1826.25 1 0.2493624 #> 4: 1 4 1826.25 1 0.1644180 #> 5: 1 5 1826.25 1 0.4634519 #> --- #> 6896: 25 272 1826.25 10 0.4739199 #> 6897: 25 273 1826.25 10 0.5088416 #> 6898: 25 274 1826.25 10 0.8041698 #> 6899: 25 275 1826.25 10 0.3732715 #> 6900: 25 276 1826.25 10 0.7077810 ice_oob[, pred_subtract := rep(pred[id_variable==1], times=25)] ice_oob[, pred := pred - pred_subtract] library(ggplot2) ggplot(ice_oob, aes(x = bili, y = pred, group = id_row)) + geom_line(alpha = 0.15) + labs(y = 'Change in predicted risk') + geom_smooth(se = FALSE, aes(group = 1)) #> `geom_smooth()` using method = 'gam' and formula = 'y ~ s(x, bs = \"cs\")'"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"limitations-of-pd","dir":"Articles","previous_headings":"","what":"Limitations of PD","title":"PD and ICE curves with ORSF","text":"Partial dependence number known limitations assumptions users aware (see Hooker, 2021). particular, partial dependence less intuitive >2 predictors examined jointly, assumed feature(s) partial dependence computed correlated features (likely true many cases). Accumulated local effect plots can used (see ) case feature independence valid assumption.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"references","dir":"Articles","previous_headings":"","what":"References","title":"PD and ICE curves with ORSF","text":"Giles Hooker, Lucas Mentch, Siyu Zhou. Unrestricted Permutation forces Extrapolation: Variable Importance Requires least One Model, Free Variable Importance. arXiv e-prints 2021 Oct; arXiv-1905. URL: https://doi.org/10.48550/arXiv.1905.03151","code":""},{"path":"https://bcjaeger.github.io/aorsf/authors.html","id":null,"dir":"","previous_headings":"","what":"Authors","title":"Authors and Citation","text":"Byron Jaeger. Author, maintainer. Nicholas Pajewski. Contributor. Sawyer Welden. Contributor. Christopher Jackson. Reviewer. Marvin Wright. Reviewer. Lukas Burk. Reviewer.","code":""},{"path":"https://bcjaeger.github.io/aorsf/authors.html","id":"citation","dir":"","previous_headings":"","what":"Citation","title":"Authors and Citation","text":"Jaeger et al. (2022). aorsf: R package supervised learning using oblique random survival forest. Journal Open Source Software, 7(77), 4705. https://doi.org/10.21105/joss.04705. Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics. 2023 Aug 3:1-6. Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique Random Survival Forests. Annals Applied Statistics. 13(3): 1847-1883. URL https://doi.org/10.1214/19-AOAS1261 DOI: 10.1214/19-AOAS1261","code":"@Article{, title = {aorsf: An R package for supervised learning using the oblique random survival forest}, author = {Byron C. Jaeger and Sawyer Welden and Kristin Lenoir and Nicholas M. Pajewski}, journal = {Journal of Open Source Software}, year = {2022}, volume = {7}, number = {77}, pages = {4705}, url = {https://doi.org/10.21105/joss.04705}, } @Article{, title = {Accelerated and interpretable oblique random survival forests}, author = {Byron C. Jaeger and Sawyer Welden and Kristin Lenoir and Jaime L. Speiser and Matthew W. Segar and Ambarish Pandey and Nicholas M. Pajewski}, journal = {Journal of Computational and Graphical Statistics}, year = {2023}, url = {https://doi.org/10.1080/10618600.2023.2231048}, } @Article{, title = {Oblique Random Survival Forests}, author = {Byron C. Jaeger and D. Leann Long and Dustin M. Long and Mario Sims and Jeff M. Szychowski and Yuan-I Min and Leslie A. Mcclure and George Howard and Noah Simon}, journal = {Annals of Applied Statistics}, year = {2019}, volume = {13}, number = {3}, pages = {1847--1883}, url = {https://doi.org/10.1214/19-AOAS1261}, }"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"aorsf-","dir":"","previous_headings":"","what":"Accelerated Oblique Random Survival Forests","title":"Accelerated Oblique Random Survival Forests","text":"Fit, interpret, make predictions oblique random survival forests (ORSFs).","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"why-aorsf","dir":"","previous_headings":"","what":"Why aorsf?","title":"Accelerated Oblique Random Survival Forests","text":"Hundreds times faster obliqueRSF.1 Accurate predictions censored outcomes.2 Negation importance, novel technique estimate variable importance ORSFs.2 Intuitive API formula based interface. Extensive input checks informative error messages.","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"installation","dir":"","previous_headings":"","what":"Installation","title":"Accelerated Oblique Random Survival Forests","text":"can install aorsf CRAN using can install development version aorsf GitHub :","code":"install.packages(\"aorsf\") # install.packages(\"remotes\") remotes::install_github(\"ropensci/aorsf\")"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"what-is-an-oblique-decision-tree","dir":"","previous_headings":"","what":"What is an oblique decision tree?","title":"Accelerated Oblique Random Survival Forests","text":"Decision trees developed splitting set training data two new subsets, goal similarity within new subsets . splitting process repeated resulting subsets data stopping criterion met. new subsets data formed based single predictor, decision tree said axis-based splits data appear perpendicular axis predictor. linear combinations variables used instead single variable, tree oblique splits data neither parallel right angle axis. Figure: Decision trees classification axis-based splitting (left) oblique splitting (right). Cases orange squares; controls purple circles. trees partition predictor space defined variables X1 X2, oblique splits better job separating two classes.","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"examples","dir":"","previous_headings":"","what":"Examples","title":"Accelerated Oblique Random Survival Forests","text":"orsf() function can fit several types ORSF ensembles. personal favorite accelerated ORSF great combination prediction accuracy computational efficiency (see JCGS paper).2","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5)"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"inspect","dir":"","previous_headings":"Examples","what":"Inspect","title":"Accelerated Oblique Random Survival Forests","text":"Printing output orsf() give information descriptive statistics ensemble. See print.orsf_fit description line printed output. See orsf examples details controlling ORSF ensemble fits using prediction modeling workflows.","code":"fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated #> N observations: 150 #> N events: 52 #> N trees: 500 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 10 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.83 #> OOB stat type: Harrell's C-statistic #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"variable-importance","dir":"","previous_headings":"Examples","what":"Variable importance","title":"Accelerated Oblique Random Survival Forests","text":"importance individual variables can estimated three ways using aorsf: negation2: variable assessed separately multiplying variable’s coefficients -1 determining much model’s performance changes. worse model’s performance negating coefficients given variable, important variable. technique promising b/c require permutation emphasizes variables larger coefficients linear combinations, also relatively new hasn’t studied much permutation importance. See Jaeger, (2023) details technique. permutation: variable assessed separately randomly permuting variable’s values determining much model’s performance changes. worse model’s performance permuting values given variable, important variable. technique flexible, intuitive, frequently used. also several known limitations analysis variance (ANOVA)3: p-value computed coefficient linear combination variables decision tree. Importance individual predictor variable proportion times p-value coefficient < 0.01. technique efficient computationally, may effective permutation negation terms selecting signal noise variables. See Menze, 2011 details technique. can supply R function estimate --bag error using negation permutation importance (see oob vignette)","code":"orsf_vi_negate(fit) #> bili sex copper stage age #> 0.1162463868 0.0517905362 0.0375565841 0.0240450064 0.0239056901 #> ast protime hepato edema ascites #> 0.0191083400 0.0158014897 0.0139536512 0.0119264604 0.0100865906 #> albumin chol spiders trt trig #> 0.0085394443 0.0037903802 0.0030727468 0.0020617896 0.0018361632 #> alk.phos platelet #> 0.0006586211 -0.0044967624 orsf_vi_permute(fit) #> bili copper age stage sex #> 0.0523994364 0.0187964038 0.0152246586 0.0115192591 0.0110127557 #> ast hepato edema ascites albumin #> 0.0100104477 0.0082889176 0.0079183046 0.0077834483 0.0070642325 #> protime trig chol spiders alk.phos #> 0.0066513097 0.0015656325 0.0014474560 0.0006015308 0.0001369292 #> trt platelet #> -0.0013984860 -0.0022427356 orsf_vi_anova(fit) #> bili ascites edema copper stage sex age #> 0.48778004 0.44943820 0.41677872 0.31865585 0.26675095 0.26458616 0.25448430 #> ast hepato albumin chol protime trig spiders #> 0.21743929 0.19945726 0.18191604 0.15240328 0.15076561 0.13709677 0.11833550 #> alk.phos platelet trt #> 0.10113636 0.06302021 0.05019305"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"partial-dependence-pd","dir":"","previous_headings":"Examples","what":"Partial dependence (PD)","title":"Accelerated Oblique Random Survival Forests","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. summary function, orsf_summarize_uni(), computes PD many variables ask , using sensible values. PD, see vignette","code":"orsf_summarize_uni(fit, n_variables = 2) #> #> -- bili (VI Rank: 1) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.70 0.1986719 0.1044026 0.04354701 0.2968290 #> 1.3 0.2132847 0.1210276 0.05245387 0.3208855 #> 3.2 0.2883814 0.1917119 0.11951296 0.4147258 #> #> -- sex (VI Rank: 2) ---------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> m 0.3394141 0.2313787 0.13762339 0.5311308 #> f 0.2390067 0.1112093 0.04782891 0.3773551 #> #> Predicted risk at time t = 1826.25 for top 2 predictors"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"individual-conditional-expectations-ice","dir":"","previous_headings":"Examples","what":"Individual conditional expectations (ICE)","title":"Accelerated Oblique Random Survival Forests","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. ICE, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"comparison-to-existing-software","dir":"","previous_headings":"","what":"Comparison to existing software","title":"Accelerated Oblique Random Survival Forests","text":"Comparisons aorsf existing software presented JCGS paper. paper: describes aorsf detail summary procedures used tree fitting algorithm runs general benchmark comparing aorsf obliqueRSF several learners reports prediction accuracy computational efficiency learners. runs simulation study comparing variable importance techniques ORSFs, axis based RSFs, boosted trees. reports probability variable importance technique rank relevant variable higher importance irrelevant variable. hands-comparison aorsf R packages provided orsf examples","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"references","dir":"","previous_headings":"","what":"References","title":"Accelerated Oblique Random Survival Forests","text":"Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique random survival forests. Annals applied statistics 2019 Sep; 13(3):1847-83. DOI: 10.1214/19-AOAS1261 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"funding","dir":"","previous_headings":"","what":"Funding","title":"Accelerated Oblique Random Survival Forests","text":"developers aorsf receive financial support Center Biomedical Informatics, Wake Forest University School Medicine. also receive support National Center Advancing Translational Sciences National Institutes Health Award Number UL1TR001420. content solely responsibility authors necessarily represent official views National Institutes Health.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/aorsf-package.html","id":null,"dir":"Reference","previous_headings":"","what":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","title":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","text":"Fit, interpret, make predictions oblique random survival forests. Oblique decision trees notoriously slow compared axis based counterparts, 'aorsf' runs fast faster axis-based decision tree algorithms right-censored time--event outcomes. Methods accelerate interpret oblique random survival forest described Jaeger et al., (2023) doi:10.1080/10618600.2023.2231048 .","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/aorsf-package.html","id":"author","dir":"Reference","previous_headings":"","what":"Author","title":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","text":"Maintainer: Byron Jaeger bjaeger@wakehealth.edu (ORCID) contributors: Nicholas Pajewski [contributor] Sawyer Welden swelden@wakehealth.edu [contributor] Christopher Jackson chris.jackson@mrc-bsu.cam.ac.uk [reviewer] Marvin Wright [reviewer] Lukas Burk [reviewer]","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"Coerce to data.table — as.data.table.orsf_summary_uni","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"Convert 'orsf_summary' object data.table object.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"","code":"# S3 method for orsf_summary_uni as.data.table(x, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"x object class 'orsf_summary_uni' ... used","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"data.table","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"","code":"library(data.table) object <- orsf(pbc_orsf, Surv(time, status) ~ . - id) smry <- orsf_summarize_uni(object, n_variables = 3) as.data.table(smry) #> variable importance value mean medn lwr upr #> 1: ascites 0.4910000 0 0.6910482 0.8020607 0.4793900 0.9356229 #> 2: ascites 0.4910000 1 0.5367928 0.6004745 0.3455624 0.7427543 #> 3: bili 0.3959368 0.80 0.7671193 0.8562470 0.6435096 0.9406650 #> 4: bili 0.3959368 1.40 0.7436993 0.8225277 0.6068565 0.9251464 #> 5: bili 0.3959368 3.52 0.6198406 0.6856069 0.4653703 0.8110744 #> 6: edema 0.3203407 0 0.6959783 0.8068156 0.4839991 0.9392233 #> 7: edema 0.3203407 0.5 0.5898021 0.6275451 0.3877274 0.7929652 #> 8: edema 0.3203407 1 0.5871225 0.6309284 0.3741667 0.8145640 #> pred_horizon level #> 1: 1788 0 #> 2: 1788 1 #> 3: 1788 #> 4: 1788 #> 5: 1788 #> 6: 1788 0 #> 7: 1788 0.5 #> 8: 1788 1"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Oblique Random Survival Forest (ORSF) — orsf","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Fit oblique random survival forest","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"","code":"orsf( data, formula, control = NULL, weights = NULL, n_tree = 500, n_split = 5, n_retry = 3, n_thread = 1, mtry = NULL, sample_with_replacement = TRUE, sample_fraction = 0.632, leaf_min_events = 1, leaf_min_obs = 5, split_rule = NULL, split_min_events = 5, split_min_obs = 10, split_min_stat = NULL, oobag_pred_type = NULL, oobag_pred_horizon = NULL, oobag_eval_every = n_tree, oobag_fun = NULL, importance = \"anova\", importance_max_pvalue = 0.01, group_factors = TRUE, tree_seeds = NULL, attach_data = TRUE, no_fit = FALSE, na_action = \"fail\", verbose_progress = FALSE, ... ) orsf_train(object, attach_data = TRUE)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"data data.frame, tibble, data.table contains relevant variables. formula (formula) response left hand side include time variable, followed status variable, may written inside call Surv (see examples). terms right names predictor variables. control (orsf_control) object returned one orsf_control functions: orsf_control_fast (default) uses single iteration Newton Raphson scoring identify linear combination predictors. orsf_control_cph uses Newton Raphson scoring convergence criteria met. orsf_control_net uses glmnet identify linear combinations predictors, similar Jaeger (2019). orsf_control_custom allows user apply function create linear combinations predictors. weights (numeric vector) Optional. given, input length equal nrow(data). Values weights treated like replication weights, .e., value 2 thing 2 observations data, containing copy corresponding person's data. Use weights cautiously, orsf count number observations events prior growing node tree, higher values weights lead deeper trees. n_tree (integer) number trees grow. Default n_tree = 500. n_split (integer) number cut-points assessed splitting node decision trees. Default n_split = 5. n_retry (integer) node can split, current linear combination inputs unable provide valid split, orsf try new linear combination based different set randomly selected predictors, n_retry times. Default n_retry = 3. Set n_retry = 0 prevent retries. n_thread (integer) number threads use growing trees, computing predictions, computing importance. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. mtry (integer) Number predictors randomly included candidates splitting node. default smallest integer greater square root number total predictors, .e., mtry = ceiling(sqrt(number predictors)) sample_with_replacement (logical) TRUE (default), observations sampled replacement -bag sample created decision tree. FALSE, observations sampled without replacement tree -bag sample containing sample_fraction% original sample. sample_fraction (double) proportion observations trees' -bag sample contain, relative number rows data. used sample_with_replacement FALSE. Default value 0.632. leaf_min_events (integer) minimum number events leaf node. Default leaf_min_events = 1 leaf_min_obs (integer) minimum number observations leaf node. Default leaf_min_obs = 5. split_rule (character) assess quality potential splitting rule node. Valid options 'logrank' : log-rank test statistic. 'cstat' : Harrell's concordance statistic. split_min_events (integer) minimum number events required node consider splitting . Default split_min_events = 5 split_min_obs (integer) minimum number observations required node consider splitting . Default split_min_obs = 10. split_min_stat (double) minimum test statistic required split node. Default 3.841459 split_rule = 'logrank' 0.50 split_rule = 'cstat'. splits found statistic exceeding split_min_stat, given node either becomes leaf retry occurs (n_retry retries). oobag_pred_type (character) type --bag predictions compute fitting ensemble. Valid options 'none' : compute --bag predictions 'risk' : probability event occurring oobag_pred_horizon. 'surv' : 1 - risk. 'chf' : cumulative hazard function oobag_pred_horizon. 'mort' : mortality, .e., number events expected observations training data identical given observation. oobag_pred_horizon (numeric) numeric value indicating time used --bag predictions. Default median observed times, .e., oobag_pred_horizon = median(time). oobag_eval_every (integer) --bag performance ensemble checked every oobag_eval_every trees. , oobag_eval_every = 10, --bag performance checked growing 10th tree, 20th tree, . Default oobag_eval_every = n_tree. oobag_fun (function) used evaluating --bag prediction accuracy every oobag_eval_every trees. oobag_fun = NULL (default), Harrell's C-statistic (1982) used evaluate accuracy. use oobag_fun note following: oobag_fun two inputs: y_mat s_vec y_mat two column matrix first column named 'time', second named 'status' s_vec numeric vector containing predicted survival probabilities. oobag_fun return numeric output length 1 details, see --bag vignette. importance (character) Indicate method variable importance: 'none': variable importance computed. 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance details methods, see orsf_vi. importance_max_pvalue (double) relevant importance \"anova\". maximum p-value register positive case counting number times variable found 'significant' tree growth. Default 0.01, recommended Menze et al. group_factors (logical) relevant variable importance estimated. TRUE, importance factor variables reported overall aggregating importance individual levels factor. FALSE, importance individual factor levels returned. tree_seeds (integer vector) Optional. specified, random seeds set using values tree_seeds[] growing tree . Two forests grown number trees seeds exact --bag samples, making --bag error estimates forests comparable. NULL (default), seeds set training process. attach_data (logical) TRUE, copy training data attached output. helpful plan using functions like orsf_pd_oob orsf_summarize_uni interpret forest using training data. Default TRUE. no_fit (logical) TRUE, model fitting steps defined saved, training initiated. object returned can directly submitted orsf_train() long attach_data TRUE. na_action (character) happen data contains missing values (.e., NA values). Valid options : 'fail' : error thrown data contains NA values 'omit' : rows data incomplete data dropped 'impute_meanmode' : missing values continuous categorical variables data imputed using mean mode, respectively. Note option selected attach_data TRUE, data attached output imputed version data. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. ... arguments passed methods (currently used). object untrained 'aorsf' object, created setting no_fit = TRUE orsf().","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"accelerated oblique RSF object (aorsf)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"function based similar ORSF function obliqueRSF R package. primary difference function runs much faster. speed increase attributable better management memory (.e., unnecessary copies inputs) using Newton Raphson scoring algorithm identify linear combinations inputs rather performing penalized regression using routines glmnet.modified Newton Raphson scoring algorithm function applies adaptation C++ routine developed Terry M. Therneau fits Cox proportional hazards models (see survival::coxph() specifically survival::coxph.fit()).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"details-on-inputs","dir":"Reference","previous_headings":"","what":"Details on inputs","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"formula: response formula can survival object returned Surv function, can also just time status variables. .e., Surv(time, status) ~ . works just like time + status ~ . . symbol right hand side short-hand using variables data (omitting left hand side formula) predictors. order variables left hand side matters. .e., writing status + time ~ . make orsf assume status variable actually time variable. response variable can survival object stored data. example, y ~ . valid formula data$y inherits Surv class. Although can fit oblique random survival forest 1 predictor variable, formula least 2 predictors. reason recommendation linear combination predictors trivial one predictor. mtry: mtry parameter may temporarily reduced ensure least 2 events per predictor variable. occurs using orsf_control_cph coefficients Newton Raphson scoring algorithm may become unstable number covariates greater equal number events. reduction occur using orsf_control_net. oobag_fun: oobag_fun specified, used compute negation importance permutation importance, role ANOVA importance. n_thread: R function must called C++ (.e., user-supplied function compute --bag error identify linear combinations variables), n_thread automatically set 1 attempting run R functions multiple threads cause R session crash.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"what-is-an-oblique-decision-tree-","dir":"Reference","previous_headings":"","what":"What is an oblique decision tree?","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Decision trees developed splitting set training data two new subsets, goal similarity within new subsets . splitting process repeated resulting subsets data stopping criterion met. new subsets data formed based single predictor, decision tree said axis-based splits data appear perpendicular axis predictor. linear combinations variables used instead single variable, tree oblique splits data neither parallel right angle axis Figure : Decision trees classification axis-based splitting (left) oblique splitting (right). Cases orange squares; controls purple circles. trees partition predictor space defined variables X1 X2, oblique splits better job separating two classes.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"what-is-a-random-forest-","dir":"Reference","previous_headings":"","what":"What is a random forest?","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Random forests collections de-correlated decision trees. Predictions tree aggregated make ensemble prediction forest. details, see Breiman el, 2001.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"training-out-of-bag-error-and-testing","dir":"Reference","previous_headings":"","what":"Training, out-of-bag error, and testing","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"random forests, tree grown bootstrapped version training set. bootstrap samples selected replacement, bootstrapped training set contains two-thirds instances original training set. '--bag' data instances bootstrapped training set. tree random forest can make predictions --bag data, --bag predictions can aggregated make ensemble --bag prediction. Since --bag data used grow tree, accuracy ensemble --bag predictions approximate generalization error random forest. Generalization error refers error random forest's predictions applied predict outcomes data used train , .e., testing data.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"missing-data","dir":"Reference","previous_headings":"","what":"Missing data","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Data passed aorsf functions allowed missing values. user impute missing values using R package purpose, recipes mlr3pipelines.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"First load relevant packages entry-point aorsf standard call orsf(): printing fit provides quick descriptive summaries:","code":"set.seed(329730) suppressPackageStartupMessages({ library(aorsf) library(survival) library(tidymodels) library(tidyverse) library(randomForestSRC) library(ranger) library(riskRegression) library(obliqueRSF) }) fit <- orsf(pbc_orsf, Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 20.98 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"model-control","dir":"Reference","previous_headings":"","what":"Model control","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"examples make use orsf_control_ functions build compare models based --bag predictions. also standardize --bag samples using input argument tree_seeds","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"accelerated-linear-combinations","dir":"Reference","previous_headings":"","what":"Accelerated linear combinations","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"accelerated ORSF ensemble default nice balance computational speed prediction accuracy. runs single iteration Newton Raphson scoring Cox partial likelihood function find linear combinations predictors.","code":"fit_accel <- orsf(pbc_orsf, control = orsf_control_survival(), formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-cox-regression","dir":"Reference","previous_headings":"","what":"Linear combinations with Cox regression","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"orsf_control_cph runs Cox regression non-terminal node survival tree, using regression coefficients create linear combinations predictors:","code":"control_cph <- orsf_control_survival(method = 'glm', scale_x = TRUE, max_iter = 20) fit_cph <- orsf(pbc_orsf, control = control_cph, formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-penalized-cox-regression","dir":"Reference","previous_headings":"","what":"Linear combinations with penalized cox regression","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"orsf_control_net runs penalized Cox regression non-terminal node survival tree, using regression coefficients create linear combinations predictors. can really helpful want feature selection within node, lot slower options.","code":"# select 3 predictors out of 5 to be used in # each linear combination of predictors. control_net <- orsf_control_survival(method = 'net', target_df = 3) fit_net <- orsf(pbc_orsf, control = control_net, formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-your-own-function","dir":"Reference","previous_headings":"","what":"Linear combinations with your own function","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Let’s make three customized functions identify linear combinations predictors. first uses random coefficients second derives coefficients principal component analysis. third uses orsf() inside orsf(). can plug functions orsf_control_custom(), pass result orsf(): fit seems work best example? Let’s find evaluating --bag survival predictions. AUC values, highest lowest: indices prediction accuracy: inspection, net, accel, rlt high discrimination index prediction accuracy. rando pca less well, aren’t bad.","code":"f_rando <- function(x_node, y_node, w_node){ matrix(runif(ncol(x_node)), ncol=1) } f_pca <- function(x_node, y_node, w_node) { # estimate two principal components. pca <- stats::prcomp(x_node, rank. = 2) # use the second principal component to split the node pca$rotation[, 1L, drop = FALSE] } # This approach is known as reinforcement learning trees. # some special care is taken to prevent your R session from crashing. # Specifically, random coefficients are used when n_obs <= 10 # or n_events <= 5. f_aorsf <- function(x_node, y_node, w_node){ colnames(y_node) <- c('time', 'status') colnames(x_node) <- paste(\"x\", seq(ncol(x_node)), sep = '') data <- as.data.frame(cbind(y_node, x_node)) if(nrow(data) <= 10 || sum(y_node[,'status']) <= 5) return(matrix(runif(ncol(x_node)), ncol = 1)) fit <- orsf(data, time + status ~ ., weights = as.numeric(w_node), n_tree = 25, importance = 'permute') out <- orsf_vi(fit) # drop the least two important variables n_vars <- length(out) out[c(n_vars, n_vars-1)] <- 0 # ensure out has same variable order as input out <- out[colnames(x_node)] matrix(out, ncol = 1) } fit_rando <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_rando), tree_seeds = 329) fit_pca <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_pca), tree_seeds = 329) fit_rlt <- orsf(pbc_orsf, time + status ~ . - id, control = orsf_control_survival(method = f_aorsf), tree_seeds = 329) risk_preds <- list( accel = 1 - fit_accel$pred_oobag, cph = 1 - fit_cph$pred_oobag, net = 1 - fit_net$pred_oobag, rando = 1 - fit_rando$pred_oobag, pca = 1 - fit_pca$pred_oobag, rlt = 1 - fit_rlt$pred_oobag ) sc <- Score(object = risk_preds, formula = Surv(time, status) ~ 1, data = pbc_orsf, summary = 'IPA', times = fit_accel$pred_horizon) sc$AUC$score[order(-AUC)] ## model times AUC se lower upper ## 1: net 1788 0.9134593 0.02079935 0.8726933 0.9542253 ## 2: rlt 1788 0.9129537 0.01979016 0.8741657 0.9517417 ## 3: accel 1788 0.9112315 0.02098077 0.8701099 0.9523530 ## 4: cph 1788 0.9063871 0.02165434 0.8639453 0.9488288 ## 5: rando 1788 0.9023489 0.02218936 0.8588586 0.9458393 ## 6: pca 1788 0.8994220 0.02201713 0.8562692 0.9425748 sc$Brier$score[order(-IPA), .(model, times, IPA)] ## model times IPA ## 1: net 1788 0.4916038 ## 2: accel 1788 0.4879683 ## 3: cph 1788 0.4751883 ## 4: rlt 1788 0.4640282 ## 5: pca 1788 0.4370592 ## 6: rando 1788 0.4258344 ## 7: Null model 1788 0.0000000"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"tidymodels","dir":"Reference","previous_headings":"","what":"tidymodels","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"example uses tidymodels functions stops short using official tidymodels workflow. working getting aorsf pulled censored package update real workflows happens!","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"comparing-orsf-with-other-learners","dir":"Reference","previous_headings":"","what":"Comparing ORSF with other learners","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Start recipe pre-process data Next create 10-fold cross validation object pre-process data: Define functions ‘workflow’ randomForestSRC, ranger, aorsf. Run ‘workflows’ fold: Next unnest column get back tibble testing data predictions. finish aggregating predictions computing performance testing data. Note computing one statistic predictions instead computing one statistic fold. approach fine smaller testing sets /small event counts. inspection, aorsf obtained slightly higher discrimination (AUC) aorsf obtained higher index prediction accuracy (IPA)","code":"imputer <- recipe(pbc_orsf, formula = time + status ~ .) %>% step_rm(id) %>% step_impute_mean(all_numeric_predictors()) %>% step_impute_mode(all_nominal_predictors()) # 10-fold cross validation; make a container for the pre-processed data analyses <- vfold_cv(data = pbc_orsf, v = 10) %>% mutate(recipe = map(splits, ~prep(imputer, training = training(.x))), train = map(recipe, juice), test = map2(splits, recipe, ~bake(.y, new_data = testing(.x)))) analyses ## # 10-fold cross-validation ## # A tibble: 10 x 5 ## splits id recipe train test ## ## 1 Fold01 ## 2 Fold02 ## 3 Fold03 ## 4 Fold04 ## 5 Fold05 ## 6 Fold06 ## 7 Fold07 ## 8 Fold08 ## 9 Fold09 ## 10 Fold10 rfsrc_wf <- function(train, test, pred_horizon){ # rfsrc does not like tibbles, so cast input data into data.frames train <- as.data.frame(train) test <- as.data.frame(test) rfsrc(formula = Surv(time, status) ~ ., data = train) %>% predictRisk(newdata = test, times = pred_horizon) %>% as.numeric() } ranger_wf <- function(train, test, pred_horizon){ ranger(Surv(time, status) ~ ., data = train) %>% predictRisk(newdata = test, times = pred_horizon) %>% as.numeric() } aorsf_wf <- function(train, test, pred_horizon){ train %>% orsf(Surv(time, status) ~ .,) %>% predict(new_data = test, pred_type = 'risk', pred_horizon = pred_horizon) %>% as.numeric() } # 5 year risk prediction ph <- 365.25 * 5 results <- analyses %>% transmute(test, pred_aorsf = map2(train, test, aorsf_wf, pred_horizon = ph), pred_rfsrc = map2(train, test, rfsrc_wf, pred_horizon = ph), pred_ranger = map2(train, test, ranger_wf, pred_horizon = ph)) results <- results %>% unnest(everything()) glimpse(results) ## Rows: 276 ## Columns: 23 ## $ id 1, 8, 15, 17, 23, 35, 56, 68, 92, 94, 97, 109, 116, 130, 1~ ## $ trt d_penicill_main, placebo, d_penicill_main, placebo, placeb~ ## $ age 58.76523, 53.05681, 64.64613, 52.18344, 55.96715, 48.61875~ ## $ sex f, f, f, f, f, f, f, f, f, f, m, f, f, f, f, f, f, f, f, f~ ## $ ascites 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0~ ## $ hepato 1, 0, 0, 1, 1, 0, 1, 0, 0, 1, 1, 0, 0, 1, 0, 0, 1, 0, 1, 0~ ## $ spiders 1, 0, 0, 0, 1, 0, 1, 0, 0, 1, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0~ ## $ edema 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0.5, 0, 0.5, 0, 0, 0, 0.5, 0~ ## $ bili 14.5, 0.3, 0.8, 2.7, 17.4, 1.2, 1.1, 0.7, 1.4, 3.2, 2.0, 0~ ## $ chol 261, 280, 231, 274, 395, 314, 498, 174, 206, 201, 420, 120~ ## $ albumin 2.60, 4.00, 3.87, 3.15, 2.94, 3.20, 3.80, 4.09, 3.13, 3.11~ ## $ copper 156, 52, 173, 159, 558, 201, 88, 58, 36, 178, 62, 53, 74, ~ ## $ alk.phos 1718.0, 4651.2, 9009.8, 1533.0, 6064.8, 12258.8, 13862.4, ~ ## $ ast 137.95, 28.38, 127.71, 117.80, 227.04, 72.24, 95.46, 71.30~ ## $ trig 172, 189, 96, 128, 191, 151, 319, 46, 70, 69, 91, 52, 382,~ ## $ platelet 190, 373, 295, 224, 214, 431, 365, 203, 145, 188, 344, 271~ ## $ protime 12.2, 11.0, 11.0, 10.5, 11.7, 10.6, 10.6, 10.6, 12.2, 11.8~ ## $ stage 4, 3, 3, 4, 4, 3, 2, 3, 4, 4, 3, 3, 3, 3, 2, 2, 3, 2, 3, 2~ ## $ time 400, 2466, 3584, 769, 264, 2847, 1847, 4039, 388, 750, 611~ ## $ status 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 0, 0, 1, 0, 0, 1, 0, 1, 0~ ## $ pred_aorsf 0.95858574, 0.05070837, 0.22924369, 0.47048899, 0.94442624~ ## $ pred_rfsrc 0.85474291, 0.05480510, 0.31751746, 0.45156052, 0.85784657~ ## $ pred_ranger 0.77897322, 0.04599438, 0.30267242, 0.43467381, 0.77914735~ Score( object = list(aorsf = results$pred_aorsf, rfsrc = results$pred_rfsrc, ranger = results$pred_ranger), formula = Surv(time, status) ~ 1, data = results, summary = 'IPA', times = ph ) ## ## Metric AUC: ## ## Results by model: ## ## model times AUC lower upper ## 1: aorsf 1826 90.7 86.4 95.0 ## 2: rfsrc 1826 89.9 85.6 94.2 ## 3: ranger 1826 89.7 85.5 94.0 ## ## Results of model comparisons: ## ## times model reference delta.AUC lower upper p ## 1: 1826 rfsrc aorsf -0.8 -2.2 0.5 0.2 ## 2: 1826 ranger aorsf -1.0 -2.5 0.5 0.2 ## 3: 1826 ranger rfsrc -0.1 -1.3 1.0 0.8 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The higher AUC the better. ## ## Metric Brier: ## ## Results by model: ## ## model times Brier lower upper IPA ## 1: Null model 1826.25 20.5 18.1 22.9 0.0 ## 2: aorsf 1826.25 10.8 8.6 13.0 47.3 ## 3: rfsrc 1826.25 11.8 9.7 13.9 42.5 ## 4: ranger 1826.25 11.9 9.8 14.0 41.9 ## ## Results of model comparisons: ## ## times model reference delta.Brier lower upper p ## 1: 1826.25 aorsf Null model -9.7 -12.3 -7.1 2.179169e-13 ## 2: 1826.25 rfsrc Null model -8.7 -11.0 -6.4 3.915661e-14 ## 3: 1826.25 ranger Null model -8.6 -10.9 -6.2 8.869452e-13 ## 4: 1826.25 rfsrc aorsf 1.0 0.3 1.7 5.383491e-03 ## 5: 1826.25 ranger aorsf 1.1 0.5 1.7 7.890574e-04 ## 6: 1826.25 ranger rfsrc 0.1 -0.4 0.6 6.310608e-01 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The lower Brier the better, the higher IPA the better."},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"mlr-pipelines","dir":"Reference","previous_headings":"","what":"mlr3 pipelines","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Warning: code may may run depending current version mlr3proba. First load additional mlr3 libraries. Next ’ll define tasks learners engage . Now can make benchmark designed compare three favorite learners: Let’s look overall results: inspection, aorsf higher expected value ‘surv.cindex’ (higher better) aorsf lower expected value ‘surv.graf’ (lower better)","code":"suppressPackageStartupMessages({ library(mlr3verse) library(mlr3proba) library(mlr3extralearners) library(mlr3viz) library(mlr3benchmark) }) # Mayo Clinic Primary Biliary Cholangitis Data task_pbc <- TaskSurv$new( id = 'pbc', backend = select(pbc_orsf, -id) %>% mutate(stage = as.numeric(stage)), time = \"time\", event = \"status\" ) # Veteran's Administration Lung Cancer Trial data(veteran, package = \"randomForestSRC\") task_veteran <- TaskSurv$new( id = 'veteran', backend = veteran, time = \"time\", event = \"status\" ) # NKI 70 gene signature data_nki <- OpenML::getOMLDataSet(data.id = 1228) task_nki <- TaskSurv$new( id = 'nki', backend = data_nki$data, time = \"time\", event = \"event\" ) # Gene Expression-Based Survival Prediction in Lung Adenocarcinoma data_lung <- OpenML::getOMLDataSet(data.id = 1245) task_lung <- TaskSurv$new( id = 'nki', backend = data_lung$data %>% mutate(OS_event = as.numeric(OS_event) -1), time = \"OS_years\", event = \"OS_event\" ) # Chemotherapy for Stage B/C colon cancer # (there are two rows per person, one for death # and the other for recurrence, hence the two tasks) task_colon_death <- TaskSurv$new( id = 'colon_death', backend = survival::colon %>% filter(etype == 2) %>% drop_na() %>% # drop id, redundant variables select(-id, -study, -node4, -etype), mutate(OS_event = as.numeric(OS_event) -1), time = \"time\", event = \"status\" ) task_colon_recur <- TaskSurv$new( id = 'colon_death', backend = survival::colon %>% filter(etype == 1) %>% drop_na() %>% # drop id, redundant variables select(-id, -study, -node4, -etype), mutate(OS_event = as.numeric(OS_event) -1), time = \"time\", event = \"status\" ) # putting them all together tasks <- list(task_pbc, task_veteran, task_nki, task_lung, task_colon_death, task_colon_recur, # add a few more pre-made ones tsk(\"actg\"), tsk('gbcs'), tsk('grace'), tsk(\"unemployment\"), tsk(\"whas\")) # Learners with default parameters learners <- lrns(c(\"surv.ranger\", \"surv.rfsrc\", \"surv.aorsf\")) # Brier (Graf) score, c-index and training time as measures measures <- msrs(c(\"surv.graf\", \"surv.cindex\", \"time_train\")) # Benchmark with 5-fold CV design <- benchmark_grid( tasks = tasks, learners = learners, resamplings = rsmps(\"cv\", folds = 5) ) benchmark_result <- benchmark(design) bm_scores <- benchmark_result$score(measures, predict_sets = \"test\") bm_scores %>% select(task_id, learner_id, surv.graf, surv.cindex, time_train) %>% group_by(learner_id) %>% filter(!is.infinite(surv.graf)) %>% summarize( across( .cols = c(surv.graf, surv.cindex, time_train), .fns = ~mean(.x, na.rm = TRUE) ) ) ## # A tibble: 3 x 4 ## learner_id surv.graf surv.cindex time_train ## ## 1 surv.aorsf 0.150 0.734 0.383 ## 2 surv.ranger 0.164 0.716 2.04 ## 3 surv.rfsrc 0.155 0.724 0.757"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating Yield Medical Tests. JAMA 1982; 247(18):2543-2546. DOI: 10.1001/jama.1982.03320430047030 Breiman L. Random forests. Machine learning 2001 Oct; 45(1):5-32. DOI: 10.1023/:1010933404324 Ishwaran H, Kogalur UB, Blackstone EH, Lauer MS. Random survival forests. Annals applied statistics 2008 Sep; 2(3):841-60. DOI: 10.1214/08-AOAS169 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29 Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique random survival forests. Annals applied statistics 2019 Sep; 13(3):1847-83. DOI: 10.1214/19-AOAS1261 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":null,"dir":"Reference","previous_headings":"","what":"Oblique random forest control — orsf_control","title":"Oblique random forest control — orsf_control","text":"Oblique random forest control","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Oblique random forest control — orsf_control","text":"","code":"orsf_control( tree_type, method, scale_x, ties, net_mix, target_df, max_iter, epsilon, ... ) orsf_control_classification( method = \"glm\", scale_x = TRUE, net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... ) orsf_control_regression( method = \"glm\", scale_x = TRUE, net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... ) orsf_control_survival( method = \"glm\", scale_x = TRUE, ties = \"efron\", net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Oblique random forest control — orsf_control","text":"tree_type (character) type tree. Valid options \"classification\", .e., categorical outcomes \"regression\", .e., continuous outcomes \"survival\", .e., time-event outcomes method (character function) identify linear linear combinations predictors. method character value, must one : 'glm': linear, logistic, cox regression 'net': 'glm' penalty terms 'pca': principal component analysis 'random': random draw uniform distribution method function, used identify linear combinations predictor variables. method must case accept three inputs named x_node, y_node w_node, expect following types dimensions: x_node (matrix; n rows, p columns) y_node (matrix; n rows, 2 columns) w_node (matrix; n rows, 1 column) addition, method must return matrix p rows 1 column. scale_x (logical) TRUE, values predictors scaled prior instance finding linear combination predictors, using summary values data current node decision tree. ties (character) character string specifying method tie handling. relevant modeling survival outcomes using method engages tied outcome times. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. net_mix (double) elastic net mixing parameter. value 1 gives lasso penalty, value 0 gives ridge penalty. multiple values alpha given, penalized model fit using alpha value prior splitting node. target_df (integer) Preferred number variables used linear combination. example, mtry 5 target_df 3, sample 5 predictors look best linear combination using 3 . max_iter (integer) iteration continues convergence (see eps ) number attempted iterations equal iter_max. epsilon (double) using modeling based method, iteration continues algorithm relative change kind objective less epsilon, absolute change less sqrt(epsilon). ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Oblique random forest control — orsf_control","text":"object class 'orsf_control', used input control argument orsf. Components : tree_type: type trees fit lincomb_type: method linear combinations lincomb_eps: epsilon convergence lincomb_iter_max: max iterations lincomb_scale: scale . lincomb_alpha: mixing parameter lincomb_df_target: target degrees freedom lincomb_ties_method: method ties survival time lincomb_R_function: R function custom splits","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Oblique random forest control — orsf_control","text":"Adjust scale_x risk. Setting scale_x = FALSE reduce computation time also make orsf model dependent scale data, default value TRUE.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":null,"dir":"Reference","previous_headings":"","what":"Cox regression ORSF control — orsf_control_cph","title":"Cox regression ORSF control — orsf_control_cph","text":"Use coefficients proportional hazards model create linear combinations predictor variables fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Cox regression ORSF control — orsf_control_cph","text":"","code":"orsf_control_cph(method = \"efron\", eps = 1e-09, iter_max = 20, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Cox regression ORSF control — orsf_control_cph","text":"method (character) character string specifying method tie handling. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. eps (double) using Newton Raphson scoring identify linear combinations inputs, iteration continues algorithm relative change log partial likelihood less eps, absolute change less sqrt(eps). Must positive. default value 1e-09 used consistency survival::coxph.control. iter_max (integer) iteration continues convergence (see eps ) number attempted iterations equal iter_max. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Cox regression ORSF control — orsf_control_cph","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Cox regression ORSF control — orsf_control_cph","text":"code survival package modified make routine. details Cox proportional hazards model, see coxph /Therneau Grambsch (2000).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Cox regression ORSF control — orsf_control_cph","text":"Therneau T.M., Grambsch P.M. (2000) Cox Model. : Modeling Survival Data: Extending Cox Model. Statistics Biology Health. Springer, New York, NY. DOI: 10.1007/978-1-4757-3294-8_3","code":""},{"path":[]},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Custom ORSF control — orsf_control_custom","text":"","code":"orsf_control_custom(beta_fun, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Custom ORSF control — orsf_control_custom","text":"beta_fun (function) function define coefficients used linear combinations predictor variables. beta_fun must accept three inputs named x_node, y_node w_node, expect following types dimensions: x_node (matrix; n rows, p columns) y_node (matrix; n rows, 2 columns) w_node (matrix; n rows, 1 column) addition, beta_fun must return matrix p rows 1 column. conditions met, orsf_control_custom() let know. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Custom ORSF control — orsf_control_custom","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Custom ORSF control — orsf_control_custom","text":"Two customized functions identify linear combinations predictors shown . first uses random coefficients second derives coefficients principal component analysis.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"random-coefficients","dir":"Reference","previous_headings":"","what":"Random coefficients","title":"Custom ORSF control — orsf_control_custom","text":"f_rando() function get random coefficients: can plug f_rando orsf_control_survival(), pass result orsf():","code":"f_rando <- function(x_node, y_node, w_node){ matrix(runif(ncol(x_node)), ncol=1) } library(aorsf) fit_rando <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_rando), n_tree = 500) fit_rando ## ---------- Oblique random survival forest ## ## Linear combinations: Custom user function ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 19.76 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"principal-components","dir":"Reference","previous_headings":"","what":"Principal components","title":"Custom ORSF control — orsf_control_custom","text":"Follow steps , starting custom function: plug function orsf_control_survival() pass result orsf():","code":"f_pca <- function(x_node, y_node, w_node) { # estimate two principal components. pca <- stats::prcomp(x_node, rank. = 2) # use the second principal component to split the node pca$rotation[, 2L, drop = FALSE] } fit_pca <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_pca), n_tree = 500)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"evaluate","dir":"Reference","previous_headings":"","what":"Evaluate","title":"Custom ORSF control — orsf_control_custom","text":"well two customized ORSFs ? Let’s compute indices prediction accuracy based --bag predictions: PCA ORSF quite well! (higher IPA better)","code":"library(riskRegression) ## riskRegression version 2023.09.08 library(survival) risk_preds <- list(rando = 1 - fit_rando$pred_oobag, pca = 1 - fit_pca$pred_oobag) sc <- Score(object = risk_preds, formula = Surv(time, status) ~ 1, data = pbc_orsf, summary = 'IPA', times = fit_pca$pred_horizon) sc$Brier ## ## Results by model: ## ## model times Brier lower upper IPA ## 1: Null model 1788 20.479 18.090 22.868 0.000 ## 2: rando 1788 11.808 9.729 13.888 42.339 ## 3: pca 1788 12.861 10.833 14.889 37.199 ## ## Results of model comparisons: ## ## times model reference delta.Brier lower upper p ## 1: 1788 rando Null model -8.671 -10.813 -6.528 2.142609e-15 ## 2: 1788 pca Null model -7.618 -9.379 -5.857 2.300807e-17 ## 3: 1788 pca rando 1.053 0.241 1.865 1.106784e-02 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The lower Brier the better, the higher IPA the better."},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":null,"dir":"Reference","previous_headings":"","what":"Accelerated ORSF control — orsf_control_fast","title":"Accelerated ORSF control — orsf_control_fast","text":"Fast methods identify linear combinations predictors fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Accelerated ORSF control — orsf_control_fast","text":"","code":"orsf_control_fast(method = \"efron\", do_scale = TRUE, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Accelerated ORSF control — orsf_control_fast","text":"method (character) character string specifying method tie handling. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. do_scale (logical) TRUE, values predictors scaled prior instance Newton Raphson scoring, using summary values data current node decision tree. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Accelerated ORSF control — orsf_control_fast","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Accelerated ORSF control — orsf_control_fast","text":"code survival package modified make routine. Adjust do_scale risk. Setting do_scale = FALSE reduce computation time also make orsf model dependent scale data, default value TRUE.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":null,"dir":"Reference","previous_headings":"","what":"Penalized Cox regression ORSF control — orsf_control_net","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"Use regularized Cox proportional hazard models identify linear combinations input variables fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"","code":"orsf_control_net(alpha = 1/2, df_target = NULL, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"alpha (double) elastic net mixing parameter. value 1 gives lasso penalty, value 0 gives ridge penalty. multiple values alpha given, penalized model fit using alpha value prior splitting node. df_target (integer) Preferred number variables used linear combination. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"df_target less mtry, separate argument orsf indicates number variables chosen random prior finding linear combination variables.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"Simon N, Friedman J, Hastie T, Tibshirani R. Regularization paths Cox's proportional hazards model via coordinate descent. Journal statistical software 2011 Mar; 39(5):1. DOI: 10.18637/jss.v039.i05","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF Individual Conditional Expectations — orsf_ice_oob","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"Compute individual conditional expectations ORSF model. Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. can compute individual conditional expectations three ways using random forest: using -bag predictions training data using --bag predictions training data using predictions new set data See examples details","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"","code":"orsf_ice_oob( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... ) orsf_ice_inb( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... ) orsf_ice_new( object, pred_spec, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"object (orsf_fit) trained oblique random survival forest (see orsf). pred_spec (named list data.frame). pred_spec named list, item list vector values used points partial dependence function. name item list indicate variable modified take corresponding values. pred_spec data.frame, columns indicate variable names, values indicate variable values, partial dependence computed using inputs row. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction expand_grid (logical) TRUE, partial dependence computed possible combinations inputs pred_spec. FALSE, partial dependence computed variable pred_spec, separately. boundary_checks (logical) TRUE, pred_spec checked make sure requested values 10th 90th percentile object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. ... arguments passed methods (currently used). new_data data.frame, tibble, data.table compute predictions . na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'omit' : rows new_data incomplete data dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"data.table containing individual conditional expectations specified variable(s) specified prediction horizon(s).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"Begin fitting ORSF ensemble Use ensemble compute ICE values using --bag predictions: Much detailed examples given vignette","code":"library(aorsf) set.seed(329) fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 21.026 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## ----------------------------------------- pred_spec <- list(bili = seq(1, 10, length.out = 25)) ice_oob <- orsf_ice_oob(fit, pred_spec, boundary_checks = FALSE) ice_oob ## id_variable id_row pred_horizon bili pred ## 1: 1 1 1788 1 0.1264442 ## 2: 1 2 1788 1 0.1739727 ## 3: 1 3 1788 1 0.3904517 ## 4: 1 4 1788 1 0.2874752 ## 5: 1 5 1788 1 0.4398522 ## --- ## 6896: 25 272 1788 10 0.3076971 ## 6897: 25 273 1788 10 0.4942110 ## 6898: 25 274 1788 10 0.6407498 ## 6899: 25 275 1788 10 0.3871298 ## 6900: 25 276 1788 10 0.6479179"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF partial dependence — orsf_pd_oob","title":"ORSF partial dependence — orsf_pd_oob","text":"Compute partial dependence ORSF model. Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model's prediction. can compute partial dependence three ways using random forest: using -bag predictions training data using --bag predictions training data using predictions new set data See examples details","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF partial dependence — orsf_pd_oob","text":"","code":"orsf_pd_oob( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... ) orsf_pd_inb( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... ) orsf_pd_new( object, pred_spec, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF partial dependence — orsf_pd_oob","text":"object (orsf_fit) trained oblique random survival forest (see orsf). pred_spec (named list data.frame). pred_spec named list, item list vector values used points partial dependence function. name item list indicate variable modified take corresponding values. pred_spec data.frame, columns indicate variable names, values indicate variable values, partial dependence computed using inputs row. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction expand_grid (logical) TRUE, partial dependence computed possible combinations inputs pred_spec. FALSE, partial dependence computed variable pred_spec, separately. prob_values (numeric) vector values 0 1, indicating quantiles used summarize partial dependence values set inputs. prob_values length prob_labels. quantiles calculated based predictions object set values indicated pred_spec. prob_labels (character) vector labels length prob_values, label indicating corresponding value prob_values labelled summarized outputs. prob_labels length prob_values. boundary_checks (logical) TRUE, pred_spec checked make sure requested values 10th 90th percentile object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. ... arguments passed methods (currently used). new_data data.frame, tibble, data.table compute predictions . na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'omit' : rows new_data incomplete data dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF partial dependence — orsf_pd_oob","text":"data.table containing partial dependence values specified variable(s) specified prediction horizon(s).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF partial dependence — orsf_pd_oob","text":"Partial dependence number known limitations assumptions users aware (see Hooker, 2021). particular, partial dependence less intuitive >2 predictors examined jointly, assumed feature(s) partial dependence computed correlated features (likely true many cases). Accumulated local effect plots can used (see ) case feature independence valid assumption.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF partial dependence — orsf_pd_oob","text":"Begin fitting ORSF ensemble:","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"three-ways-to-compute-pd-and-ice","dir":"Reference","previous_headings":"","what":"Three ways to compute PD and ICE","title":"ORSF partial dependence — orsf_pd_oob","text":"can compute partial dependence ICE three ways aorsf: using -bag predictions training data using --bag predictions training data using predictions new set data -bag partial dependence indicates relationships model learned training. helpful goal interpret model. --bag partial dependence indicates relationships model learned training using --bag data simulates application model new data. want test model’s reliability fairness new data don’t access large testing set. new data partial dependence shows model predicts outcomes observations seen. helpful want test model’s reliability fairness.","code":"pd_train <- orsf_pd_inb(fit, pred_spec = list(bili = 1:5)) pd_train ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7932390 0.2177461 0.9060625 0.9816153 ## 2: 1826.25 2 0.7642403 0.1988035 0.8717127 0.9710504 ## 3: 1826.25 3 0.7240284 0.1770122 0.8303501 0.9480047 ## 4: 1826.25 4 0.6744615 0.1615326 0.7599508 0.9088882 ## 5: 1826.25 5 0.6313355 0.1553589 0.7152580 0.8658139 pd_train <- orsf_pd_oob(fit, pred_spec = list(bili = 1:5)) pd_train ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7840481 0.2727537 0.8694252 0.9809905 ## 2: 1826.25 2 0.7549406 0.2525478 0.8333524 0.9693362 ## 3: 1826.25 3 0.7158234 0.2364582 0.7890158 0.9461864 ## 4: 1826.25 4 0.6656823 0.2260407 0.7158336 0.9151153 ## 5: 1826.25 5 0.6225353 0.2071656 0.6734005 0.8681677 pd_test <- orsf_pd_new(fit, new_data = pbc_orsf_test, pred_spec = list(bili = 1:5)) pd_test ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7524101 0.1868769 0.8121185 0.9803382 ## 2: 1826.25 2 0.7234050 0.1759562 0.7754099 0.9653244 ## 3: 1826.25 3 0.6816975 0.1581292 0.7224945 0.9403449 ## 4: 1826.25 4 0.6339907 0.1467816 0.6598026 0.9000773 ## 5: 1826.25 5 0.5911775 0.1387876 0.6186801 0.8504577"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"ORSF partial dependence — orsf_pd_oob","text":"Giles Hooker, Lucas Mentch, Siyu Zhou. Unrestricted Permutation forces Extrapolation: Variable Importance Requires least One Model, Free Variable Importance. arXiv e-prints 2021 Oct; arXiv-1905. URL: https://doi.org/10.48550/arXiv.1905.03151","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":null,"dir":"Reference","previous_headings":"","what":"Scale input data — orsf_scale_cph","title":"Scale input data — orsf_scale_cph","text":"functions exported users may access internal routines used scale inputs orsf_control_cph used.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Scale input data — orsf_scale_cph","text":"","code":"orsf_scale_cph(x_mat, w_vec = NULL) orsf_unscale_cph(x_mat)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Scale input data — orsf_scale_cph","text":"x_mat (numeric matrix) matrix values scaled unscaled. Note orsf_unscale_cph accept x_mat inputs attribute containing transform values, added automatically orsf_scale_cph. w_vec (numeric vector) optional vector weights. weights supplied (default), observations equally weighted. supplied, w_vec must length equal nrow(x_mat).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Scale input data — orsf_scale_cph","text":"scaled unscaled x_mat.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Scale input data — orsf_scale_cph","text":"data transformed first subtracting mean multiplying scale. inverse transform can completed using orsf_unscale_cph dividing column corresponding scale adding mean. values means scales stored attribute output returned orsf_scale_cph (see examples)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Scale input data — orsf_scale_cph","text":"","code":"x_mat <- as.matrix(pbc_orsf[, c('bili', 'age', 'protime')]) head(x_mat) #> bili age protime #> 1 14.5 58.76523 12.2 #> 2 1.1 56.44627 10.6 #> 3 1.4 70.07255 12.0 #> 4 1.8 54.74059 10.3 #> 5 3.4 38.10541 10.9 #> 7 1.0 55.53457 9.7 x_scaled <- orsf_scale_cph(x_mat) head(x_scaled) #> bili age protime #> [1,] 3.77308887 1.0412574 1.9694656 #> [2,] -0.75476469 0.7719344 -0.1822316 #> [3,] -0.65339483 2.3544852 1.7005035 #> [4,] -0.51823502 0.5738373 -0.5856748 #> [5,] 0.02240421 -1.3581657 0.2212116 #> [6,] -0.78855464 0.6660494 -1.3925613 attributes(x_scaled) # note the transforms attribute #> $dim #> [1] 276 3 #> #> $dimnames #> $dimnames[[1]] #> NULL #> #> $dimnames[[2]] #> [1] \"bili\" \"age\" \"protime\" #> #> #> $transforms #> mean scale #> [1,] 3.333696 0.3378995 #> [2,] 49.799661 0.1161396 #> [3,] 10.735507 1.3448108 #> x_unscaled <- orsf_unscale_cph(x_scaled) head(x_unscaled) #> bili age protime #> [1,] 14.5 58.76523 12.2 #> [2,] 1.1 56.44627 10.6 #> [3,] 1.4 70.07255 12.0 #> [4,] 1.8 54.74059 10.3 #> [5,] 3.4 38.10541 10.9 #> [6,] 1.0 55.53457 9.7 # numeric difference in x_mat and x_unscaled should be practically 0 max(abs(x_mat - x_unscaled)) #> [1] 3.552714e-15"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF summary; univariate — orsf_summarize_uni","title":"ORSF summary; univariate — orsf_summarize_uni","text":"Summarize univariate information ORSF object","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF summary; univariate — orsf_summarize_uni","text":"","code":"orsf_summarize_uni( object, n_variables = NULL, pred_horizon = NULL, pred_type = NULL, importance = NULL, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF summary; univariate — orsf_summarize_uni","text":"object (orsf_fit) trained oblique random survival forest (see orsf). n_variables (integer) many variables summarized? Setting input lower number reduce computation time. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction importance (character) Indicate method variable importance: 'none': variable importance computed. 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance details methods, see orsf_vi. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF summary; univariate — orsf_summarize_uni","text":"object class 'orsf_summary', includes data importance individual predictors. expected values predictions specific values predictors.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF summary; univariate — orsf_summarize_uni","text":"pred_horizon left unspecified, median value time--event variable object's training data used. recommended always specify prediction horizon, median time may especially meaningful horizon compute predicted risk values . object already variable importance values, can safely bypass computation variable importance function setting importance = 'none'.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF summary; univariate — orsf_summarize_uni","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 25) # since anova importance was used to make object, it is also # used for ranking variables in the summary, unless we specify # a different type of importance orsf_summarize_uni(object, n_variables = 3) #> #> -- ascites (VI Rank: 1) ----------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.6828102 0.7768548 0.4716727 0.9346420 #> 1 0.5579327 0.6105944 0.3471315 0.7721955 #> #> -- bili (VI Rank: 2) -------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0.80 0.7458561 0.8378528 0.6073211 0.9468758 #> 1.40 0.7198478 0.8099048 0.5737313 0.9291287 #> 3.52 0.6214243 0.6784119 0.4142632 0.8398702 #> #> -- edema (VI Rank: 3) ------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.6892673 0.7786128 0.4716727 0.9346420 #> 0.5 0.5370010 0.5273521 0.3228615 0.7637832 #> 1 0.5433128 0.5246940 0.3033819 0.8003144 #> #> Predicted survival at time t = 1788 for top 3 predictors # if we want to summarize object according to variables # ranked by negation importance, we can compute negation # importance within orsf_summarize_uni() as follows: orsf_summarize_uni(object, n_variables = 3, importance = 'negate') #> #> -- bili (VI Rank: 1) -------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0.80 0.7458561 0.8378528 0.6073211 0.9468758 #> 1.40 0.7198478 0.8099048 0.5737313 0.9291287 #> 3.52 0.6214243 0.6784119 0.4142632 0.8398702 #> #> -- copper (VI Rank: 2) ------------------------ #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 42.8 0.7281277 0.8198190 0.5729566 0.9505562 #> 74.0 0.7125495 0.7977600 0.5713264 0.9353026 #> 129 0.6411257 0.7000076 0.4974017 0.8797232 #> #> -- sex (VI Rank: 3) --------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> m 0.6584815 0.7560459 0.4623345 0.8749346 #> f 0.6800629 0.7861048 0.4664926 0.9346420 #> #> Predicted survival at time t = 1788 for top 3 predictors"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":null,"dir":"Reference","previous_headings":"","what":"Estimate training time — orsf_time_to_train","title":"Estimate training time — orsf_time_to_train","text":"Estimate training time","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Estimate training time — orsf_time_to_train","text":"","code":"orsf_time_to_train(object, n_tree_subset = 50)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Estimate training time — orsf_time_to_train","text":"object untrained aorsf object n_tree_subset (integer) many trees fit order estimate time needed train object. default value 50, usually gives good enough approximation.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Estimate training time — orsf_time_to_train","text":"difftime object.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Estimate training time — orsf_time_to_train","text":"","code":"# specify but do not train the model by setting no_fit = TRUE. object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 500, no_fit = TRUE) # grow 50 trees to approximate the time it will take to grow 500 trees time_estimated <- orsf_time_to_train(object, n_tree_subset = 50) print(time_estimated) #> Time difference of 0.1956177 secs # let's see how close the approximation was time_true_start <- Sys.time() fit <- orsf_train(object) time_true_stop <- Sys.time() time_true <- time_true_stop - time_true_start print(time_true) #> Time difference of 0.2299004 secs # error abs(time_true - time_estimated) #> Time difference of 0.03428268 secs"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF variable importance — orsf_vi","title":"ORSF variable importance — orsf_vi","text":"Estimate importance individual variables using oblique random survival forests.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF variable importance — orsf_vi","text":"","code":"orsf_vi( object, group_factors = TRUE, importance = NULL, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_negate( object, group_factors = TRUE, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_permute( object, group_factors = TRUE, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_anova(object, group_factors = TRUE, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF variable importance — orsf_vi","text":"object (orsf_fit) trained oblique random survival forest (see orsf). group_factors (logical) TRUE, importance factor variables reported overall aggregating importance individual levels factor. FALSE, importance individual factor levels returned. importance (character) Indicate method variable importance: 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance oobag_fun (function) used evaluating --bag prediction accuracy negating coefficients (importance = 'negate') permuting values predictor (importance = 'permute') oobag_fun = NULL (default), Harrell's C-statistic (1982) used evaluate accuracy. use oobag_fun note following: oobag_fun two inputs: y_mat s_vec y_mat two column matrix first column named 'time', second named 'status' s_vec numeric vector containing predicted survival probabilities. oobag_fun return numeric output length 1 oobag_fun used created object initial value --bag prediction accuracy consistent values computed variable importance estimated. details, see --bag vignette. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF variable importance — orsf_vi","text":"orsf_vi functions return named numeric vector. Names vector predictor variables used object Values vector estimated importance given predictor. returned vector sorted highest lowest value, higher values indicating higher importance.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF variable importance — orsf_vi","text":"orsf_fit object fitted importance = 'anova', 'negate', 'permute', output vector importance values based requested type importance. However, may still want call orsf_vi() output want group factor levels one overall importance value. orsf_vi() general purpose function extract compute variable importance estimates 'orsf_fit' object (see orsf). orsf_vi_negate(), orsf_vi_permute(), orsf_vi_anova() wrappers orsf_vi(). way functions work depends whether object given already variable importance estimates (see examples).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"variable-importance-methods","dir":"Reference","previous_headings":"","what":"Variable importance methods","title":"ORSF variable importance — orsf_vi","text":"negation importance: variable assessed separately multiplying variable's coefficients -1 determining much model's performance changes. worse model's performance negating coefficients given variable, important variable. technique promising b/c require permutation emphasizes variables larger coefficients linear combinations, also relatively new studied much permutation importance. See Jaeger, (2023) details technique. permutation importance: variable assessed separately randomly permuting variable's values determining much model's performance changes. worse model's performance permuting values given variable, important variable. technique flexible, intuitive, frequently used. also several known limitations analysis variance (ANOVA) importance: p-value computed coefficient linear combination variables decision tree. Importance individual predictor variable proportion times p-value coefficient < 0.01. technique efficient computationally, may effective permutation negation terms selecting signal noise variables. See Menze, 2011 details technique.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"anova-importance","dir":"Reference","previous_headings":"","what":"ANOVA importance","title":"ORSF variable importance — orsf_vi","text":"default variable importance technique, ANOVA, calculated fit ORSF ensemble. ANOVA default fast, may decisive permutation negation techniques variable selection.","code":"fit <- orsf(pbc_orsf, Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 21.114 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"raw-vi-values","dir":"Reference","previous_headings":"","what":"Raw VI values","title":"ORSF variable importance — orsf_vi","text":"‘raw’ variable importance values can accessed fit object ‘raw’ values factors aggregated single value. Currently one value k-1 levels k level factor. example, can see edema_1 edema_0.5 importance values edema factor variable levels 0, 0.5, 1.","code":"attr(fit, 'importance_values') ## NULL"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"collapse-vi-across-factor-levels","dir":"Reference","previous_headings":"","what":"Collapse VI across factor levels","title":"ORSF variable importance — orsf_vi","text":"get aggregated values across levels factor, access importance element orsf fit: use orsf_vi() group_factors set TRUE (default) Note can make default returned importance values ungrouped setting group_factors FALSE orsf_vi functions orsf function.","code":"fit$importance ## ascites bili edema copper age albumin protime ## 0.49306931 0.40601166 0.30339953 0.26839623 0.26685796 0.25804901 0.22825024 ## chol stage ast spiders hepato sex trig ## 0.19290780 0.18941048 0.17435648 0.16943522 0.15678670 0.13905325 0.12965799 ## alk.phos platelet trt ## 0.11338661 0.09012876 0.06778770 orsf_vi(fit) ## ascites bili edema copper age albumin protime ## 0.49306931 0.40601166 0.30339953 0.26839623 0.26685796 0.25804901 0.22825024 ## chol stage ast spiders hepato sex trig ## 0.19290780 0.18941048 0.17435648 0.16943522 0.15678670 0.13905325 0.12965799 ## alk.phos platelet trt ## 0.11338661 0.09012876 0.06778770"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"add-vi-to-an-orsf","dir":"Reference","previous_headings":"","what":"Add VI to an ORSF","title":"ORSF variable importance — orsf_vi","text":"can fit ORSF without VI, add VI later","code":"fit_no_vi <- orsf(pbc_orsf, Surv(time, status) ~ . - id, importance = 'none') # Note: you can't call orsf_vi_anova() on fit_no_vi because anova # VI can only be computed while the forest is being grown. orsf_vi_negate(fit_no_vi) ## bili copper sex protime albumin age ## 0.122344895 0.047850279 0.035986359 0.023711711 0.021831451 0.021503160 ## stage ascites chol ast spiders hepato ## 0.019718835 0.012550534 0.011115307 0.009845811 0.007601474 0.007055077 ## edema trt alk.phos trig platelet ## 0.006411580 0.003666224 0.002388178 0.001156845 -0.001214167 orsf_vi_permute(fit_no_vi) ## bili copper protime age ascites ## 5.513908e-02 2.181846e-02 1.246900e-02 1.192659e-02 1.176139e-02 ## albumin stage chol spiders edema ## 1.175554e-02 9.479348e-03 6.215674e-03 5.752179e-03 4.960035e-03 ## ast hepato sex trig alk.phos ## 4.647971e-03 3.594325e-03 2.477936e-03 1.162558e-03 6.778008e-05 ## platelet trt ## -1.132546e-03 -1.376816e-03"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"orsf-and-vi-all-at-once","dir":"Reference","previous_headings":"","what":"ORSF and VI all at once","title":"ORSF variable importance — orsf_vi","text":"fit ORSF compute vi time can still get negation VI fit, needs computed","code":"fit_permute_vi <- orsf(pbc_orsf, Surv(time, status) ~ . - id, importance = 'permute') # get the vi instantly (i.e., it doesn't need to be computed again) orsf_vi_permute(fit_permute_vi) ## bili copper protime albumin age ## 0.0582460338 0.0255992039 0.0130100780 0.0129532316 0.0121027391 ## ascites stage chol ast edema ## 0.0119289124 0.0084185175 0.0071302967 0.0053592731 0.0051471990 ## spiders hepato sex trig alk.phos ## 0.0046418826 0.0036776097 0.0026334550 0.0024978806 0.0013078222 ## platelet trt ## 0.0003504423 -0.0013892173 orsf_vi_negate(fit_permute_vi) ## bili copper sex protime age albumin ## 0.1259391254 0.0507141085 0.0363834330 0.0235136073 0.0233592840 0.0225371677 ## stage chol ascites ast spiders edema ## 0.0211978251 0.0141956334 0.0141890702 0.0108977272 0.0073762768 0.0070333453 ## hepato alk.phos trig trt platelet ## 0.0050661672 0.0048879157 0.0044980321 0.0039418881 0.0007189274"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"ORSF variable importance — orsf_vi","text":"Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating Yield Medical Tests. JAMA 1982; 247(18):2543-2546. DOI: 10.1001/jama.1982.03320430047030 Breiman L. Random forests. Machine learning 2001 Oct; 45(1):5-32. DOI: 10.1023/:1010933404324 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":null,"dir":"Reference","previous_headings":"","what":"Variable selection — orsf_vs","title":"Variable selection — orsf_vs","text":"Variable selection","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Variable selection — orsf_vs","text":"","code":"orsf_vs(object, n_predictor_min = 3, verbose_progress = FALSE)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Variable selection — orsf_vs","text":"object (orsf_fit) trained oblique random survival forest (see orsf). n_predictor_min (integer) minimum number predictors allowed verbose_progress (logical) implemented yet. progress printed console?","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Variable selection — orsf_vs","text":"data.table four columns: n_predictors: number predictors used stat_value: --bag statistic predictors_included: names predictors included predictor_dropped: predictor selected dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Variable selection — orsf_vs","text":"tree_seeds specified object successive run orsf evaluated --bag samples initial run.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Variable selection — orsf_vs","text":"","code":"object <- orsf(formula = time + status ~ ., data = pbc_orsf, n_tree = 25, importance = 'anova') orsf_vs(object, n_predictor_min = 15) #> n_predictors stat_value predictors_included #> 1: 15 0.8343664 age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... #> 2: 16 0.8337413 id,age,sex_f,ascites_1,hepato_1,spiders_1,... #> 3: 17 0.8336893 id,age,sex_f,ascites_1,hepato_1,spiders_1,... #> 4: 18 0.8355123 id,trt_placebo,age,sex_f,ascites_1,hepato_1,... #> predictor_dropped #> 1: trig #> 2: id #> 3: platelet #> 4: trt_placebo"},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"data light modification survival::pbc data. modifications :","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"","code":"pbc_orsf"},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"format","dir":"Reference","previous_headings":"","what":"Format","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"data frame 276 rows 20 variables: id case number time number days registration earlier death, transplantion, study analysis July, 1986 status status endpoint, 0 censored transplant, 1 dead trt randomized treatment group: D-penicillmain placebo age years sex m/f ascites presence ascites hepato presence hepatomegaly enlarged liver spiders blood vessel malformations skin edema 0 edema, 0.5 untreated successfully treated, 1 edema despite diuretic therapy bili serum bilirubin (mg/dl) chol serum cholesterol (mg/dl) albumin serum albumin (g/dl) copper urine copper (ug/day) alk.phos alkaline phosphotase (U/liter) ast aspartate aminotransferase, called SGOT (U/ml) trig triglycerides (mg/dl) platelet platelet count protime standardized blood clotting time stage histologic stage disease (needs biopsy)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"source","dir":"Reference","previous_headings":"","what":"Source","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"T Therneau P Grambsch (2000), Modeling Survival Data: Extending Cox Model, Springer-Verlag, New York. ISBN: 0-387-98784-3.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"removed rows missing data converted status 0 censor transplant, 1 dead converted stage ordered factor. converted trt, ascites, hepato, spiders, edema factors.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"data copied lightly modified penguins data palmerpenguins R package. modification removal rows missing data. data include measurements penguin species, island Palmer Archipelago, size (flipper length, body mass, bill dimensions), sex.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"","code":"penguins_orsf"},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"format","dir":"Reference","previous_headings":"","what":"Format","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"tibble 333 rows 8 variables: species factor denoting penguin species (Adélie, Chinstrap Gentoo) island factor denoting island Palmer Archipelago, Antarctica (Biscoe, Dream Torgersen) bill_length_mm number denoting bill length (millimeters) bill_depth_mm number denoting bill depth (millimeters) flipper_length_mm integer denoting flipper length (millimeters) body_mass_g integer denoting body mass (grams) sex factor denoting penguin sex (female, male) year integer denoting study year (2007, 2008, 2009)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"source","dir":"Reference","previous_headings":"","what":"Source","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"Adélie penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Adélie penguins (Pygoscelis adeliae) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 5. Environmental Data Initiative. doi:10.6073/pasta/98b16d7d563f265cb52372c8ca99e60f Gentoo penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Gentoo penguin (Pygoscelis papua) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 5. Environmental Data Initiative. doi:10.6073/pasta/7fca67fb28d56ee2ffa3d9370ebda689 Chinstrap penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Chinstrap penguin (Pygoscelis antarcticus) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 6. Environmental Data Initiative. doi:10.6073/pasta/c14dfcfada8ea13a17536e73eb6fbe9e Originally published : Gorman KB, Williams TD, Fraser WR (2014) Ecological Sexual Dimorphism Environmental Variability within Community Antarctic Penguins (Genus Pygoscelis). PLoS ONE 9(3): e90081. doi:10.1371/journal.pone.0090081","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":null,"dir":"Reference","previous_headings":"","what":"Compute predictions using ORSF — predict.ObliqueForest","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"Predicted risk, survival, hazard, mortality ORSF model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"","code":"# S3 method for ObliqueForest predict( object, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", boundary_checks = TRUE, n_thread = 1, verbose_progress = FALSE, pred_aggregate = TRUE, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"object (orsf_fit) trained oblique random survival forest (see orsf). new_data data.frame, tibble, data.table compute predictions . pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'pass' : output NA rows new_data 1 NA value predictors used object 'omit' : rows new_data incomplete data dropped 'impute_meanmode' : missing values continuous categorical variables new_data imputed using mean mode, respectively. clarify, mean mode used impute missing values training data object, new_data. boundary_checks (logical) TRUE, pred_horizon checked make sure requested values less maximum observed time object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. pred_aggregate (logical) TRUE (default), predictions aggregated trees taking mean. FALSE, returned output contain one row per observation one column tree. length pred_horizon two pred_aggregate FALSE, result list matrices, 'th item list corresponding 'th value pred_horizon. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"matrix predictions. Column j matrix corresponds value j pred_horizon. Row matrix corresponds row new_data.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"new_data must columns equivalent types data used train object. Also, factors new_data must levels data used train object. pred_horizon values exceed maximum follow-time object's training data, truly want , set boundary_checks = FALSE can use pred_horizon large want. Note predictions beyond maximum follow-time object's training data equal predictions maximum follow-time, aorsf estimate survival beyond maximum observed time. unspecified, pred_horizon may automatically specified value used oobag_pred_horizon object created (see orsf).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"Begin fitting ORSF ensemble: Predict risk, survival, cumulative hazard one several times: Predict mortality, defined number events forest’s population observations characteristics like current observation. type prediction require specify prediction horizon","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5) # predicted risk, the default predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'risk', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.45965512 0.73309199 0.89715078 ## [2,] 0.03235764 0.09091330 0.18045864 ## [3,] 0.12091603 0.25919883 0.39403239 ## [4,] 0.01488893 0.03745896 0.07571412 ## [5,] 0.01279842 0.02623832 0.06015808 # predicted survival, i.e., 1 - risk predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'surv', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.5403449 0.2669080 0.1028492 ## [2,] 0.9676424 0.9090867 0.8195414 ## [3,] 0.8790840 0.7408012 0.6059676 ## [4,] 0.9851111 0.9625410 0.9242859 ## [5,] 0.9872016 0.9737617 0.9398419 # predicted cumulative hazard function # (expected number of events for person i at time j) predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'chf', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.65381651 1.28606246 1.75476570 ## [2,] 0.03531788 0.10967272 0.24697387 ## [3,] 0.15371784 0.36989220 0.65462524 ## [4,] 0.01549537 0.04229610 0.09352493 ## [5,] 0.01290261 0.02687956 0.06916273 predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'mort') ## [,1] ## [1,] 79.795533 ## [2,] 22.393743 ## [3,] 38.749709 ## [4,] 13.552788 ## [5,] 9.984989"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":null,"dir":"Reference","previous_headings":"","what":"Inspect your ORSF model — print.ObliqueForest","title":"Inspect your ORSF model — print.ObliqueForest","text":"Printing ORSF model tells : Linear combinations: identified? N observations: Number rows training data N events: Number events training data N trees: Number trees forest N predictors total: Total number columns predictor matrix N predictors per node: Number variables used linear combinations Average leaves per tree: proxy depth trees Min observations leaf: See leaf_min_obs orsf Min events leaf: See leaf_min_events orsf OOB stat value: --bag error fitting trees OOB stat type: --bag error computed? Variable importance: variable importance computed?","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Inspect your ORSF model — print.ObliqueForest","text":"","code":"# S3 method for ObliqueForest print(x, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Inspect your ORSF model — print.ObliqueForest","text":"x (orsf_fit) oblique random survival forest (ORSF; see orsf). ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Inspect your ORSF model — print.ObliqueForest","text":"x, invisibly.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Inspect your ORSF model — print.ObliqueForest","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 5) print(object) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 20.8 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.77 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"Print ORSF summary — print.orsf_summary_uni","title":"Print ORSF summary — print.orsf_summary_uni","text":"Print ORSF summary","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Print ORSF summary — print.orsf_summary_uni","text":"","code":"# S3 method for orsf_summary_uni print(x, n_variables = NULL, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Print ORSF summary — print.orsf_summary_uni","text":"x object class 'orsf_summary' n_variables number variables print ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Print ORSF summary — print.orsf_summary_uni","text":"invisibly, x","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Print ORSF summary — print.orsf_summary_uni","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id) smry <- orsf_summarize_uni(object, n_variables = 3) print(smry) #> #> -- ascites (VI Rank: 1) ----------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.6920458 0.7998361 0.4865148 0.9340876 #> 1 0.5332737 0.5944016 0.3339684 0.7316275 #> #> -- bili (VI Rank: 2) -------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0.80 0.7607468 0.8475307 0.6170921 0.9395086 #> 1.40 0.7401053 0.8265075 0.5942011 0.9260483 #> 3.52 0.6251061 0.6835610 0.4731634 0.8224297 #> #> -- edema (VI Rank: 3) ------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.6963454 0.8047710 0.4898785 0.9361466 #> 0.5 0.6006160 0.6514396 0.3851734 0.8085655 #> 1 0.5965868 0.6466259 0.3865121 0.8204036 #> #> Predicted survival at time t = 1788 for top 3 predictors"},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-012-unreleased","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.2 (unreleased)","title":"aorsf 0.1.2 (unreleased)","text":"Added orsf_control functions classification, regression, survival (https://github.com/ropensci/aorsf/pull/25). optimization implemented matrix multiplication prediction (https://github.com/ropensci/aorsf/pull/20)","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-011","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.1","title":"aorsf 0.1.1","text":"CRAN release: 2023-10-26 fixed uninitialized value pd_type","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-010","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.0","title":"aorsf 0.1.0","text":"CRAN release: 2023-10-13 Re-worked internal C++ routines following design ranger. Re-worked progress printed console verbose_progress TRUE, following design ranger. Messages now indicate action taken, % complete, approximate time finishing action. Improved variable importance, following design ranger. Importance now computed tree--tree instead aggregate. Additionally, mortality type prediction used importance survival trees, since mortality depend pred_horizon. Allowed multi-threading performed orsf(), predict.orsf_fit(), functions orsf_vi() orsf_pd() family. Allowed sampling without replacement sampling specific fraction observations orsf() Included Harrell’s C-statistic option assessing goodness splits growing trees. Fixed issue uninformative error message occur pred_horizon > max(time) orsf_summarize_uni. Thanks @JyHao1 @DustinMLong finding !","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-007","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.7","title":"aorsf 0.0.7","text":"CRAN release: 2023-01-12 Additional changes internal testing avoid problems ATLAS","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-006","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.6","title":"aorsf 0.0.6","text":"CRAN release: 2023-01-06 Minor fix internal tests failing run ATLAS","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-005","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.5","title":"aorsf 0.0.5","text":"CRAN release: 2022-12-14 orsf() longer throws errors warnings try give single predictor. note added documentation details ?orsf explains using single predictor orsf() somewhat useless. done resolve https://github.com/mlr-org/mlr3extralearners/issues/259. predict.orsf_fit now accepts pred_horizon = 0 returns sensible values. Thanks @mattwarkentin feature request. added function perform variable selection, orsf_vs(). Made variable importance consistent respect group_factors. Originally, output orsf ungrouped VI values orsf_vi grouped values. update, orsf defaults grouped values. ungrouped values can still recovered. Fixed issue orsf_pd functions output data returned original scale.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-004","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.4","title":"aorsf 0.0.4","text":"CRAN release: 2022-11-07 orsf formulas now accepts Surv objects (see https://github.com/ropensci/aorsf/issues/11) Added verbose_progress input orsf, prints messages console indicating progress. Allowance missing values orsf. Mean mode imputation performed observations missing data. values can also used impute new data missing values. Centering scaling predictors now done prior growing forest.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-003","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.3","title":"aorsf 0.0.3","text":"CRAN release: 2022-10-09 Included rOpenSci reviewers Christopher Jackson, Marvin N Wright, Lukas Burk DESCRIPTION reviewers. Thank ! Added clarification docs pros/cons different variable importance techniques Added regression tests aorsf versus obliqueRSF (similar) Additional support tests functions long right hand sides Updated --bag vignette appropriate custom functions. Allow status values input data general, .e., just 0 1. Allow missing values predict functions, including partial dependence.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-002","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.2","title":"aorsf 0.0.2","text":"CRAN release: 2022-09-05 Modified unit tests compatibility extra checks run CRAN.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-001","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.1","title":"aorsf 0.0.1","text":"CRAN release: 2022-08-23 Added orsf_control_custom(), allows users submit custom functions identifying linear combinations inputs growing oblique decision trees. Added weights input orsf, allowing users fit orsf specific data training set. Added chf mort options predict.orsf_fit(). Mortality predictions fully implemented yet - supported partial dependence --bag error estimates. features added future update.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-0009000","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.0.9000","title":"aorsf 0.0.0.9000","text":"Core features implemented: fit, interpret, predict using oblique random survival forests. Vignettes + Readme covering usage core features. Website hosted GitHub pages, managed pkgdown.","code":""}] +[{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":null,"dir":"","previous_headings":"","what":"Contributing to aorsf","title":"Contributing to aorsf","text":"Want contribute aorsf? Great! aorsf initially stable state development, great deal active subsequent development envisioned. outline propose change aorsf. detailed info contributing , tidyverse packages, please see development contributing guide.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"fixing-typos","dir":"","previous_headings":"","what":"Fixing typos","title":"Contributing to aorsf","text":"can fix typos, spelling mistakes, grammatical errors documentation directly using GitHub web interface, long changes made source file. generally means ’ll need edit roxygen2 comments .R, .Rd file. can find .R file generates .Rd reading comment first line.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"bigger-changes","dir":"","previous_headings":"","what":"Bigger changes","title":"Contributing to aorsf","text":"want make bigger change, ’s good idea first file issue make sure someone team agrees ’s needed. ’ve found bug, please file issue illustrates bug minimal reprex (also help write unit test, needed).","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"pull-request-process","dir":"","previous_headings":"Bigger changes","what":"Pull request process","title":"Contributing to aorsf","text":"Fork package clone onto computer. haven’t done , recommend using usethis::create_from_github(\"ropensci/aorsf\", fork = TRUE). Install development dependencies devtools::install_dev_deps(), make sure package passes R CMD check running devtools::check(). R CMD check doesn’t pass cleanly, ’s good idea ask help continuing. Create Git branch pull request (PR). recommend using usethis::pr_init(\"brief-description--change\"). Make changes, commit git, create PR running usethis::pr_push(), following prompts browser. title PR briefly describe change. body PR contain Fixes #issue-number. user-facing changes, add bullet top NEWS.md (.e. just first header). Follow style described https://style.tidyverse.org/news.html.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"code-style","dir":"","previous_headings":"Bigger changes","what":"Code style","title":"Contributing to aorsf","text":"New code follow tidyverse style guide. can use styler package apply styles, please don’t restyle code nothing PR. use roxygen2, Markdown syntax, documentation. use testthat unit tests. Contributions test cases included easier accept.","code":""},{"path":"https://bcjaeger.github.io/aorsf/CONTRIBUTING.html","id":"code-of-conduct","dir":"","previous_headings":"","what":"Code of Conduct","title":"Contributing to aorsf","text":"Please note aorsf project released Contributor Code Conduct. contributing project agree abide terms.","code":""},{"path":"https://bcjaeger.github.io/aorsf/LICENSE.html","id":null,"dir":"","previous_headings":"","what":"MIT License","title":"MIT License","text":"Copyright (c) 2022 aorsf authors (Byron C. Jaeger, Sawyer Welden, Nicholas M. Pajewski) Permission hereby granted, free charge, person obtaining copy software associated documentation files (“Software”), deal Software without restriction, including without limitation rights use, copy, modify, merge, publish, distribute, sublicense, /sell copies Software, permit persons Software furnished , subject following conditions: copyright notice permission notice shall included copies substantial portions Software. SOFTWARE PROVIDED “”, WITHOUT WARRANTY KIND, EXPRESS IMPLIED, INCLUDING LIMITED WARRANTIES MERCHANTABILITY, FITNESS PARTICULAR PURPOSE NONINFRINGEMENT. EVENT SHALL AUTHORS COPYRIGHT HOLDERS LIABLE CLAIM, DAMAGES LIABILITY, WHETHER ACTION CONTRACT, TORT OTHERWISE, ARISING , CONNECTION SOFTWARE USE DEALINGS SOFTWARE.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"background","dir":"Articles","previous_headings":"","what":"Background","title":"Introduction to aorsf","text":"oblique random forest (RF) extension traditional (axis-based) RF. Instead using single variable split data grow new branches, trees oblique RF use weighted combination multiple variables.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"oblique-rfs-for-survival-classification-and-regression","dir":"Articles","previous_headings":"","what":"Oblique RFs for survival, classification, and regression","title":"Introduction to aorsf","text":"purpose aorsf (‘’ short accelerated) provide unifying framework fit oblique RFs can scale adequately large data sets. fastest algorithms available package used default often equivalent prediction accuracy computational approaches. Everything aorsf begins orsf() function. begin oblique RF survival using pbc_orsf data, oblique RF classification using penguins_orsf data, FILL REGRESSION. Note n_tree 5 convenience examples, >= 500 practice. may notice first input aorsf data. design choice makes easier use orsf pipes (.e., %>% |>). instance,","code":"library(aorsf) # An oblique survival RF pbc_fit <- orsf(data = pbc_orsf, n_tree = 5, formula = Surv(time, status) ~ . - id) pbc_fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 21.4 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.79 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> ----------------------------------------- # An oblique classification RF penguin_fit <- orsf(data = penguins_orsf, n_tree = 5, formula = species ~ .) penguin_fit #> ---------- Oblique random classification forest #> #> Linear combinations: Accelerated Logistic regression #> N observations: 333 #> N classes: 3 #> N trees: 5 #> N predictors total: 7 #> N predictors per node: 3 #> Average leaves per tree: 5.2 #> Min observations in leaf: 5 #> OOB stat value: 0.99 #> OOB stat type: AUC-ROC #> Variable importance: anova #> #> ----------------------------------------- # An oblique regression RF cars_fit <- orsf(data = mtcars, n_tree = 5, formula = mpg ~ .) cars_fit #> ---------- Oblique random regression forest #> #> Linear combinations: Accelerated Linear regression #> N observations: 32 #> N trees: 5 #> N predictors total: 10 #> N predictors per node: 4 #> Average leaves per tree: 5 #> Min observations in leaf: 5 #> OOB stat value: 0.73 #> OOB stat type: RSQ #> Variable importance: anova #> #> ----------------------------------------- library(dplyr) pbc_fit <- pbc_orsf |> select(-id) |> orsf(formula = Surv(time, status) ~ ., n_tree = 5)"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"interpretation","dir":"Articles","previous_headings":"","what":"Interpretation","title":"Introduction to aorsf","text":"aorsf includes several functions dedicated interpretation ORSFs, estimation partial dependence variable importance.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"variable-importance","dir":"Articles","previous_headings":"Interpretation","what":"Variable importance","title":"Introduction to aorsf","text":"multiple methods compute variable importance. compute negation importance, ORSF multiplies coefficient variable -1 re-computes --sample (sometimes referred --bag) accuracy ORSF model. can also compute variable importance using permutation, classical approach noises predictor assigned resulting degradation prediction accuracy importance predictor. faster alternative permutation negation importance ANOVA importance, computes proportion times variable obtains low p-value (p < 0.01) forest grown.","code":"orsf_vi_negate(pbc_fit) #> bili stage ascites copper edema sex #> 0.160185833 0.042419910 0.037004321 0.029450477 0.025523886 0.021037248 #> ast age hepato albumin trt chol #> 0.020497704 0.020317763 0.020162922 0.015865138 0.007418603 0.005756730 #> alk.phos protime spiders trig platelet #> 0.003328945 -0.002559019 -0.006195550 -0.007907720 -0.009315955 orsf_vi_permute(pbc_fit) #> bili ascites copper age ast #> 0.0770176686 0.0286127351 0.0222179569 0.0158979928 0.0105580692 #> alk.phos hepato trt edema chol #> 0.0074408002 0.0054291589 0.0052311839 0.0050824237 0.0038163615 #> sex stage spiders trig protime #> 0.0027274412 0.0002958220 -0.0001345556 -0.0034778432 -0.0042680518 #> albumin platelet #> -0.0130420884 -0.0152792851 orsf_vi_anova(pbc_fit) #> ascites bili stage edema albumin sex platelet #> 0.54545455 0.40909091 0.31818182 0.31746032 0.31250000 0.26666667 0.24137931 #> age copper spiders trt trig alk.phos protime #> 0.22727273 0.20000000 0.20000000 0.15789474 0.15000000 0.13043478 0.12500000 #> chol hepato ast #> 0.12500000 0.10714286 0.04166667"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"partial-dependence-pd","dir":"Articles","previous_headings":"Interpretation","what":"Partial dependence (PD)","title":"Introduction to aorsf","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. PD, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"individual-conditional-expectations-ice","dir":"Articles","previous_headings":"Interpretation","what":"Individual conditional expectations (ICE)","title":"Introduction to aorsf","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. ICE, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"what-about-the-original-orsf","dir":"Articles","previous_headings":"","what":"What about the original ORSF?","title":"Introduction to aorsf","text":"original ORSF (.e., obliqueRSF) used glmnet find linear combinations inputs. aorsf allows users implement approach using orsf_control_survival(method = 'net') function: net forests fit lot faster original ORSF function obliqueRSF. However, net forests still much slower cph ones.","code":"orsf_net <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, control = orsf_control_survival(method = 'net'))"},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"aorsf-and-other-machine-learning-software","dir":"Articles","previous_headings":"","what":"aorsf and other machine learning software","title":"Introduction to aorsf","text":"unique feature aorsf fast algorithms fit ORSF ensembles. RLT obliqueRSF fit oblique random survival forests, aorsf faster. ranger randomForestSRC fit survival forests, neither package supports oblique splitting. obliqueRF fits oblique random forests classification regression, survival. PPforest fits oblique random forests classification survival. Note: default prediction behavior aorsf models produce predicted risk specific prediction horizon, default ranger randomForestSRC. think change future, computing time independent predictions aorsf helpful.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/aorsf.html","id":"learning-more","dir":"Articles","previous_headings":"","what":"Learning more","title":"Introduction to aorsf","text":"aorsf began dedicated package oblique random survival forests, papers published far focused survival analysis risk prediction. However, routines regression classification oblique RFs aorsf high overlap survival ones. See orsf details oblique random survival forests. see JCGS paper details algorithms used specifically aorsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"go-faster","dir":"Articles","previous_headings":"","what":"Go faster","title":"Tips to speed up computation","text":"Analyses can slow crawl models need hours run. article find tricks prevent bottleneck using orsf().","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"dont-specify-a-control","dir":"Articles","previous_headings":"","what":"Don’t specify a control","title":"Tips to speed up computation","text":"default control orsf() NULL , unspecified, orsf() pick fastest possible control depending type forest grown. default control run-time compared approaches can striking. example:","code":"time_fast <- system.time( expr = orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5) ) time_net <- system.time( expr = orsf(pbc_orsf, formula = time+status~. -id, control = orsf_control_survival(method = 'net'), n_tree = 5) ) # control_fast() is much faster time_net['elapsed'] / time_fast['elapsed'] #> elapsed #> 56.2"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"use-n_thread","dir":"Articles","previous_headings":"","what":"Use n_thread","title":"Tips to speed up computation","text":"n_thread argument uses multi-threading run aorsf functions parallel possible. know many threads want, e.g. want exactly 5, just say n_thread = 5. aren’t sure many threads available want use many can, say n_thread = 0 aorsf figure number . R single threaded language, multi-threading applied orsf() needs call R functions C++, occurs customized R function used find linear combination variables compute prediction accuracy.","code":"# automatically pick number of threads based on amount available orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5, n_thread = 0) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 20 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.75 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"do-less","dir":"Articles","previous_headings":"","what":"Do less","title":"Tips to speed up computation","text":"defaults orsf() can adjusted make run faster: set n_retry 0 instead 3 (default) set oobag_pred_type ‘none’ instead ‘surv’ (default) set ‘importance’ ‘none’ instead ‘anova’ (default) increase split_min_events, split_min_obs, leaf_min_events, leaf_min_obs make trees stop growing sooner increase split_min_stat make trees stop growing sooner Applying tips: default values make orsf() run slower, also usually make predictions accurate make fit easier interpret.","code":"orsf(pbc_orsf, formula = time+status~., n_thread = 0, n_tree = 5, n_retry = 0, oobag_pred_type = 'none', importance = 'none', split_min_events = 20, leaf_min_events = 10, split_min_stat = 10) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 18 #> N predictors per node: 5 #> Average leaves per tree: 5.6 #> Min observations in leaf: 5 #> Min events in leaf: 10 #> OOB stat value: none #> OOB stat type: none #> Variable importance: none #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/fast.html","id":"show-progress","dir":"Articles","previous_headings":"","what":"Show progress","title":"Tips to speed up computation","text":"Setting verbose_progress = TRUE doesn’t make anything run faster, can help make feel like things running less slow.","code":"verbose_fit <- orsf(pbc_orsf, formula = time+status~. -id, n_tree = 5, verbose_progress = TRUE) #> Growing trees: 100%. #> Computing predictions: 100%."},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"out-of-bag-data","dir":"Articles","previous_headings":"","what":"Out-of-bag data","title":"Out-of-bag predictions and evaluation","text":"random forests, tree grown bootstrapped version training set. bootstrap samples selected replacement, bootstrapped training set contains two-thirds instances original training set. ‘--bag’ data instances bootstrapped training set.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"out-of-bag-predictions-and-error","dir":"Articles","previous_headings":"","what":"Out-of-bag predictions and error","title":"Out-of-bag predictions and evaluation","text":"tree random forest can make predictions --bag data, --bag predictions can aggregated make ensemble --bag prediction. Since --bag data used grow tree, accuracy ensemble --bag predictions approximate generalization error random forest. --bag prediction error plays central role routines estimate variable importance, e.g. negation importance. Let’s fit oblique random survival forest plot distribution ensemble --bag predictions. surprisingly, survival predictions 0 1. Next, let’s check --bag accuracy fit: --bag estimate 1 (default method evaluate --bag predictions) 0.7755585.","code":"fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, oobag_pred_type = 'surv', n_tree = 5, oobag_pred_horizon = 2000) hist(fit$pred_oobag, main = 'Ensemble out-of-bag survival predictions at t=3,500') # what function is used to evaluate out-of-bag predictions? fit$eval_oobag$stat_type #> [1] 1 # what is the output from this function? fit$eval_oobag$stat_values #> [,1] #> [1,] 0.7755585"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"monitoring-out-of-bag-error","dir":"Articles","previous_headings":"","what":"Monitoring out-of-bag error","title":"Out-of-bag predictions and evaluation","text":"--bag data set contains one-third training set, --bag error estimate usually converges stable value trees added forest. want monitor convergence --bag error oblique random survival forest, can set oobag_eval_every compute --bag error every oobag_eval_every tree. example, let’s compute --bag error fitting tree forest 50 trees: general, least 500 trees recommended random forest fit. ’re just using 10 illustration.","code":"fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, n_tree = 20, tree_seeds = 2, oobag_pred_type = 'surv', oobag_pred_horizon = 2000, oobag_eval_every = 1) plot( x = seq(1, 20, by = 1), y = fit$eval_oobag$stat_values, main = 'Out-of-bag C-statistic computed after each new tree is grown.', xlab = 'Number of trees grown', ylab = fit$eval_oobag$stat_type ) lines(x=seq(1, 20), y = fit$eval_oobag$stat_values)"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"user-supplied-out-of-bag-evaluation-functions","dir":"Articles","previous_headings":"","what":"User-supplied out-of-bag evaluation functions","title":"Out-of-bag predictions and evaluation","text":"cases, may want control --bag error estimated. example, let’s use Brier score SurvMetrics package: two ways apply function compute --bag error. First, can apply function --bag survival predictions stored ‘aorsf’ objects, e.g: Second, can pass function orsf(), used place Harrell’s C-statistic:","code":"oobag_fun_brier <- function(y_mat, w_vec, s_vec){ # output is numeric vector of length 1 as.numeric( SurvMetrics::Brier( object = Surv(time = y_mat[, 1], event = y_mat[, 2]), pre_sp = s_vec, # t_star in Brier() should match oob_pred_horizon in orsf() t_star = 2000 ) ) } oobag_fun_brier(y_mat = pbc_orsf[,c('time', 'status')], s_vec = fit$pred_oobag) #> [1] 0.117498 fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id, n_tree = 20, tree_seeds = 2, oobag_pred_horizon = 2000, oobag_fun = oobag_fun_brier, oobag_eval_every = 1) plot( x = seq(1, 20, by = 1), y = fit$eval_oobag$stat_values, main = 'Out-of-bag error computed after each new tree is grown.', sub = 'For the Brier score, lower values indicate more accurate predictions', xlab = 'Number of trees grown', ylab = \"Brier score\" ) lines(x=seq(1, 20), y = fit$eval_oobag$stat_values)"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"specific-instructions-on-user-supplied-functions","dir":"Articles","previous_headings":"User-supplied out-of-bag evaluation functions","what":"Specific instructions on user-supplied functions","title":"Out-of-bag predictions and evaluation","text":"User-supplied functions must: exactly three arguments named y_mat, w_vec, s_vec. return numeric output length 1 either conditions true, error occur. simple test make sure user-supplied function work aorsf package :","code":"# Helper code to make sure your oobag_fun function will work with aorsf # time and status values test_time <- seq(from = 1, to = 5, length.out = 100) test_status <- rep(c(0,1), each = 50) # y-matrix is presumed to contain time and status (with column names) y_mat <- cbind(time = test_time, status = test_status) # s_vec is presumed to be a vector of survival probabilities s_vec <- seq(0.9, 0.1, length.out = 100) # see 1 in the checklist above names(formals(oobag_fun_brier)) == c(\"y_mat\", \"w_vec\", \"s_vec\") #> [1] TRUE TRUE TRUE test_output <- oobag_fun_brier(y_mat = y_mat, w_vec = w_vec, s_vec = s_vec) # test output should be numeric is.numeric(test_output) #> [1] TRUE # test_output should be a numeric value of length 1 length(test_output) == 1 #> [1] TRUE"},{"path":"https://bcjaeger.github.io/aorsf/articles/oobag.html","id":"notes","dir":"Articles","previous_headings":"","what":"Notes","title":"Out-of-bag predictions and evaluation","text":"evaluating --bag error: oobag_pred_horizon input orsf() determines prediction horizon --bag predictions. prediction horizon needs specified evaluate prediction accuracy cases, examples . sure check case using functions, , sure oobag_pred_horizon matches prediction horizon used custom function. functions expect predicted risk (.e., 1 - predicted survival), others expect predicted survival. cases, also able use function whatsoever compute --bag prediction error estimating negation permutation importance, assuming passes tests . Unfortunately, exception riskRegression::Score(), one favorites. experimented riskRegression::Score found work try run C++. sure case.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"partial-dependence-pd","dir":"Articles","previous_headings":"","what":"Partial dependence (PD)","title":"PD and ICE curves with ORSF","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. Begin fitting ORSF ensemble. Set prediction horizon 5 years fit ensemble aorsf function pass ensemble assume want compute predictions 5 years.","code":"library(aorsf) pred_horizon <- 365.25 * 5 set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, n_tree = 50, oobag_pred_horizon = pred_horizon) fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 150 #> N events: 52 #> N trees: 50 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 10.26 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.82 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"three-ways-to-compute-pd","dir":"Articles","previous_headings":"","what":"Three ways to compute PD","title":"PD and ICE curves with ORSF","text":"can compute PD three ways aorsf: using -bag predictions training data using --bag predictions training data using predictions new set data -bag PD indicates relationships model learned training. helpful goal interpret model. --bag PD indicates relationships model learned training using --bag data simulates application model new data. want test model’s reliability fairness new data don’t access large testing set. new data PD shows model predicts outcomes observations seen. helpful want test model’s reliability fairness. Let’s re-fit ORSF model available data proceeding next sections.","code":"pd_inb <- orsf_pd_inb(fit, pred_spec = list(bili = 1:5)) pd_inb #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.7907730 0.2481813 0.8937603 0.9844993 #> 2: 1826.25 2 0.7601163 0.2197790 0.8682995 0.9727126 #> 3: 1826.25 3 0.7285689 0.2036100 0.8217230 0.9565828 #> 4: 1826.25 4 0.6746859 0.1718164 0.7566957 0.9123469 #> 5: 1826.25 5 0.6432024 0.1594598 0.7325270 0.8812735 pd_oob <- orsf_pd_oob(fit, pred_spec = list(bili = 1:5)) pd_oob #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.7881621 0.2863629 0.8597642 0.9894571 #> 2: 1826.25 2 0.7555353 0.2442537 0.8200408 0.9748819 #> 3: 1826.25 3 0.7255229 0.2015414 0.8066997 0.9652856 #> 4: 1826.25 4 0.6627814 0.1825518 0.7251021 0.9222259 #> 5: 1826.25 5 0.6312946 0.1513669 0.6887701 0.9008661 pd_test <- orsf_pd_new(fit, new_data = pbc_orsf_test, pred_spec = list(bili = 1:5)) pd_test #> pred_horizon bili mean lwr medn upr #> 1: 1826.25 1 0.7431989 0.2273887 0.7909497 0.9839732 #> 2: 1826.25 2 0.7109910 0.1997981 0.7468900 0.9641052 #> 3: 1826.25 3 0.6810310 0.2020585 0.7197035 0.9462750 #> 4: 1826.25 4 0.6286608 0.1842981 0.6652184 0.8986032 #> 5: 1826.25 5 0.5963168 0.1735789 0.6239932 0.8723134 set.seed(329730) fit <- orsf(pbc_orsf, Surv(time, status) ~ . -id, n_tree = 50, oobag_pred_horizon = pred_horizon)"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"one-variable-one-horizon","dir":"Articles","previous_headings":"","what":"One variable, one horizon","title":"PD and ICE curves with ORSF","text":"Computing PD single variable straightforward: output shows expected predicted mortality risk men substantially higher women 5 years baseline.","code":"pd_sex <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\"))) pd_sex #> pred_horizon sex mean lwr medn upr #> 1: 1826.25 m 0.6435480 0.07603602 0.7117799 0.9703216 #> 2: 1826.25 f 0.6856422 0.05828848 0.8006676 0.9897476"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"one-variable-moving-horizon","dir":"Articles","previous_headings":"","what":"One variable, moving horizon","title":"PD and ICE curves with ORSF","text":"effect predictor varies time? PD can show . inspection, can see males higher risk females difference risk grows time. can also seen viewing ratio expected risk time:","code":"pd_sex_tv <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\")), pred_horizon = seq(365, 365*5)) ggplot(pd_sex_tv, aes(x = pred_horizon, y = mean, color = sex)) + geom_line() + labs(x = 'Time since baseline', y = 'Expected risk') library(data.table) ratio_tv <- pd_sex_tv[ , .(ratio = mean[sex == 'm'] / mean[sex == 'f']), by = pred_horizon ] ggplot(ratio_tv, aes(x = pred_horizon, y = ratio)) + geom_line(color = 'grey') + geom_smooth(color = 'black', se = FALSE) + labs(x = 'time since baseline', y = 'ratio in expected risk for males versus females') #> `geom_smooth()` using method = 'gam' and formula = 'y ~ s(x, bs = \"cs\")'"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"multiple-variables-marginally","dir":"Articles","previous_headings":"","what":"Multiple variables, marginally","title":"PD and ICE curves with ORSF","text":"want compute PD marginally multiple variables, just list variable values pred_spec specify expand_grid = FALSE. Now tedious wanted variables? bet. ’s made function . bonus, printed output sorted least important variables. ’s easy enough turn ‘summary’ object data.table downstream plotting tables.","code":"pd_two_vars <- orsf_pd_oob(fit, pred_spec = list(sex = c(\"m\", \"f\"), bili = 1:5), expand_grid = FALSE) pd_two_vars #> pred_horizon variable value level mean lwr medn upr #> 1: 1826.25 sex NA m 0.6435480 0.07603602 0.7117799 0.9703216 #> 2: 1826.25 sex NA f 0.6856422 0.05828848 0.8006676 0.9897476 #> 3: 1826.25 bili 1 0.7578522 0.14149456 0.8228529 0.9879458 #> 4: 1826.25 bili 2 0.7007216 0.09924444 0.7792010 0.9688718 #> 5: 1826.25 bili 3 0.6463678 0.08210453 0.7216161 0.9398680 #> 6: 1826.25 bili 4 0.6058594 0.06268395 0.6709035 0.9324928 #> 7: 1826.25 bili 5 0.5760493 0.05933883 0.6265555 0.9027867 pd_smry <- orsf_summarize_uni(fit, n_variables = 4) pd_smry #> #> -- ascites (VI Rank: 1) ----------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.6881650 0.7943433 0.4746425 0.9449489 #> 1 0.5111958 0.5708393 0.3199671 0.7159134 #> #> -- bili (VI Rank: 2) -------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0.80 0.7651622 0.8323025 0.6370644 0.9563400 #> 1.40 0.7343138 0.8090864 0.5983719 0.9342372 #> 3.52 0.6271650 0.6967314 0.4420082 0.8455518 #> #> -- edema (VI Rank: 3) ------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.6941026 0.8006676 0.4662736 0.9449489 #> 0.5 0.5978522 0.6289791 0.3879660 0.8228830 #> 1 0.5981885 0.6461966 0.3858379 0.8131762 #> #> -- copper (VI Rank: 4) ------------------------ #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 42.8 0.7397492 0.8450985 0.5764946 0.9533662 #> 74.0 0.7168641 0.8286188 0.5265654 0.9448001 #> 129 0.6565337 0.7409069 0.4453135 0.8936874 #> #> Predicted survival at time t = 1826.25 for top 4 predictors head(as.data.table(pd_smry)) #> variable importance Value Mean Median 25th % 75th % #> 1: ascites 0.5225225 0 0.6881650 0.7943433 0.4746425 0.9449489 #> 2: ascites 0.5225225 1 0.5111958 0.5708393 0.3199671 0.7159134 #> 3: bili 0.3807339 0.80 0.7651622 0.8323025 0.6370644 0.9563400 #> 4: bili 0.3807339 1.40 0.7343138 0.8090864 0.5983719 0.9342372 #> 5: bili 0.3807339 3.52 0.6271650 0.6967314 0.4420082 0.8455518 #> 6: edema 0.2965828 0 0.6941026 0.8006676 0.4662736 0.9449489 #> pred_horizon level #> 1: 1826.25 0 #> 2: 1826.25 1 #> 3: 1826.25 #> 4: 1826.25 #> 5: 1826.25 #> 6: 1826.25 0"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"multiple-variables-jointly","dir":"Articles","previous_headings":"","what":"Multiple variables, jointly","title":"PD and ICE curves with ORSF","text":"PD can show expected value model’s predictions function specific predictor, function multiple predictors. instance, can estimate predicted risk joint function bili, edema, trt: inspection, model’s predictions indicate slightly lower risk placebo group, seem change much different values bili edema. clear increase predicted risk higher levels edema higher levels bili slope predicted risk function bili appears highest among patients edema 0.5. effect bili modified edema 0.5? quick sanity check coxph suggests .","code":"pred_spec = list(bili = seq(1, 5, length.out = 20), edema = levels(pbc_orsf_train$edema), trt = levels(pbc_orsf$trt)) pd_bili_edema <- orsf_pd_oob(fit, pred_spec) library(ggplot2) ggplot(pd_bili_edema, aes(x = bili, y = medn, col = trt, linetype = edema)) + geom_line() + labs(y = 'Expected predicted risk') library(survival) pbc_orsf$edema_05 <- ifelse(pbc_orsf$edema == '0.5', 'yes', 'no') fit_cph <- coxph(Surv(time,status) ~ edema_05 * bili, data = pbc_orsf) anova(fit_cph) #> Analysis of Deviance Table #> Cox model: response is Surv(time, status) #> Terms added sequentially (first to last) #> #> loglik Chisq Df Pr(>|Chi|) #> NULL -550.19 #> edema_05 -546.83 6.7248 1 0.009508 ** #> bili -513.59 66.4689 1 3.555e-16 *** #> edema_05:bili -510.54 6.1112 1 0.013433 * #> --- #> Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"individual-conditional-expectations-ice","dir":"Articles","previous_headings":"","what":"Individual conditional expectations (ICE)","title":"PD and ICE curves with ORSF","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. Just like PD, can compute ICE using -bag, --bag, testing data, principles apply. ’ll use --bag estimates .","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"visualizing-ice-curves","dir":"Articles","previous_headings":"","what":"Visualizing ICE curves","title":"PD and ICE curves with ORSF","text":"Inspecting ICE curves observation can help identify whether heterogeneity model’s predictions. .e., effect variable follow pattern data, groups variable impacts risk differently? going turn boundary checking orsf_ice_oob setting boundary_checks = FALSE, allow generate ICE curves go beyond 90th percentile bili. id_variable identifier current value variable(s) data. redundant one variable, helpful multiple variables. id_row identifier observation original data. used group observation’s predictions together plots. plots, helpful scale ICE data. subtract initial value predicted risk (.e., bili = 1) observation’s conditional expectation values. , Every curve start 0 plot shows change predicted risk function bili. Now can visualize curves. inspection figure, individual slopes cluster around overall trend - Good! small number individual slopes appear flat. may helpful investigate .","code":"pred_spec <- list(bili = seq(1, 10, length.out = 25)) ice_oob <- orsf_ice_oob(fit, pred_spec, boundary_checks = FALSE) ice_oob #> id_variable id_row pred_horizon bili pred #> 1: 1 1 1826.25 1 0.1256531 #> 2: 1 2 1826.25 1 0.1266534 #> 3: 1 3 1826.25 1 0.2493624 #> 4: 1 4 1826.25 1 0.1644180 #> 5: 1 5 1826.25 1 0.4634519 #> --- #> 6896: 25 272 1826.25 10 0.4739199 #> 6897: 25 273 1826.25 10 0.5088416 #> 6898: 25 274 1826.25 10 0.8041698 #> 6899: 25 275 1826.25 10 0.3732715 #> 6900: 25 276 1826.25 10 0.7077810 ice_oob[, pred_subtract := rep(pred[id_variable==1], times=25)] ice_oob[, pred := pred - pred_subtract] library(ggplot2) ggplot(ice_oob, aes(x = bili, y = pred, group = id_row)) + geom_line(alpha = 0.15) + labs(y = 'Change in predicted risk') + geom_smooth(se = FALSE, aes(group = 1)) #> `geom_smooth()` using method = 'gam' and formula = 'y ~ s(x, bs = \"cs\")'"},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"limitations-of-pd","dir":"Articles","previous_headings":"","what":"Limitations of PD","title":"PD and ICE curves with ORSF","text":"Partial dependence number known limitations assumptions users aware (see Hooker, 2021). particular, partial dependence less intuitive >2 predictors examined jointly, assumed feature(s) partial dependence computed correlated features (likely true many cases). Accumulated local effect plots can used (see ) case feature independence valid assumption.","code":""},{"path":"https://bcjaeger.github.io/aorsf/articles/pd.html","id":"references","dir":"Articles","previous_headings":"","what":"References","title":"PD and ICE curves with ORSF","text":"Giles Hooker, Lucas Mentch, Siyu Zhou. Unrestricted Permutation forces Extrapolation: Variable Importance Requires least One Model, Free Variable Importance. arXiv e-prints 2021 Oct; arXiv-1905. URL: https://doi.org/10.48550/arXiv.1905.03151","code":""},{"path":"https://bcjaeger.github.io/aorsf/authors.html","id":null,"dir":"","previous_headings":"","what":"Authors","title":"Authors and Citation","text":"Byron Jaeger. Author, maintainer. Nicholas Pajewski. Contributor. Sawyer Welden. Contributor. Christopher Jackson. Reviewer. Marvin Wright. Reviewer. Lukas Burk. Reviewer.","code":""},{"path":"https://bcjaeger.github.io/aorsf/authors.html","id":"citation","dir":"","previous_headings":"","what":"Citation","title":"Authors and Citation","text":"Jaeger et al. (2022). aorsf: R package supervised learning using oblique random survival forest. Journal Open Source Software, 7(77), 4705. https://doi.org/10.21105/joss.04705. Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics. 2023 Aug 3:1-6. Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique Random Survival Forests. Annals Applied Statistics. 13(3): 1847-1883. URL https://doi.org/10.1214/19-AOAS1261 DOI: 10.1214/19-AOAS1261","code":"@Article{, title = {aorsf: An R package for supervised learning using the oblique random survival forest}, author = {Byron C. Jaeger and Sawyer Welden and Kristin Lenoir and Nicholas M. Pajewski}, journal = {Journal of Open Source Software}, year = {2022}, volume = {7}, number = {77}, pages = {4705}, url = {https://doi.org/10.21105/joss.04705}, } @Article{, title = {Accelerated and interpretable oblique random survival forests}, author = {Byron C. Jaeger and Sawyer Welden and Kristin Lenoir and Jaime L. Speiser and Matthew W. Segar and Ambarish Pandey and Nicholas M. Pajewski}, journal = {Journal of Computational and Graphical Statistics}, year = {2023}, url = {https://doi.org/10.1080/10618600.2023.2231048}, } @Article{, title = {Oblique Random Survival Forests}, author = {Byron C. Jaeger and D. Leann Long and Dustin M. Long and Mario Sims and Jeff M. Szychowski and Yuan-I Min and Leslie A. Mcclure and George Howard and Noah Simon}, journal = {Annals of Applied Statistics}, year = {2019}, volume = {13}, number = {3}, pages = {1847--1883}, url = {https://doi.org/10.1214/19-AOAS1261}, }"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"aorsf-","dir":"","previous_headings":"","what":"Accelerated Oblique Random Survival Forests","title":"Accelerated Oblique Random Survival Forests","text":"Fit, interpret, make predictions oblique random survival forests (ORSFs).","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"why-aorsf","dir":"","previous_headings":"","what":"Why aorsf?","title":"Accelerated Oblique Random Survival Forests","text":"Hundreds times faster obliqueRSF.1 Accurate predictions censored outcomes.2 Negation importance, novel technique estimate variable importance ORSFs.2 Intuitive API formula based interface. Extensive input checks informative error messages.","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"installation","dir":"","previous_headings":"","what":"Installation","title":"Accelerated Oblique Random Survival Forests","text":"can install aorsf CRAN using can install development version aorsf GitHub :","code":"install.packages(\"aorsf\") # install.packages(\"remotes\") remotes::install_github(\"ropensci/aorsf\")"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"what-is-an-oblique-decision-tree","dir":"","previous_headings":"","what":"What is an oblique decision tree?","title":"Accelerated Oblique Random Survival Forests","text":"Decision trees developed splitting set training data two new subsets, goal similarity within new subsets . splitting process repeated resulting subsets data stopping criterion met. new subsets data formed based single predictor, decision tree said axis-based splits data appear perpendicular axis predictor. linear combinations variables used instead single variable, tree oblique splits data neither parallel right angle axis. Figure: Decision trees classification axis-based splitting (left) oblique splitting (right). Cases orange squares; controls purple circles. trees partition predictor space defined variables X1 X2, oblique splits better job separating two classes.","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"examples","dir":"","previous_headings":"","what":"Examples","title":"Accelerated Oblique Random Survival Forests","text":"orsf() function can fit several types ORSF ensembles. personal favorite accelerated ORSF great combination prediction accuracy computational efficiency (see JCGS paper).2","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5)"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"inspect","dir":"","previous_headings":"Examples","what":"Inspect","title":"Accelerated Oblique Random Survival Forests","text":"Printing output orsf() give information descriptive statistics ensemble. See print.orsf_fit description line printed output. See orsf examples details controlling ORSF ensemble fits using prediction modeling workflows.","code":"fit #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated #> N observations: 150 #> N events: 52 #> N trees: 500 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 10 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.83 #> OOB stat type: Harrell's C-statistic #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"variable-importance","dir":"","previous_headings":"Examples","what":"Variable importance","title":"Accelerated Oblique Random Survival Forests","text":"importance individual variables can estimated three ways using aorsf: negation2: variable assessed separately multiplying variable’s coefficients -1 determining much model’s performance changes. worse model’s performance negating coefficients given variable, important variable. technique promising b/c require permutation emphasizes variables larger coefficients linear combinations, also relatively new hasn’t studied much permutation importance. See Jaeger, (2023) details technique. permutation: variable assessed separately randomly permuting variable’s values determining much model’s performance changes. worse model’s performance permuting values given variable, important variable. technique flexible, intuitive, frequently used. also several known limitations analysis variance (ANOVA)3: p-value computed coefficient linear combination variables decision tree. Importance individual predictor variable proportion times p-value coefficient < 0.01. technique efficient computationally, may effective permutation negation terms selecting signal noise variables. See Menze, 2011 details technique. can supply R function estimate --bag error using negation permutation importance (see oob vignette)","code":"orsf_vi_negate(fit) #> bili sex copper stage age #> 0.1162463868 0.0517905362 0.0375565841 0.0240450064 0.0239056901 #> ast protime hepato edema ascites #> 0.0191083400 0.0158014897 0.0139536512 0.0119264604 0.0100865906 #> albumin chol spiders trt trig #> 0.0085394443 0.0037903802 0.0030727468 0.0020617896 0.0018361632 #> alk.phos platelet #> 0.0006586211 -0.0044967624 orsf_vi_permute(fit) #> bili copper age stage sex #> 0.0523994364 0.0187964038 0.0152246586 0.0115192591 0.0110127557 #> ast hepato edema ascites albumin #> 0.0100104477 0.0082889176 0.0079183046 0.0077834483 0.0070642325 #> protime trig chol spiders alk.phos #> 0.0066513097 0.0015656325 0.0014474560 0.0006015308 0.0001369292 #> trt platelet #> -0.0013984860 -0.0022427356 orsf_vi_anova(fit) #> bili ascites edema copper stage sex age #> 0.48778004 0.44943820 0.41677872 0.31865585 0.26675095 0.26458616 0.25448430 #> ast hepato albumin chol protime trig spiders #> 0.21743929 0.19945726 0.18191604 0.15240328 0.15076561 0.13709677 0.11833550 #> alk.phos platelet trt #> 0.10113636 0.06302021 0.05019305"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"partial-dependence-pd","dir":"","previous_headings":"Examples","what":"Partial dependence (PD)","title":"Accelerated Oblique Random Survival Forests","text":"Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model’s prediction. summary function, orsf_summarize_uni(), computes PD many variables ask , using sensible values. PD, see vignette","code":"orsf_summarize_uni(fit, n_variables = 2) #> #> -- bili (VI Rank: 1) --------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> 0.70 0.1986719 0.1044026 0.04354701 0.2968290 #> 1.3 0.2132847 0.1210276 0.05245387 0.3208855 #> 3.2 0.2883814 0.1917119 0.11951296 0.4147258 #> #> -- sex (VI Rank: 2) ---------------------------- #> #> |---------------- Risk ----------------| #> Value Mean Median 25th % 75th % #> m 0.3394141 0.2313787 0.13762339 0.5311308 #> f 0.2390067 0.1112093 0.04782891 0.3773551 #> #> Predicted risk at time t = 1826.25 for top 2 predictors"},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"individual-conditional-expectations-ice","dir":"","previous_headings":"Examples","what":"Individual conditional expectations (ICE)","title":"Accelerated Oblique Random Survival Forests","text":"Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. ICE, see vignette","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"comparison-to-existing-software","dir":"","previous_headings":"","what":"Comparison to existing software","title":"Accelerated Oblique Random Survival Forests","text":"Comparisons aorsf existing software presented JCGS paper. paper: describes aorsf detail summary procedures used tree fitting algorithm runs general benchmark comparing aorsf obliqueRSF several learners reports prediction accuracy computational efficiency learners. runs simulation study comparing variable importance techniques ORSFs, axis based RSFs, boosted trees. reports probability variable importance technique rank relevant variable higher importance irrelevant variable. hands-comparison aorsf R packages provided orsf examples","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"references","dir":"","previous_headings":"","what":"References","title":"Accelerated Oblique Random Survival Forests","text":"Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique random survival forests. Annals applied statistics 2019 Sep; 13(3):1847-83. DOI: 10.1214/19-AOAS1261 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29","code":""},{"path":"https://bcjaeger.github.io/aorsf/index.html","id":"funding","dir":"","previous_headings":"","what":"Funding","title":"Accelerated Oblique Random Survival Forests","text":"developers aorsf receive financial support Center Biomedical Informatics, Wake Forest University School Medicine. also receive support National Center Advancing Translational Sciences National Institutes Health Award Number UL1TR001420. content solely responsibility authors necessarily represent official views National Institutes Health.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/aorsf-package.html","id":null,"dir":"Reference","previous_headings":"","what":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","title":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","text":"Fit, interpret, make predictions oblique random survival forests. Oblique decision trees notoriously slow compared axis based counterparts, 'aorsf' runs fast faster axis-based decision tree algorithms right-censored time--event outcomes. Methods accelerate interpret oblique random survival forest described Jaeger et al., (2023) doi:10.1080/10618600.2023.2231048 .","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/aorsf-package.html","id":"author","dir":"Reference","previous_headings":"","what":"Author","title":"aorsf: Accelerated Oblique Random Survival Forests — aorsf-package","text":"Maintainer: Byron Jaeger bjaeger@wakehealth.edu (ORCID) contributors: Nicholas Pajewski [contributor] Sawyer Welden swelden@wakehealth.edu [contributor] Christopher Jackson chris.jackson@mrc-bsu.cam.ac.uk [reviewer] Marvin Wright [reviewer] Lukas Burk [reviewer]","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"Coerce to data.table — as.data.table.orsf_summary_uni","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"Convert 'orsf_summary' object data.table object.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"","code":"# S3 method for orsf_summary_uni as.data.table(x, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"x object class 'orsf_summary_uni' ... used","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"data.table","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/as.data.table.orsf_summary_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Coerce to data.table — as.data.table.orsf_summary_uni","text":"","code":"library(data.table) object <- orsf(pbc_orsf, Surv(time, status) ~ . - id) smry <- orsf_summarize_uni(object, n_variables = 3) as.data.table(smry) #> variable importance value mean medn lwr upr #> 1: ascites 0.4730483 0 0.6932660 0.7916641 0.4859274 0.9406494 #> 2: ascites 0.4730483 1 0.5400248 0.6013855 0.3606726 0.7381156 #> 3: bili 0.4091540 0.80 0.7645298 0.8521718 0.6246527 0.9474698 #> 4: bili 0.4091540 1.40 0.7427138 0.8227958 0.5924513 0.9292095 #> 5: bili 0.4091540 3.52 0.6296811 0.6935698 0.4653658 0.8270041 #> 6: edema 0.3102631 0 0.6995667 0.8042188 0.4921150 0.9411968 #> 7: edema 0.3102631 0.5 0.6015764 0.6593340 0.3891068 0.7962471 #> 8: edema 0.3102631 1 0.5993817 0.6468171 0.3786302 0.8259274 #> pred_horizon level #> 1: 1788 0 #> 2: 1788 1 #> 3: 1788 #> 4: 1788 #> 5: 1788 #> 6: 1788 0 #> 7: 1788 0.5 #> 8: 1788 1"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Oblique Random Survival Forest (ORSF) — orsf","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Fit oblique random survival forest","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"","code":"orsf( data, formula, control = NULL, weights = NULL, n_tree = 500, n_split = 5, n_retry = 3, n_thread = 1, mtry = NULL, sample_with_replacement = TRUE, sample_fraction = 0.632, leaf_min_events = 1, leaf_min_obs = 5, split_rule = NULL, split_min_events = 5, split_min_obs = 10, split_min_stat = NULL, oobag_pred_type = NULL, oobag_pred_horizon = NULL, oobag_eval_every = n_tree, oobag_fun = NULL, importance = \"anova\", importance_max_pvalue = 0.01, group_factors = TRUE, tree_seeds = NULL, attach_data = TRUE, no_fit = FALSE, na_action = \"fail\", verbose_progress = FALSE, ... ) orsf_train(object, attach_data = TRUE)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"data data.frame, tibble, data.table contains relevant variables. formula (formula) response left hand side include time variable, followed status variable, may written inside call Surv (see examples). terms right names predictor variables. control (orsf_control) object returned one orsf_control functions: orsf_control_fast (default) uses single iteration Newton Raphson scoring identify linear combination predictors. orsf_control_cph uses Newton Raphson scoring convergence criteria met. orsf_control_net uses glmnet identify linear combinations predictors, similar Jaeger (2019). orsf_control_custom allows user apply function create linear combinations predictors. weights (numeric vector) Optional. given, input length equal nrow(data). Values weights treated like replication weights, .e., value 2 thing 2 observations data, containing copy corresponding person's data. Use weights cautiously, orsf count number observations events prior growing node tree, higher values weights lead deeper trees. n_tree (integer) number trees grow. Default n_tree = 500. n_split (integer) number cut-points assessed splitting node decision trees. Default n_split = 5. n_retry (integer) node can split, current linear combination inputs unable provide valid split, orsf try new linear combination based different set randomly selected predictors, n_retry times. Default n_retry = 3. Set n_retry = 0 prevent retries. n_thread (integer) number threads use growing trees, computing predictions, computing importance. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. mtry (integer) Number predictors randomly included candidates splitting node. default smallest integer greater square root number total predictors, .e., mtry = ceiling(sqrt(number predictors)) sample_with_replacement (logical) TRUE (default), observations sampled replacement -bag sample created decision tree. FALSE, observations sampled without replacement tree -bag sample containing sample_fraction% original sample. sample_fraction (double) proportion observations trees' -bag sample contain, relative number rows data. used sample_with_replacement FALSE. Default value 0.632. leaf_min_events (integer) minimum number events leaf node. Default leaf_min_events = 1 leaf_min_obs (integer) minimum number observations leaf node. Default leaf_min_obs = 5. split_rule (character) assess quality potential splitting rule node. Valid options 'logrank' : log-rank test statistic. 'cstat' : Harrell's concordance statistic. split_min_events (integer) minimum number events required node consider splitting . Default split_min_events = 5 split_min_obs (integer) minimum number observations required node consider splitting . Default split_min_obs = 10. split_min_stat (double) minimum test statistic required split node. Default 3.841459 split_rule = 'logrank' 0.50 split_rule = 'cstat'. splits found statistic exceeding split_min_stat, given node either becomes leaf retry occurs (n_retry retries). oobag_pred_type (character) type --bag predictions compute fitting ensemble. Valid options 'none' : compute --bag predictions 'risk' : probability event occurring oobag_pred_horizon. 'surv' : 1 - risk. 'chf' : cumulative hazard function oobag_pred_horizon. 'mort' : mortality, .e., number events expected observations training data identical given observation. oobag_pred_horizon (numeric) numeric value indicating time used --bag predictions. Default median observed times, .e., oobag_pred_horizon = median(time). oobag_eval_every (integer) --bag performance ensemble checked every oobag_eval_every trees. , oobag_eval_every = 10, --bag performance checked growing 10th tree, 20th tree, . Default oobag_eval_every = n_tree. oobag_fun (function) used evaluating --bag prediction accuracy every oobag_eval_every trees. oobag_fun = NULL (default), Harrell's C-statistic (1982) used evaluate accuracy. use oobag_fun note following: oobag_fun two inputs: y_mat s_vec y_mat two column matrix first column named 'time', second named 'status' s_vec numeric vector containing predicted survival probabilities. oobag_fun return numeric output length 1 details, see --bag vignette. importance (character) Indicate method variable importance: 'none': variable importance computed. 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance details methods, see orsf_vi. importance_max_pvalue (double) relevant importance \"anova\". maximum p-value register positive case counting number times variable found 'significant' tree growth. Default 0.01, recommended Menze et al. group_factors (logical) relevant variable importance estimated. TRUE, importance factor variables reported overall aggregating importance individual levels factor. FALSE, importance individual factor levels returned. tree_seeds (integer vector) Optional. specified, random seeds set using values tree_seeds[] growing tree . Two forests grown number trees seeds exact --bag samples, making --bag error estimates forests comparable. NULL (default), seeds set training process. attach_data (logical) TRUE, copy training data attached output. helpful plan using functions like orsf_pd_oob orsf_summarize_uni interpret forest using training data. Default TRUE. no_fit (logical) TRUE, model fitting steps defined saved, training initiated. object returned can directly submitted orsf_train() long attach_data TRUE. na_action (character) happen data contains missing values (.e., NA values). Valid options : 'fail' : error thrown data contains NA values 'omit' : rows data incomplete data dropped 'impute_meanmode' : missing values continuous categorical variables data imputed using mean mode, respectively. Note option selected attach_data TRUE, data attached output imputed version data. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. ... arguments passed methods (currently used). object untrained 'aorsf' object, created setting no_fit = TRUE orsf().","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"accelerated oblique RSF object (aorsf)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"function based similar ORSF function obliqueRSF R package. primary difference function runs much faster. speed increase attributable better management memory (.e., unnecessary copies inputs) using Newton Raphson scoring algorithm identify linear combinations inputs rather performing penalized regression using routines glmnet.modified Newton Raphson scoring algorithm function applies adaptation C++ routine developed Terry M. Therneau fits Cox proportional hazards models (see survival::coxph() specifically survival::coxph.fit()).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"details-on-inputs","dir":"Reference","previous_headings":"","what":"Details on inputs","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"formula: response formula can survival object returned Surv function, can also just time status variables. .e., Surv(time, status) ~ . works just like time + status ~ . . symbol right hand side short-hand using variables data (omitting left hand side formula) predictors. order variables left hand side matters. .e., writing status + time ~ . make orsf assume status variable actually time variable. response variable can survival object stored data. example, y ~ . valid formula data$y inherits Surv class. Although can fit oblique random survival forest 1 predictor variable, formula least 2 predictors. reason recommendation linear combination predictors trivial one predictor. mtry: mtry parameter may temporarily reduced ensure least 2 events per predictor variable. occurs using orsf_control_cph coefficients Newton Raphson scoring algorithm may become unstable number covariates greater equal number events. reduction occur using orsf_control_net. oobag_fun: oobag_fun specified, used compute negation importance permutation importance, role ANOVA importance. n_thread: R function must called C++ (.e., user-supplied function compute --bag error identify linear combinations variables), n_thread automatically set 1 attempting run R functions multiple threads cause R session crash.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"what-is-an-oblique-decision-tree-","dir":"Reference","previous_headings":"","what":"What is an oblique decision tree?","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Decision trees developed splitting set training data two new subsets, goal similarity within new subsets . splitting process repeated resulting subsets data stopping criterion met. new subsets data formed based single predictor, decision tree said axis-based splits data appear perpendicular axis predictor. linear combinations variables used instead single variable, tree oblique splits data neither parallel right angle axis Figure : Decision trees classification axis-based splitting (left) oblique splitting (right). Cases orange squares; controls purple circles. trees partition predictor space defined variables X1 X2, oblique splits better job separating two classes.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"what-is-a-random-forest-","dir":"Reference","previous_headings":"","what":"What is a random forest?","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Random forests collections de-correlated decision trees. Predictions tree aggregated make ensemble prediction forest. details, see Breiman el, 2001.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"training-out-of-bag-error-and-testing","dir":"Reference","previous_headings":"","what":"Training, out-of-bag error, and testing","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"random forests, tree grown bootstrapped version training set. bootstrap samples selected replacement, bootstrapped training set contains two-thirds instances original training set. '--bag' data instances bootstrapped training set. tree random forest can make predictions --bag data, --bag predictions can aggregated make ensemble --bag prediction. Since --bag data used grow tree, accuracy ensemble --bag predictions approximate generalization error random forest. Generalization error refers error random forest's predictions applied predict outcomes data used train , .e., testing data.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"missing-data","dir":"Reference","previous_headings":"","what":"Missing data","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Data passed aorsf functions allowed missing values. user impute missing values using R package purpose, recipes mlr3pipelines.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"First load relevant packages entry-point aorsf standard call orsf(): printing fit provides quick descriptive summaries:","code":"set.seed(329730) suppressPackageStartupMessages({ library(aorsf) library(survival) library(tidymodels) library(tidyverse) library(randomForestSRC) library(ranger) library(riskRegression) library(obliqueRSF) }) fit <- orsf(pbc_orsf, Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 20.98 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"model-control","dir":"Reference","previous_headings":"","what":"Model control","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"examples make use orsf_control_ functions build compare models based --bag predictions. also standardize --bag samples using input argument tree_seeds","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"accelerated-linear-combinations","dir":"Reference","previous_headings":"","what":"Accelerated linear combinations","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"accelerated ORSF ensemble default nice balance computational speed prediction accuracy. runs single iteration Newton Raphson scoring Cox partial likelihood function find linear combinations predictors.","code":"fit_accel <- orsf(pbc_orsf, control = orsf_control_survival(), formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-cox-regression","dir":"Reference","previous_headings":"","what":"Linear combinations with Cox regression","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"orsf_control_cph runs Cox regression non-terminal node survival tree, using regression coefficients create linear combinations predictors:","code":"control_cph <- orsf_control_survival(method = 'glm', scale_x = TRUE, max_iter = 20) fit_cph <- orsf(pbc_orsf, control = control_cph, formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-penalized-cox-regression","dir":"Reference","previous_headings":"","what":"Linear combinations with penalized cox regression","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"orsf_control_net runs penalized Cox regression non-terminal node survival tree, using regression coefficients create linear combinations predictors. can really helpful want feature selection within node, lot slower options.","code":"# select 3 predictors out of 5 to be used in # each linear combination of predictors. control_net <- orsf_control_survival(method = 'net', target_df = 3) fit_net <- orsf(pbc_orsf, control = control_net, formula = Surv(time, status) ~ . - id, tree_seeds = 329)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"linear-combinations-with-your-own-function","dir":"Reference","previous_headings":"","what":"Linear combinations with your own function","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Let’s make three customized functions identify linear combinations predictors. first uses random coefficients second derives coefficients principal component analysis. third uses orsf() inside orsf(). can plug functions orsf_control_custom(), pass result orsf(): fit seems work best example? Let’s find evaluating --bag survival predictions. AUC values, highest lowest: indices prediction accuracy: inspection, net, accel, rlt high discrimination index prediction accuracy. rando pca less well, aren’t bad.","code":"f_rando <- function(x_node, y_node, w_node){ matrix(runif(ncol(x_node)), ncol=1) } f_pca <- function(x_node, y_node, w_node) { # estimate two principal components. pca <- stats::prcomp(x_node, rank. = 2) # use the second principal component to split the node pca$rotation[, 1L, drop = FALSE] } # This approach is known as reinforcement learning trees. # some special care is taken to prevent your R session from crashing. # Specifically, random coefficients are used when n_obs <= 10 # or n_events <= 5. f_aorsf <- function(x_node, y_node, w_node){ colnames(y_node) <- c('time', 'status') colnames(x_node) <- paste(\"x\", seq(ncol(x_node)), sep = '') data <- as.data.frame(cbind(y_node, x_node)) if(nrow(data) <= 10 || sum(y_node[,'status']) <= 5) return(matrix(runif(ncol(x_node)), ncol = 1)) fit <- orsf(data, time + status ~ ., weights = as.numeric(w_node), n_tree = 25, importance = 'permute') out <- orsf_vi(fit) # drop the least two important variables n_vars <- length(out) out[c(n_vars, n_vars-1)] <- 0 # ensure out has same variable order as input out <- out[colnames(x_node)] matrix(out, ncol = 1) } fit_rando <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_rando), tree_seeds = 329) fit_pca <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_pca), tree_seeds = 329) fit_rlt <- orsf(pbc_orsf, time + status ~ . - id, control = orsf_control_survival(method = f_aorsf), tree_seeds = 329) risk_preds <- list( accel = 1 - fit_accel$pred_oobag, cph = 1 - fit_cph$pred_oobag, net = 1 - fit_net$pred_oobag, rando = 1 - fit_rando$pred_oobag, pca = 1 - fit_pca$pred_oobag, rlt = 1 - fit_rlt$pred_oobag ) sc <- Score(object = risk_preds, formula = Surv(time, status) ~ 1, data = pbc_orsf, summary = 'IPA', times = fit_accel$pred_horizon) sc$AUC$score[order(-AUC)] ## model times AUC se lower upper ## 1: net 1788 0.9134593 0.02079935 0.8726933 0.9542253 ## 2: rlt 1788 0.9129537 0.01979016 0.8741657 0.9517417 ## 3: accel 1788 0.9112315 0.02098077 0.8701099 0.9523530 ## 4: cph 1788 0.9063871 0.02165434 0.8639453 0.9488288 ## 5: rando 1788 0.9023489 0.02218936 0.8588586 0.9458393 ## 6: pca 1788 0.8994220 0.02201713 0.8562692 0.9425748 sc$Brier$score[order(-IPA), .(model, times, IPA)] ## model times IPA ## 1: net 1788 0.4916038 ## 2: accel 1788 0.4879683 ## 3: cph 1788 0.4751883 ## 4: rlt 1788 0.4640282 ## 5: pca 1788 0.4370592 ## 6: rando 1788 0.4258344 ## 7: Null model 1788 0.0000000"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"tidymodels","dir":"Reference","previous_headings":"","what":"tidymodels","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"example uses tidymodels functions stops short using official tidymodels workflow. working getting aorsf pulled censored package update real workflows happens!","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"comparing-orsf-with-other-learners","dir":"Reference","previous_headings":"","what":"Comparing ORSF with other learners","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Start recipe pre-process data Next create 10-fold cross validation object pre-process data: Define functions ‘workflow’ randomForestSRC, ranger, aorsf. Run ‘workflows’ fold: Next unnest column get back tibble testing data predictions. finish aggregating predictions computing performance testing data. Note computing one statistic predictions instead computing one statistic fold. approach fine smaller testing sets /small event counts. inspection, aorsf obtained slightly higher discrimination (AUC) aorsf obtained higher index prediction accuracy (IPA)","code":"imputer <- recipe(pbc_orsf, formula = time + status ~ .) %>% step_rm(id) %>% step_impute_mean(all_numeric_predictors()) %>% step_impute_mode(all_nominal_predictors()) # 10-fold cross validation; make a container for the pre-processed data analyses <- vfold_cv(data = pbc_orsf, v = 10) %>% mutate(recipe = map(splits, ~prep(imputer, training = training(.x))), train = map(recipe, juice), test = map2(splits, recipe, ~bake(.y, new_data = testing(.x)))) analyses ## # 10-fold cross-validation ## # A tibble: 10 x 5 ## splits id recipe train test ## ## 1 Fold01 ## 2 Fold02 ## 3 Fold03 ## 4 Fold04 ## 5 Fold05 ## 6 Fold06 ## 7 Fold07 ## 8 Fold08 ## 9 Fold09 ## 10 Fold10 rfsrc_wf <- function(train, test, pred_horizon){ # rfsrc does not like tibbles, so cast input data into data.frames train <- as.data.frame(train) test <- as.data.frame(test) rfsrc(formula = Surv(time, status) ~ ., data = train) %>% predictRisk(newdata = test, times = pred_horizon) %>% as.numeric() } ranger_wf <- function(train, test, pred_horizon){ ranger(Surv(time, status) ~ ., data = train) %>% predictRisk(newdata = test, times = pred_horizon) %>% as.numeric() } aorsf_wf <- function(train, test, pred_horizon){ train %>% orsf(Surv(time, status) ~ .,) %>% predict(new_data = test, pred_type = 'risk', pred_horizon = pred_horizon) %>% as.numeric() } # 5 year risk prediction ph <- 365.25 * 5 results <- analyses %>% transmute(test, pred_aorsf = map2(train, test, aorsf_wf, pred_horizon = ph), pred_rfsrc = map2(train, test, rfsrc_wf, pred_horizon = ph), pred_ranger = map2(train, test, ranger_wf, pred_horizon = ph)) results <- results %>% unnest(everything()) glimpse(results) ## Rows: 276 ## Columns: 23 ## $ id 1, 8, 15, 17, 23, 35, 56, 68, 92, 94, 97, 109, 116, 130, 1~ ## $ trt d_penicill_main, placebo, d_penicill_main, placebo, placeb~ ## $ age 58.76523, 53.05681, 64.64613, 52.18344, 55.96715, 48.61875~ ## $ sex f, f, f, f, f, f, f, f, f, f, m, f, f, f, f, f, f, f, f, f~ ## $ ascites 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0~ ## $ hepato 1, 0, 0, 1, 1, 0, 1, 0, 0, 1, 1, 0, 0, 1, 0, 0, 1, 0, 1, 0~ ## $ spiders 1, 0, 0, 0, 1, 0, 1, 0, 0, 1, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0~ ## $ edema 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0.5, 0, 0.5, 0, 0, 0, 0.5, 0~ ## $ bili 14.5, 0.3, 0.8, 2.7, 17.4, 1.2, 1.1, 0.7, 1.4, 3.2, 2.0, 0~ ## $ chol 261, 280, 231, 274, 395, 314, 498, 174, 206, 201, 420, 120~ ## $ albumin 2.60, 4.00, 3.87, 3.15, 2.94, 3.20, 3.80, 4.09, 3.13, 3.11~ ## $ copper 156, 52, 173, 159, 558, 201, 88, 58, 36, 178, 62, 53, 74, ~ ## $ alk.phos 1718.0, 4651.2, 9009.8, 1533.0, 6064.8, 12258.8, 13862.4, ~ ## $ ast 137.95, 28.38, 127.71, 117.80, 227.04, 72.24, 95.46, 71.30~ ## $ trig 172, 189, 96, 128, 191, 151, 319, 46, 70, 69, 91, 52, 382,~ ## $ platelet 190, 373, 295, 224, 214, 431, 365, 203, 145, 188, 344, 271~ ## $ protime 12.2, 11.0, 11.0, 10.5, 11.7, 10.6, 10.6, 10.6, 12.2, 11.8~ ## $ stage 4, 3, 3, 4, 4, 3, 2, 3, 4, 4, 3, 3, 3, 3, 2, 2, 3, 2, 3, 2~ ## $ time 400, 2466, 3584, 769, 264, 2847, 1847, 4039, 388, 750, 611~ ## $ status 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 0, 0, 1, 0, 0, 1, 0, 1, 0~ ## $ pred_aorsf 0.95858574, 0.05070837, 0.22924369, 0.47048899, 0.94442624~ ## $ pred_rfsrc 0.85474291, 0.05480510, 0.31751746, 0.45156052, 0.85784657~ ## $ pred_ranger 0.77897322, 0.04599438, 0.30267242, 0.43467381, 0.77914735~ Score( object = list(aorsf = results$pred_aorsf, rfsrc = results$pred_rfsrc, ranger = results$pred_ranger), formula = Surv(time, status) ~ 1, data = results, summary = 'IPA', times = ph ) ## ## Metric AUC: ## ## Results by model: ## ## model times AUC lower upper ## 1: aorsf 1826 90.7 86.4 95.0 ## 2: rfsrc 1826 89.9 85.6 94.2 ## 3: ranger 1826 89.7 85.5 94.0 ## ## Results of model comparisons: ## ## times model reference delta.AUC lower upper p ## 1: 1826 rfsrc aorsf -0.8 -2.2 0.5 0.2 ## 2: 1826 ranger aorsf -1.0 -2.5 0.5 0.2 ## 3: 1826 ranger rfsrc -0.1 -1.3 1.0 0.8 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The higher AUC the better. ## ## Metric Brier: ## ## Results by model: ## ## model times Brier lower upper IPA ## 1: Null model 1826.25 20.5 18.1 22.9 0.0 ## 2: aorsf 1826.25 10.8 8.6 13.0 47.3 ## 3: rfsrc 1826.25 11.8 9.7 13.9 42.5 ## 4: ranger 1826.25 11.9 9.8 14.0 41.9 ## ## Results of model comparisons: ## ## times model reference delta.Brier lower upper p ## 1: 1826.25 aorsf Null model -9.7 -12.3 -7.1 2.179169e-13 ## 2: 1826.25 rfsrc Null model -8.7 -11.0 -6.4 3.915661e-14 ## 3: 1826.25 ranger Null model -8.6 -10.9 -6.2 8.869452e-13 ## 4: 1826.25 rfsrc aorsf 1.0 0.3 1.7 5.383491e-03 ## 5: 1826.25 ranger aorsf 1.1 0.5 1.7 7.890574e-04 ## 6: 1826.25 ranger rfsrc 0.1 -0.4 0.6 6.310608e-01 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The lower Brier the better, the higher IPA the better."},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"mlr-pipelines","dir":"Reference","previous_headings":"","what":"mlr3 pipelines","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Warning: code may may run depending current version mlr3proba. First load additional mlr3 libraries. Next ’ll define tasks learners engage . Now can make benchmark designed compare three favorite learners: Let’s look overall results: inspection, aorsf higher expected value ‘surv.cindex’ (higher better) aorsf lower expected value ‘surv.graf’ (lower better)","code":"suppressPackageStartupMessages({ library(mlr3verse) library(mlr3proba) library(mlr3extralearners) library(mlr3viz) library(mlr3benchmark) }) # Mayo Clinic Primary Biliary Cholangitis Data task_pbc <- TaskSurv$new( id = 'pbc', backend = select(pbc_orsf, -id) %>% mutate(stage = as.numeric(stage)), time = \"time\", event = \"status\" ) # Veteran's Administration Lung Cancer Trial data(veteran, package = \"randomForestSRC\") task_veteran <- TaskSurv$new( id = 'veteran', backend = veteran, time = \"time\", event = \"status\" ) # NKI 70 gene signature data_nki <- OpenML::getOMLDataSet(data.id = 1228) task_nki <- TaskSurv$new( id = 'nki', backend = data_nki$data, time = \"time\", event = \"event\" ) # Gene Expression-Based Survival Prediction in Lung Adenocarcinoma data_lung <- OpenML::getOMLDataSet(data.id = 1245) task_lung <- TaskSurv$new( id = 'nki', backend = data_lung$data %>% mutate(OS_event = as.numeric(OS_event) -1), time = \"OS_years\", event = \"OS_event\" ) # Chemotherapy for Stage B/C colon cancer # (there are two rows per person, one for death # and the other for recurrence, hence the two tasks) task_colon_death <- TaskSurv$new( id = 'colon_death', backend = survival::colon %>% filter(etype == 2) %>% drop_na() %>% # drop id, redundant variables select(-id, -study, -node4, -etype), mutate(OS_event = as.numeric(OS_event) -1), time = \"time\", event = \"status\" ) task_colon_recur <- TaskSurv$new( id = 'colon_death', backend = survival::colon %>% filter(etype == 1) %>% drop_na() %>% # drop id, redundant variables select(-id, -study, -node4, -etype), mutate(OS_event = as.numeric(OS_event) -1), time = \"time\", event = \"status\" ) # putting them all together tasks <- list(task_pbc, task_veteran, task_nki, task_lung, task_colon_death, task_colon_recur, # add a few more pre-made ones tsk(\"actg\"), tsk('gbcs'), tsk('grace'), tsk(\"unemployment\"), tsk(\"whas\")) # Learners with default parameters learners <- lrns(c(\"surv.ranger\", \"surv.rfsrc\", \"surv.aorsf\")) # Brier (Graf) score, c-index and training time as measures measures <- msrs(c(\"surv.graf\", \"surv.cindex\", \"time_train\")) # Benchmark with 5-fold CV design <- benchmark_grid( tasks = tasks, learners = learners, resamplings = rsmps(\"cv\", folds = 5) ) benchmark_result <- benchmark(design) bm_scores <- benchmark_result$score(measures, predict_sets = \"test\") bm_scores %>% select(task_id, learner_id, surv.graf, surv.cindex, time_train) %>% group_by(learner_id) %>% filter(!is.infinite(surv.graf)) %>% summarize( across( .cols = c(surv.graf, surv.cindex, time_train), .fns = ~mean(.x, na.rm = TRUE) ) ) ## # A tibble: 3 x 4 ## learner_id surv.graf surv.cindex time_train ## ## 1 surv.aorsf 0.150 0.734 0.383 ## 2 surv.ranger 0.164 0.716 2.04 ## 3 surv.rfsrc 0.155 0.724 0.757"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Oblique Random Survival Forest (ORSF) — orsf","text":"Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating Yield Medical Tests. JAMA 1982; 247(18):2543-2546. DOI: 10.1001/jama.1982.03320430047030 Breiman L. Random forests. Machine learning 2001 Oct; 45(1):5-32. DOI: 10.1023/:1010933404324 Ishwaran H, Kogalur UB, Blackstone EH, Lauer MS. Random survival forests. Annals applied statistics 2008 Sep; 2(3):841-60. DOI: 10.1214/08-AOAS169 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29 Jaeger BC, Long DL, Long DM, Sims M, Szychowski JM, Min YI, Mcclure LA, Howard G, Simon N. Oblique random survival forests. Annals applied statistics 2019 Sep; 13(3):1847-83. DOI: 10.1214/19-AOAS1261 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":null,"dir":"Reference","previous_headings":"","what":"Oblique random forest control — orsf_control","title":"Oblique random forest control — orsf_control","text":"Oblique random forest control","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Oblique random forest control — orsf_control","text":"","code":"orsf_control( tree_type, method, scale_x, ties, net_mix, target_df, max_iter, epsilon, ... ) orsf_control_classification( method = \"glm\", scale_x = TRUE, net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... ) orsf_control_regression( method = \"glm\", scale_x = TRUE, net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... ) orsf_control_survival( method = \"glm\", scale_x = TRUE, ties = \"efron\", net_mix = 0.5, target_df = NULL, max_iter = 20, epsilon = 1e-09, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Oblique random forest control — orsf_control","text":"tree_type (character) type tree. Valid options \"classification\", .e., categorical outcomes \"regression\", .e., continuous outcomes \"survival\", .e., time-event outcomes method (character function) identify linear linear combinations predictors. method character value, must one : 'glm': linear, logistic, cox regression 'net': 'glm' penalty terms 'pca': principal component analysis 'random': random draw uniform distribution method function, used identify linear combinations predictor variables. method must case accept three inputs named x_node, y_node w_node, expect following types dimensions: x_node (matrix; n rows, p columns) y_node (matrix; n rows, 2 columns) w_node (matrix; n rows, 1 column) addition, method must return matrix p rows 1 column. scale_x (logical) TRUE, values predictors scaled prior instance finding linear combination predictors, using summary values data current node decision tree. ties (character) character string specifying method tie handling. relevant modeling survival outcomes using method engages tied outcome times. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. net_mix (double) elastic net mixing parameter. value 1 gives lasso penalty, value 0 gives ridge penalty. multiple values alpha given, penalized model fit using alpha value prior splitting node. target_df (integer) Preferred number variables used linear combination. example, mtry 5 target_df 3, sample 5 predictors look best linear combination using 3 . max_iter (integer) iteration continues convergence (see eps ) number attempted iterations equal iter_max. epsilon (double) using modeling based method, iteration continues algorithm relative change kind objective less epsilon, absolute change less sqrt(epsilon). ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Oblique random forest control — orsf_control","text":"object class 'orsf_control', used input control argument orsf. Components : tree_type: type trees fit lincomb_type: method linear combinations lincomb_eps: epsilon convergence lincomb_iter_max: max iterations lincomb_scale: scale . lincomb_alpha: mixing parameter lincomb_df_target: target degrees freedom lincomb_ties_method: method ties survival time lincomb_R_function: R function custom splits","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Oblique random forest control — orsf_control","text":"Adjust scale_x risk. Setting scale_x = FALSE reduce computation time also make orsf model dependent scale data, default value TRUE.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":null,"dir":"Reference","previous_headings":"","what":"Cox regression ORSF control — orsf_control_cph","title":"Cox regression ORSF control — orsf_control_cph","text":"Use coefficients proportional hazards model create linear combinations predictor variables fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Cox regression ORSF control — orsf_control_cph","text":"","code":"orsf_control_cph(method = \"efron\", eps = 1e-09, iter_max = 20, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Cox regression ORSF control — orsf_control_cph","text":"method (character) character string specifying method tie handling. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. eps (double) using Newton Raphson scoring identify linear combinations inputs, iteration continues algorithm relative change log partial likelihood less eps, absolute change less sqrt(eps). Must positive. default value 1e-09 used consistency survival::coxph.control. iter_max (integer) iteration continues convergence (see eps ) number attempted iterations equal iter_max. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Cox regression ORSF control — orsf_control_cph","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Cox regression ORSF control — orsf_control_cph","text":"code survival package modified make routine. details Cox proportional hazards model, see coxph /Therneau Grambsch (2000).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_cph.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Cox regression ORSF control — orsf_control_cph","text":"Therneau T.M., Grambsch P.M. (2000) Cox Model. : Modeling Survival Data: Extending Cox Model. Statistics Biology Health. Springer, New York, NY. DOI: 10.1007/978-1-4757-3294-8_3","code":""},{"path":[]},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Custom ORSF control — orsf_control_custom","text":"","code":"orsf_control_custom(beta_fun, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Custom ORSF control — orsf_control_custom","text":"beta_fun (function) function define coefficients used linear combinations predictor variables. beta_fun must accept three inputs named x_node, y_node w_node, expect following types dimensions: x_node (matrix; n rows, p columns) y_node (matrix; n rows, 2 columns) w_node (matrix; n rows, 1 column) addition, beta_fun must return matrix p rows 1 column. conditions met, orsf_control_custom() let know. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Custom ORSF control — orsf_control_custom","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Custom ORSF control — orsf_control_custom","text":"Two customized functions identify linear combinations predictors shown . first uses random coefficients second derives coefficients principal component analysis.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"random-coefficients","dir":"Reference","previous_headings":"","what":"Random coefficients","title":"Custom ORSF control — orsf_control_custom","text":"f_rando() function get random coefficients: can plug f_rando orsf_control_survival(), pass result orsf():","code":"f_rando <- function(x_node, y_node, w_node){ matrix(runif(ncol(x_node)), ncol=1) } library(aorsf) fit_rando <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_rando), n_tree = 500) fit_rando ## ---------- Oblique random survival forest ## ## Linear combinations: Custom user function ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 19.682 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.83 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"principal-components","dir":"Reference","previous_headings":"","what":"Principal components","title":"Custom ORSF control — orsf_control_custom","text":"Follow steps , starting custom function: plug function orsf_control_survival() pass result orsf():","code":"f_pca <- function(x_node, y_node, w_node) { # estimate two principal components. pca <- stats::prcomp(x_node, rank. = 2) # use the second principal component to split the node pca$rotation[, 2L, drop = FALSE] } fit_pca <- orsf(pbc_orsf, Surv(time, status) ~ . - id, control = orsf_control_survival(method = f_pca), n_tree = 500)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_custom.html","id":"evaluate","dir":"Reference","previous_headings":"","what":"Evaluate","title":"Custom ORSF control — orsf_control_custom","text":"well two customized ORSFs ? Let’s compute indices prediction accuracy based --bag predictions: PCA ORSF quite well! (higher IPA better)","code":"library(riskRegression) ## riskRegression version 2023.09.08 library(survival) risk_preds <- list(rando = 1 - fit_rando$pred_oobag, pca = 1 - fit_pca$pred_oobag) sc <- Score(object = risk_preds, formula = Surv(time, status) ~ 1, data = pbc_orsf, summary = 'IPA', times = fit_pca$pred_horizon) sc$Brier ## ## Results by model: ## ## model times Brier lower upper IPA ## 1: Null model 1788 20.479 18.090 22.868 0.000 ## 2: rando 1788 11.872 9.771 13.972 42.031 ## 3: pca 1788 12.990 10.971 15.009 36.569 ## ## Results of model comparisons: ## ## times model reference delta.Brier lower upper p ## 1: 1788 rando Null model -8.607 -10.809 -6.406 1.832790e-14 ## 2: 1788 pca Null model -7.489 -9.213 -5.765 1.664802e-17 ## 3: 1788 pca rando 1.118 0.258 1.979 1.087482e-02 ## ## NOTE: Values are multiplied by 100 and given in %. ## NOTE: The lower Brier the better, the higher IPA the better."},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":null,"dir":"Reference","previous_headings":"","what":"Accelerated ORSF control — orsf_control_fast","title":"Accelerated ORSF control — orsf_control_fast","text":"Fast methods identify linear combinations predictors fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Accelerated ORSF control — orsf_control_fast","text":"","code":"orsf_control_fast(method = \"efron\", do_scale = TRUE, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Accelerated ORSF control — orsf_control_fast","text":"method (character) character string specifying method tie handling. ties, methods equivalent. Valid options 'breslow' 'efron'. Efron approximation default accurate dealing tied event times similar computational efficiency compared Breslow method. do_scale (logical) TRUE, values predictors scaled prior instance Newton Raphson scoring, using summary values data current node decision tree. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Accelerated ORSF control — orsf_control_fast","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_fast.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Accelerated ORSF control — orsf_control_fast","text":"code survival package modified make routine. Adjust do_scale risk. Setting do_scale = FALSE reduce computation time also make orsf model dependent scale data, default value TRUE.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":null,"dir":"Reference","previous_headings":"","what":"Penalized Cox regression ORSF control — orsf_control_net","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"Use regularized Cox proportional hazard models identify linear combinations input variables fitting orsf model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"","code":"orsf_control_net(alpha = 1/2, df_target = NULL, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"alpha (double) elastic net mixing parameter. value 1 gives lasso penalty, value 0 gives ridge penalty. multiple values alpha given, penalized model fit using alpha value prior splitting node. df_target (integer) Preferred number variables used linear combination. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"object class 'orsf_control', used input control argument orsf.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"df_target less mtry, separate argument orsf indicates number variables chosen random prior finding linear combination variables.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_control_net.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"Penalized Cox regression ORSF control — orsf_control_net","text":"Simon N, Friedman J, Hastie T, Tibshirani R. Regularization paths Cox's proportional hazards model via coordinate descent. Journal statistical software 2011 Mar; 39(5):1. DOI: 10.18637/jss.v039.i05","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF Individual Conditional Expectations — orsf_ice_oob","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"Compute individual conditional expectations ORSF model. Unlike partial dependence, shows expected prediction function one multiple predictors, individual conditional expectations (ICE) show prediction individual observation function predictor. can compute individual conditional expectations three ways using random forest: using -bag predictions training data using --bag predictions training data using predictions new set data See examples details","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"","code":"orsf_ice_oob( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... ) orsf_ice_inb( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... ) orsf_ice_new( object, pred_spec, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", expand_grid = TRUE, boundary_checks = TRUE, n_thread = 1, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"object (orsf_fit) trained oblique random survival forest (see orsf). pred_spec (named list data.frame). pred_spec named list, item list vector values used points partial dependence function. name item list indicate variable modified take corresponding values. pred_spec data.frame, columns indicate variable names, values indicate variable values, partial dependence computed using inputs row. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction expand_grid (logical) TRUE, partial dependence computed possible combinations inputs pred_spec. FALSE, partial dependence computed variable pred_spec, separately. boundary_checks (logical) TRUE, pred_spec checked make sure requested values 10th 90th percentile object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. ... arguments passed methods (currently used). new_data data.frame, tibble, data.table compute predictions . na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'omit' : rows new_data incomplete data dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"data.table containing individual conditional expectations specified variable(s) specified prediction horizon(s).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_ice_oob.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF Individual Conditional Expectations — orsf_ice_oob","text":"Begin fitting ORSF ensemble Use ensemble compute ICE values using --bag predictions: Much detailed examples given vignette","code":"library(aorsf) set.seed(329) fit <- orsf(data = pbc_orsf, formula = Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 21.026 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## ----------------------------------------- pred_spec <- list(bili = seq(1, 10, length.out = 25)) ice_oob <- orsf_ice_oob(fit, pred_spec, boundary_checks = FALSE) ice_oob ## id_variable id_row pred_horizon bili pred ## 1: 1 1 1788 1 0.1264442 ## 2: 1 2 1788 1 0.1739727 ## 3: 1 3 1788 1 0.3904517 ## 4: 1 4 1788 1 0.2874752 ## 5: 1 5 1788 1 0.4398522 ## --- ## 6896: 25 272 1788 10 0.3076971 ## 6897: 25 273 1788 10 0.4942110 ## 6898: 25 274 1788 10 0.6407498 ## 6899: 25 275 1788 10 0.3871298 ## 6900: 25 276 1788 10 0.6479179"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF partial dependence — orsf_pd_oob","title":"ORSF partial dependence — orsf_pd_oob","text":"Compute partial dependence ORSF model. Partial dependence (PD) shows expected prediction model function single predictor multiple predictors. expectation marginalized values predictors, giving something like multivariable adjusted estimate model's prediction. can compute partial dependence three ways using random forest: using -bag predictions training data using --bag predictions training data using predictions new set data See examples details","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF partial dependence — orsf_pd_oob","text":"","code":"orsf_pd_oob( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... ) orsf_pd_inb( object, pred_spec, pred_horizon = NULL, pred_type = NULL, expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... ) orsf_pd_new( object, pred_spec, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", expand_grid = TRUE, prob_values = c(0.025, 0.5, 0.975), prob_labels = c(\"lwr\", \"medn\", \"upr\"), boundary_checks = TRUE, n_thread = 1, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF partial dependence — orsf_pd_oob","text":"object (orsf_fit) trained oblique random survival forest (see orsf). pred_spec (named list data.frame). pred_spec named list, item list vector values used points partial dependence function. name item list indicate variable modified take corresponding values. pred_spec data.frame, columns indicate variable names, values indicate variable values, partial dependence computed using inputs row. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction expand_grid (logical) TRUE, partial dependence computed possible combinations inputs pred_spec. FALSE, partial dependence computed variable pred_spec, separately. prob_values (numeric) vector values 0 1, indicating quantiles used summarize partial dependence values set inputs. prob_values length prob_labels. quantiles calculated based predictions object set values indicated pred_spec. prob_labels (character) vector labels length prob_values, label indicating corresponding value prob_values labelled summarized outputs. prob_labels length prob_values. boundary_checks (logical) TRUE, pred_spec checked make sure requested values 10th 90th percentile object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. ... arguments passed methods (currently used). new_data data.frame, tibble, data.table compute predictions . na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'omit' : rows new_data incomplete data dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF partial dependence — orsf_pd_oob","text":"data.table containing partial dependence values specified variable(s) specified prediction horizon(s).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF partial dependence — orsf_pd_oob","text":"Partial dependence number known limitations assumptions users aware (see Hooker, 2021). particular, partial dependence less intuitive >2 predictors examined jointly, assumed feature(s) partial dependence computed correlated features (likely true many cases). Accumulated local effect plots can used (see ) case feature independence valid assumption.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF partial dependence — orsf_pd_oob","text":"Begin fitting ORSF ensemble:","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"three-ways-to-compute-pd-and-ice","dir":"Reference","previous_headings":"","what":"Three ways to compute PD and ICE","title":"ORSF partial dependence — orsf_pd_oob","text":"can compute partial dependence ICE three ways aorsf: using -bag predictions training data using --bag predictions training data using predictions new set data -bag partial dependence indicates relationships model learned training. helpful goal interpret model. --bag partial dependence indicates relationships model learned training using --bag data simulates application model new data. want test model’s reliability fairness new data don’t access large testing set. new data partial dependence shows model predicts outcomes observations seen. helpful want test model’s reliability fairness.","code":"pd_train <- orsf_pd_inb(fit, pred_spec = list(bili = 1:5)) pd_train ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7932390 0.2177461 0.9060625 0.9816153 ## 2: 1826.25 2 0.7642403 0.1988035 0.8717127 0.9710504 ## 3: 1826.25 3 0.7240284 0.1770122 0.8303501 0.9480047 ## 4: 1826.25 4 0.6744615 0.1615326 0.7599508 0.9088882 ## 5: 1826.25 5 0.6313355 0.1553589 0.7152580 0.8658139 pd_train <- orsf_pd_oob(fit, pred_spec = list(bili = 1:5)) pd_train ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7840481 0.2727537 0.8694252 0.9809905 ## 2: 1826.25 2 0.7549406 0.2525478 0.8333524 0.9693362 ## 3: 1826.25 3 0.7158234 0.2364582 0.7890158 0.9461864 ## 4: 1826.25 4 0.6656823 0.2260407 0.7158336 0.9151153 ## 5: 1826.25 5 0.6225353 0.2071656 0.6734005 0.8681677 pd_test <- orsf_pd_new(fit, new_data = pbc_orsf_test, pred_spec = list(bili = 1:5)) pd_test ## pred_horizon bili mean lwr medn upr ## 1: 1826.25 1 0.7524101 0.1868769 0.8121185 0.9803382 ## 2: 1826.25 2 0.7234050 0.1759562 0.7754099 0.9653244 ## 3: 1826.25 3 0.6816975 0.1581292 0.7224945 0.9403449 ## 4: 1826.25 4 0.6339907 0.1467816 0.6598026 0.9000773 ## 5: 1826.25 5 0.5911775 0.1387876 0.6186801 0.8504577"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_pd_oob.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"ORSF partial dependence — orsf_pd_oob","text":"Giles Hooker, Lucas Mentch, Siyu Zhou. Unrestricted Permutation forces Extrapolation: Variable Importance Requires least One Model, Free Variable Importance. arXiv e-prints 2021 Oct; arXiv-1905. URL: https://doi.org/10.48550/arXiv.1905.03151","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":null,"dir":"Reference","previous_headings":"","what":"Scale input data — orsf_scale_cph","title":"Scale input data — orsf_scale_cph","text":"functions exported users may access internal routines used scale inputs orsf_control_cph used.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Scale input data — orsf_scale_cph","text":"","code":"orsf_scale_cph(x_mat, w_vec = NULL) orsf_unscale_cph(x_mat)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Scale input data — orsf_scale_cph","text":"x_mat (numeric matrix) matrix values scaled unscaled. Note orsf_unscale_cph accept x_mat inputs attribute containing transform values, added automatically orsf_scale_cph. w_vec (numeric vector) optional vector weights. weights supplied (default), observations equally weighted. supplied, w_vec must length equal nrow(x_mat).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Scale input data — orsf_scale_cph","text":"scaled unscaled x_mat.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Scale input data — orsf_scale_cph","text":"data transformed first subtracting mean multiplying scale. inverse transform can completed using orsf_unscale_cph dividing column corresponding scale adding mean. values means scales stored attribute output returned orsf_scale_cph (see examples)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_scale_cph.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Scale input data — orsf_scale_cph","text":"","code":"x_mat <- as.matrix(pbc_orsf[, c('bili', 'age', 'protime')]) head(x_mat) #> bili age protime #> 1 14.5 58.76523 12.2 #> 2 1.1 56.44627 10.6 #> 3 1.4 70.07255 12.0 #> 4 1.8 54.74059 10.3 #> 5 3.4 38.10541 10.9 #> 7 1.0 55.53457 9.7 x_scaled <- orsf_scale_cph(x_mat) head(x_scaled) #> bili age protime #> [1,] 3.77308887 1.0412574 1.9694656 #> [2,] -0.75476469 0.7719344 -0.1822316 #> [3,] -0.65339483 2.3544852 1.7005035 #> [4,] -0.51823502 0.5738373 -0.5856748 #> [5,] 0.02240421 -1.3581657 0.2212116 #> [6,] -0.78855464 0.6660494 -1.3925613 attributes(x_scaled) # note the transforms attribute #> $dim #> [1] 276 3 #> #> $dimnames #> $dimnames[[1]] #> NULL #> #> $dimnames[[2]] #> [1] \"bili\" \"age\" \"protime\" #> #> #> $transforms #> mean scale #> [1,] 3.333696 0.3378995 #> [2,] 49.799661 0.1161396 #> [3,] 10.735507 1.3448108 #> x_unscaled <- orsf_unscale_cph(x_scaled) head(x_unscaled) #> bili age protime #> [1,] 14.5 58.76523 12.2 #> [2,] 1.1 56.44627 10.6 #> [3,] 1.4 70.07255 12.0 #> [4,] 1.8 54.74059 10.3 #> [5,] 3.4 38.10541 10.9 #> [6,] 1.0 55.53457 9.7 # numeric difference in x_mat and x_unscaled should be practically 0 max(abs(x_mat - x_unscaled)) #> [1] 3.552714e-15"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF summary; univariate — orsf_summarize_uni","title":"ORSF summary; univariate — orsf_summarize_uni","text":"Summarize univariate information ORSF object","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF summary; univariate — orsf_summarize_uni","text":"","code":"orsf_summarize_uni( object, n_variables = NULL, pred_horizon = NULL, pred_type = NULL, importance = NULL, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF summary; univariate — orsf_summarize_uni","text":"object (orsf_fit) trained oblique random survival forest (see orsf). n_variables (integer) many variables summarized? Setting input lower number reduce computation time. pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction importance (character) Indicate method variable importance: 'none': variable importance computed. 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance details methods, see orsf_vi. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF summary; univariate — orsf_summarize_uni","text":"object class 'orsf_summary', includes data importance individual predictors. expected values predictions specific values predictors.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF summary; univariate — orsf_summarize_uni","text":"pred_horizon left unspecified, median value time--event variable object's training data used. recommended always specify prediction horizon, median time may especially meaningful horizon compute predicted risk values . object already variable importance values, can safely bypass computation variable importance function setting importance = 'none'.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_summarize_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"ORSF summary; univariate — orsf_summarize_uni","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 25) # since anova importance was used to make object, it is also # used for ranking variables in the summary, unless we specify # a different type of importance orsf_summarize_uni(object, n_variables = 3) #> #> -- ascites (VI Rank: 1) ----------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.6985772 0.7778961 0.5076467 0.9625396 #> 1 0.5357652 0.5899158 0.3432510 0.7223251 #> #> -- edema (VI Rank: 2) ------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.7023951 0.7910831 0.4997954 0.9625396 #> 0.5 0.5466641 0.5299526 0.3376921 0.7933590 #> 1 0.5309622 0.4879545 0.2887210 0.7964328 #> #> -- bili (VI Rank: 3) -------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0.80 0.7781310 0.8665958 0.6715962 0.9702002 #> 1.40 0.7403634 0.8295737 0.6265314 0.9312644 #> 3.52 0.6284779 0.6885322 0.4583099 0.8284686 #> #> Predicted survival at time t = 1788 for top 3 predictors # if we want to summarize object according to variables # ranked by negation importance, we can compute negation # importance within orsf_summarize_uni() as follows: orsf_summarize_uni(object, n_variables = 3, importance = 'negate') #> #> -- bili (VI Rank: 1) -------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0.80 0.7781310 0.8665958 0.6715962 0.9702002 #> 1.40 0.7403634 0.8295737 0.6265314 0.9312644 #> 3.52 0.6284779 0.6885322 0.4583099 0.8284686 #> #> -- sex (VI Rank: 2) --------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> m 0.6693552 0.7366514 0.4918090 0.8863393 #> f 0.6913549 0.7745463 0.4792209 0.9625396 #> #> -- copper (VI Rank: 3) ------------------------ #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 42.8 0.7336237 0.8276291 0.5793735 0.9659481 #> 74.0 0.7131908 0.7925953 0.5576385 0.9552043 #> 129 0.6693603 0.7372459 0.4720362 0.9062475 #> #> Predicted survival at time t = 1788 for top 3 predictors"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":null,"dir":"Reference","previous_headings":"","what":"Estimate training time — orsf_time_to_train","title":"Estimate training time — orsf_time_to_train","text":"Estimate training time","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Estimate training time — orsf_time_to_train","text":"","code":"orsf_time_to_train(object, n_tree_subset = 50)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Estimate training time — orsf_time_to_train","text":"object untrained aorsf object n_tree_subset (integer) many trees fit order estimate time needed train object. default value 50, usually gives good enough approximation.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Estimate training time — orsf_time_to_train","text":"difftime object.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_time_to_train.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Estimate training time — orsf_time_to_train","text":"","code":"# specify but do not train the model by setting no_fit = TRUE. object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 500, no_fit = TRUE) # grow 50 trees to approximate the time it will take to grow 500 trees time_estimated <- orsf_time_to_train(object, n_tree_subset = 50) print(time_estimated) #> Time difference of 0.1965189 secs # let's see how close the approximation was time_true_start <- Sys.time() fit <- orsf_train(object) time_true_stop <- Sys.time() time_true <- time_true_stop - time_true_start print(time_true) #> Time difference of 0.2333381 secs # error abs(time_true - time_estimated) #> Time difference of 0.03681922 secs"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":null,"dir":"Reference","previous_headings":"","what":"ORSF variable importance — orsf_vi","title":"ORSF variable importance — orsf_vi","text":"Estimate importance individual variables using oblique random survival forests.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"ORSF variable importance — orsf_vi","text":"","code":"orsf_vi( object, group_factors = TRUE, importance = NULL, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_negate( object, group_factors = TRUE, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_permute( object, group_factors = TRUE, oobag_fun = NULL, n_thread = 1, verbose_progress = FALSE, ... ) orsf_vi_anova(object, group_factors = TRUE, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"ORSF variable importance — orsf_vi","text":"object (orsf_fit) trained oblique random survival forest (see orsf). group_factors (logical) TRUE, importance factor variables reported overall aggregating importance individual levels factor. FALSE, importance individual factor levels returned. importance (character) Indicate method variable importance: 'anova': compute analysis variance (ANOVA) importance 'negate': compute negation importance 'permute': compute permutation importance oobag_fun (function) used evaluating --bag prediction accuracy negating coefficients (importance = 'negate') permuting values predictor (importance = 'permute') oobag_fun = NULL (default), Harrell's C-statistic (1982) used evaluate accuracy. use oobag_fun note following: oobag_fun two inputs: y_mat s_vec y_mat two column matrix first column named 'time', second named 'status' s_vec numeric vector containing predicted survival probabilities. oobag_fun return numeric output length 1 oobag_fun used created object initial value --bag prediction accuracy consistent values computed variable importance estimated. details, see --bag vignette. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"ORSF variable importance — orsf_vi","text":"orsf_vi functions return named numeric vector. Names vector predictor variables used object Values vector estimated importance given predictor. returned vector sorted highest lowest value, higher values indicating higher importance.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"ORSF variable importance — orsf_vi","text":"orsf_fit object fitted importance = 'anova', 'negate', 'permute', output vector importance values based requested type importance. However, may still want call orsf_vi() output want group factor levels one overall importance value. orsf_vi() general purpose function extract compute variable importance estimates 'orsf_fit' object (see orsf). orsf_vi_negate(), orsf_vi_permute(), orsf_vi_anova() wrappers orsf_vi(). way functions work depends whether object given already variable importance estimates (see examples).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"variable-importance-methods","dir":"Reference","previous_headings":"","what":"Variable importance methods","title":"ORSF variable importance — orsf_vi","text":"negation importance: variable assessed separately multiplying variable's coefficients -1 determining much model's performance changes. worse model's performance negating coefficients given variable, important variable. technique promising b/c require permutation emphasizes variables larger coefficients linear combinations, also relatively new studied much permutation importance. See Jaeger, (2023) details technique. permutation importance: variable assessed separately randomly permuting variable's values determining much model's performance changes. worse model's performance permuting values given variable, important variable. technique flexible, intuitive, frequently used. also several known limitations analysis variance (ANOVA) importance: p-value computed coefficient linear combination variables decision tree. Importance individual predictor variable proportion times p-value coefficient < 0.01. technique efficient computationally, may effective permutation negation terms selecting signal noise variables. See Menze, 2011 details technique.","code":""},{"path":[]},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"anova-importance","dir":"Reference","previous_headings":"","what":"ANOVA importance","title":"ORSF variable importance — orsf_vi","text":"default variable importance technique, ANOVA, calculated fit ORSF ensemble. ANOVA default fast, may decisive permutation negation techniques variable selection.","code":"fit <- orsf(pbc_orsf, Surv(time, status) ~ . - id) fit ## ---------- Oblique random survival forest ## ## Linear combinations: Accelerated Cox regression ## N observations: 276 ## N events: 111 ## N trees: 500 ## N predictors total: 17 ## N predictors per node: 5 ## Average leaves per tree: 21.114 ## Min observations in leaf: 5 ## Min events in leaf: 1 ## OOB stat value: 0.84 ## OOB stat type: Harrell's C-index ## Variable importance: anova ## ## -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"raw-vi-values","dir":"Reference","previous_headings":"","what":"Raw VI values","title":"ORSF variable importance — orsf_vi","text":"‘raw’ variable importance values can accessed fit object ‘raw’ values factors aggregated single value. Currently one value k-1 levels k level factor. example, can see edema_1 edema_0.5 importance values edema factor variable levels 0, 0.5, 1.","code":"attr(fit, 'importance_values') ## NULL"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"collapse-vi-across-factor-levels","dir":"Reference","previous_headings":"","what":"Collapse VI across factor levels","title":"ORSF variable importance — orsf_vi","text":"get aggregated values across levels factor, access importance element orsf fit: use orsf_vi() group_factors set TRUE (default) Note can make default returned importance values ungrouped setting group_factors FALSE orsf_vi functions orsf function.","code":"fit$importance ## ascites bili edema copper age albumin protime ## 0.49306931 0.40601166 0.30339953 0.26839623 0.26685796 0.25804901 0.22825024 ## chol stage ast spiders hepato sex trig ## 0.19290780 0.18941048 0.17435648 0.16943522 0.15678670 0.13905325 0.12965799 ## alk.phos platelet trt ## 0.11338661 0.09012876 0.06778770 orsf_vi(fit) ## ascites bili edema copper age albumin protime ## 0.49306931 0.40601166 0.30339953 0.26839623 0.26685796 0.25804901 0.22825024 ## chol stage ast spiders hepato sex trig ## 0.19290780 0.18941048 0.17435648 0.16943522 0.15678670 0.13905325 0.12965799 ## alk.phos platelet trt ## 0.11338661 0.09012876 0.06778770"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"add-vi-to-an-orsf","dir":"Reference","previous_headings":"","what":"Add VI to an ORSF","title":"ORSF variable importance — orsf_vi","text":"can fit ORSF without VI, add VI later","code":"fit_no_vi <- orsf(pbc_orsf, Surv(time, status) ~ . - id, importance = 'none') # Note: you can't call orsf_vi_anova() on fit_no_vi because anova # VI can only be computed while the forest is being grown. orsf_vi_negate(fit_no_vi) ## bili copper sex protime albumin age ## 0.122344895 0.047850279 0.035986359 0.023711711 0.021831451 0.021503160 ## stage ascites chol ast spiders hepato ## 0.019718835 0.012550534 0.011115307 0.009845811 0.007601474 0.007055077 ## edema trt alk.phos trig platelet ## 0.006411580 0.003666224 0.002388178 0.001156845 -0.001214167 orsf_vi_permute(fit_no_vi) ## bili copper protime age ascites ## 5.513908e-02 2.181846e-02 1.246900e-02 1.192659e-02 1.176139e-02 ## albumin stage chol spiders edema ## 1.175554e-02 9.479348e-03 6.215674e-03 5.752179e-03 4.960035e-03 ## ast hepato sex trig alk.phos ## 4.647971e-03 3.594325e-03 2.477936e-03 1.162558e-03 6.778008e-05 ## platelet trt ## -1.132546e-03 -1.376816e-03"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"orsf-and-vi-all-at-once","dir":"Reference","previous_headings":"","what":"ORSF and VI all at once","title":"ORSF variable importance — orsf_vi","text":"fit ORSF compute vi time can still get negation VI fit, needs computed","code":"fit_permute_vi <- orsf(pbc_orsf, Surv(time, status) ~ . - id, importance = 'permute') # get the vi instantly (i.e., it doesn't need to be computed again) orsf_vi_permute(fit_permute_vi) ## bili copper protime albumin age ## 0.0582460338 0.0255992039 0.0130100780 0.0129532316 0.0121027391 ## ascites stage chol ast edema ## 0.0119289124 0.0084185175 0.0071302967 0.0053592731 0.0051471990 ## spiders hepato sex trig alk.phos ## 0.0046418826 0.0036776097 0.0026334550 0.0024978806 0.0013078222 ## platelet trt ## 0.0003504423 -0.0013892173 orsf_vi_negate(fit_permute_vi) ## bili copper sex protime age albumin ## 0.1259391254 0.0507141085 0.0363834330 0.0235136073 0.0233592840 0.0225371677 ## stage chol ascites ast spiders edema ## 0.0211978251 0.0141956334 0.0141890702 0.0108977272 0.0073762768 0.0070333453 ## hepato alk.phos trig trt platelet ## 0.0050661672 0.0048879157 0.0044980321 0.0039418881 0.0007189274"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vi.html","id":"references","dir":"Reference","previous_headings":"","what":"References","title":"ORSF variable importance — orsf_vi","text":"Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating Yield Medical Tests. JAMA 1982; 247(18):2543-2546. DOI: 10.1001/jama.1982.03320430047030 Breiman L. Random forests. Machine learning 2001 Oct; 45(1):5-32. DOI: 10.1023/:1010933404324 Menze BH, Kelm BM, Splitthoff DN, Koethe U, Hamprecht FA. oblique random forests. Joint European Conference Machine Learning Knowledge Discovery Databases 2011 Sep 4; pp. 453-469. DOI: 10.1007/978-3-642-23783-6_29 Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey , Pajewski NM. Accelerated interpretable oblique random survival forests. Journal Computational Graphical Statistics Published online 08 Aug 2023. DOI: 10.1080/10618600.2023.2231048","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":null,"dir":"Reference","previous_headings":"","what":"Variable selection — orsf_vs","title":"Variable selection — orsf_vs","text":"Variable selection","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Variable selection — orsf_vs","text":"","code":"orsf_vs(object, n_predictor_min = 3, verbose_progress = FALSE)"},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Variable selection — orsf_vs","text":"object (orsf_fit) trained oblique random survival forest (see orsf). n_predictor_min (integer) minimum number predictors allowed verbose_progress (logical) implemented yet. progress printed console?","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Variable selection — orsf_vs","text":"data.table four columns: n_predictors: number predictors used stat_value: --bag statistic predictors_included: names predictors included predictor_dropped: predictor selected dropped","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Variable selection — orsf_vs","text":"tree_seeds specified object successive run orsf evaluated --bag samples initial run.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/orsf_vs.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Variable selection — orsf_vs","text":"","code":"object <- orsf(formula = time + status ~ ., data = pbc_orsf, n_tree = 25, importance = 'anova') orsf_vs(object, n_predictor_min = 15) #> n_predictors stat_value predictors_included #> 1: 15 0.8431168 age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... #> 2: 16 0.8213969 age,sex_f,ascites_1,hepato_1,spiders_1,edema_0.5,... #> 3: 17 0.8266056 id,age,sex_f,ascites_1,hepato_1,spiders_1,... #> 4: 18 0.8263972 id,trt_placebo,age,sex_f,ascites_1,hepato_1,... #> predictor_dropped #> 1: spiders_1 #> 2: alk.phos #> 3: id #> 4: trt_placebo"},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"data light modification survival::pbc data. modifications :","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"","code":"pbc_orsf"},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"format","dir":"Reference","previous_headings":"","what":"Format","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"data frame 276 rows 20 variables: id case number time number days registration earlier death, transplantion, study analysis July, 1986 status status endpoint, 0 censored transplant, 1 dead trt randomized treatment group: D-penicillmain placebo age years sex m/f ascites presence ascites hepato presence hepatomegaly enlarged liver spiders blood vessel malformations skin edema 0 edema, 0.5 untreated successfully treated, 1 edema despite diuretic therapy bili serum bilirubin (mg/dl) chol serum cholesterol (mg/dl) albumin serum albumin (g/dl) copper urine copper (ug/day) alk.phos alkaline phosphotase (U/liter) ast aspartate aminotransferase, called SGOT (U/ml) trig triglycerides (mg/dl) platelet platelet count protime standardized blood clotting time stage histologic stage disease (needs biopsy)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"source","dir":"Reference","previous_headings":"","what":"Source","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"T Therneau P Grambsch (2000), Modeling Survival Data: Extending Cox Model, Springer-Verlag, New York. ISBN: 0-387-98784-3.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/pbc_orsf.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Mayo Clinic Primary Biliary Cholangitis Data — pbc_orsf","text":"removed rows missing data converted status 0 censor transplant, 1 dead converted stage ordered factor. converted trt, ascites, hepato, spiders, edema factors.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":null,"dir":"Reference","previous_headings":"","what":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"data copied lightly modified penguins data palmerpenguins R package. modification removal rows missing data. data include measurements penguin species, island Palmer Archipelago, size (flipper length, body mass, bill dimensions), sex.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"","code":"penguins_orsf"},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"format","dir":"Reference","previous_headings":"","what":"Format","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"tibble 333 rows 8 variables: species factor denoting penguin species (Adélie, Chinstrap Gentoo) island factor denoting island Palmer Archipelago, Antarctica (Biscoe, Dream Torgersen) bill_length_mm number denoting bill length (millimeters) bill_depth_mm number denoting bill depth (millimeters) flipper_length_mm integer denoting flipper length (millimeters) body_mass_g integer denoting body mass (grams) sex factor denoting penguin sex (female, male) year integer denoting study year (2007, 2008, 2009)","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/penguins_orsf.html","id":"source","dir":"Reference","previous_headings":"","what":"Source","title":"Size measurements for adult foraging penguins near Palmer Station, Antarctica — penguins_orsf","text":"Adélie penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Adélie penguins (Pygoscelis adeliae) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 5. Environmental Data Initiative. doi:10.6073/pasta/98b16d7d563f265cb52372c8ca99e60f Gentoo penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Gentoo penguin (Pygoscelis papua) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 5. Environmental Data Initiative. doi:10.6073/pasta/7fca67fb28d56ee2ffa3d9370ebda689 Chinstrap penguins: Palmer Station Antarctica LTER K. Gorman. 2020. Structural size measurements isotopic signatures foraging among adult male female Chinstrap penguin (Pygoscelis antarcticus) nesting along Palmer Archipelago near Palmer Station, 2007-2009 ver 6. Environmental Data Initiative. doi:10.6073/pasta/c14dfcfada8ea13a17536e73eb6fbe9e Originally published : Gorman KB, Williams TD, Fraser WR (2014) Ecological Sexual Dimorphism Environmental Variability within Community Antarctic Penguins (Genus Pygoscelis). PLoS ONE 9(3): e90081. doi:10.1371/journal.pone.0090081","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":null,"dir":"Reference","previous_headings":"","what":"Compute predictions using ORSF — predict.ObliqueForest","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"Predicted risk, survival, hazard, mortality ORSF model.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"","code":"# S3 method for ObliqueForest predict( object, new_data, pred_horizon = NULL, pred_type = NULL, na_action = \"fail\", boundary_checks = TRUE, n_thread = 1, verbose_progress = FALSE, pred_aggregate = TRUE, ... )"},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"object (orsf_fit) trained oblique random survival forest (see orsf). new_data data.frame, tibble, data.table compute predictions . pred_horizon (double) value vector indicating time(s) predictions calibrated . E.g., predicting risk incident heart failure within next 10 years, pred_horizon = 10. pred_horizon can NULL pred_type 'mort', since mortality predictions aggregated event times pred_type (character) type predictions compute. Valid options 'risk' : probability event pred_horizon. 'surv' : 1 - risk. 'chf': cumulative hazard function 'mort': mortality prediction na_action (character) happen new_data contains missing values (.e., NA values). Valid options : 'fail' : error thrown new_data contains NA values 'pass' : output NA rows new_data 1 NA value predictors used object 'omit' : rows new_data incomplete data dropped 'impute_meanmode' : missing values continuous categorical variables new_data imputed using mean mode, respectively. clarify, mean mode used impute missing values training data object, new_data. boundary_checks (logical) TRUE, pred_horizon checked make sure requested values less maximum observed time object's training data. FALSE, checks skipped. n_thread (integer) number threads use computing predictions. Default one thread. use maximum number threads system provides concurrent execution, set n_thread = 0. verbose_progress (logical) TRUE, progress messages printed console. FALSE (default), nothing printed. pred_aggregate (logical) TRUE (default), predictions aggregated trees taking mean. FALSE, returned output contain one row per observation one column tree. length pred_horizon two pred_aggregate FALSE, result list matrices, 'th item list corresponding 'th value pred_horizon. ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"matrix predictions. Column j matrix corresponds value j pred_horizon. Row matrix corresponds row new_data.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"details","dir":"Reference","previous_headings":"","what":"Details","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"new_data must columns equivalent types data used train object. Also, factors new_data must levels data used train object. pred_horizon values exceed maximum follow-time object's training data, truly want , set boundary_checks = FALSE can use pred_horizon large want. Note predictions beyond maximum follow-time object's training data equal predictions maximum follow-time, aorsf estimate survival beyond maximum observed time. unspecified, pred_horizon may automatically specified value used oobag_pred_horizon object created (see orsf).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/predict.ObliqueForest.html","id":"examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Compute predictions using ORSF — predict.ObliqueForest","text":"Begin fitting ORSF ensemble: Predict risk, survival, cumulative hazard one several times: Predict mortality, defined number events forest’s population observations characteristics like current observation. type prediction require specify prediction horizon","code":"library(aorsf) set.seed(329730) index_train <- sample(nrow(pbc_orsf), 150) pbc_orsf_train <- pbc_orsf[index_train, ] pbc_orsf_test <- pbc_orsf[-index_train, ] fit <- orsf(data = pbc_orsf_train, formula = Surv(time, status) ~ . - id, oobag_pred_horizon = 365.25 * 5) # predicted risk, the default predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'risk', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.45965512 0.73309199 0.89715078 ## [2,] 0.03235764 0.09091330 0.18045864 ## [3,] 0.12091603 0.25919883 0.39403239 ## [4,] 0.01488893 0.03745896 0.07571412 ## [5,] 0.01279842 0.02623832 0.06015808 # predicted survival, i.e., 1 - risk predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'surv', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.5403449 0.2669080 0.1028492 ## [2,] 0.9676424 0.9090867 0.8195414 ## [3,] 0.8790840 0.7408012 0.6059676 ## [4,] 0.9851111 0.9625410 0.9242859 ## [5,] 0.9872016 0.9737617 0.9398419 # predicted cumulative hazard function # (expected number of events for person i at time j) predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'chf', pred_horizon = c(500, 1000, 1500)) ## [,1] [,2] [,3] ## [1,] 0.65381651 1.28606246 1.75476570 ## [2,] 0.03531788 0.10967272 0.24697387 ## [3,] 0.15371784 0.36989220 0.65462524 ## [4,] 0.01549537 0.04229610 0.09352493 ## [5,] 0.01290261 0.02687956 0.06916273 predict(fit, new_data = pbc_orsf_test[1:5, ], pred_type = 'mort') ## [,1] ## [1,] 79.795533 ## [2,] 22.393743 ## [3,] 38.749709 ## [4,] 13.552788 ## [5,] 9.984989"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":null,"dir":"Reference","previous_headings":"","what":"Inspect your ORSF model — print.ObliqueForest","title":"Inspect your ORSF model — print.ObliqueForest","text":"Printing ORSF model tells : Linear combinations: identified? N observations: Number rows training data N events: Number events training data N trees: Number trees forest N predictors total: Total number columns predictor matrix N predictors per node: Number variables used linear combinations Average leaves per tree: proxy depth trees Min observations leaf: See leaf_min_obs orsf Min events leaf: See leaf_min_events orsf OOB stat value: --bag error fitting trees OOB stat type: --bag error computed? Variable importance: variable importance computed?","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Inspect your ORSF model — print.ObliqueForest","text":"","code":"# S3 method for ObliqueForest print(x, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Inspect your ORSF model — print.ObliqueForest","text":"x (orsf_fit) oblique random survival forest (ORSF; see orsf). ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Inspect your ORSF model — print.ObliqueForest","text":"x, invisibly.","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.ObliqueForest.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Inspect your ORSF model — print.ObliqueForest","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id, n_tree = 5) print(object) #> ---------- Oblique random survival forest #> #> Linear combinations: Accelerated Cox regression #> N observations: 276 #> N events: 111 #> N trees: 5 #> N predictors total: 17 #> N predictors per node: 5 #> Average leaves per tree: 19.8 #> Min observations in leaf: 5 #> Min events in leaf: 1 #> OOB stat value: 0.76 #> OOB stat type: Harrell's C-index #> Variable importance: anova #> #> -----------------------------------------"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":null,"dir":"Reference","previous_headings":"","what":"Print ORSF summary — print.orsf_summary_uni","title":"Print ORSF summary — print.orsf_summary_uni","text":"Print ORSF summary","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"ref-usage","dir":"Reference","previous_headings":"","what":"Usage","title":"Print ORSF summary — print.orsf_summary_uni","text":"","code":"# S3 method for orsf_summary_uni print(x, n_variables = NULL, ...)"},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"arguments","dir":"Reference","previous_headings":"","what":"Arguments","title":"Print ORSF summary — print.orsf_summary_uni","text":"x object class 'orsf_summary' n_variables number variables print ... arguments passed methods (currently used).","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"value","dir":"Reference","previous_headings":"","what":"Value","title":"Print ORSF summary — print.orsf_summary_uni","text":"invisibly, x","code":""},{"path":"https://bcjaeger.github.io/aorsf/reference/print.orsf_summary_uni.html","id":"ref-examples","dir":"Reference","previous_headings":"","what":"Examples","title":"Print ORSF summary — print.orsf_summary_uni","text":"","code":"object <- orsf(pbc_orsf, Surv(time, status) ~ . - id) smry <- orsf_summarize_uni(object, n_variables = 3) print(smry) #> #> -- ascites (VI Rank: 1) ----------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.6914649 0.7872515 0.4616078 0.9362258 #> 1 0.5213949 0.5816831 0.3364211 0.7130168 #> #> -- bili (VI Rank: 2) -------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0.80 0.7547110 0.8421022 0.6093138 0.9420232 #> 1.40 0.7356315 0.8169133 0.5716575 0.9264993 #> 3.52 0.6362687 0.6947275 0.4532841 0.8392213 #> #> -- edema (VI Rank: 3) ------------------------- #> #> |-------------- Survival --------------| #> Value Mean Median 25th % 75th % #> 0 0.6971149 0.7986289 0.4863726 0.9372551 #> 0.5 0.5944294 0.6334475 0.3869436 0.7921139 #> 1 0.5915448 0.6250744 0.3754279 0.8237650 #> #> Predicted survival at time t = 1788 for top 3 predictors"},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-012-unreleased","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.2 (unreleased)","title":"aorsf 0.1.2 (unreleased)","text":"Added orsf_control functions classification, regression, survival (https://github.com/ropensci/aorsf/pull/25). optimization implemented matrix multiplication prediction (https://github.com/ropensci/aorsf/pull/20)","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-011","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.1","title":"aorsf 0.1.1","text":"CRAN release: 2023-10-26 fixed uninitialized value pd_type","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-010","dir":"Changelog","previous_headings":"","what":"aorsf 0.1.0","title":"aorsf 0.1.0","text":"CRAN release: 2023-10-13 Re-worked internal C++ routines following design ranger. Re-worked progress printed console verbose_progress TRUE, following design ranger. Messages now indicate action taken, % complete, approximate time finishing action. Improved variable importance, following design ranger. Importance now computed tree--tree instead aggregate. Additionally, mortality type prediction used importance survival trees, since mortality depend pred_horizon. Allowed multi-threading performed orsf(), predict.orsf_fit(), functions orsf_vi() orsf_pd() family. Allowed sampling without replacement sampling specific fraction observations orsf() Included Harrell’s C-statistic option assessing goodness splits growing trees. Fixed issue uninformative error message occur pred_horizon > max(time) orsf_summarize_uni. Thanks @JyHao1 @DustinMLong finding !","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-007","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.7","title":"aorsf 0.0.7","text":"CRAN release: 2023-01-12 Additional changes internal testing avoid problems ATLAS","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-006","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.6","title":"aorsf 0.0.6","text":"CRAN release: 2023-01-06 Minor fix internal tests failing run ATLAS","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-005","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.5","title":"aorsf 0.0.5","text":"CRAN release: 2022-12-14 orsf() longer throws errors warnings try give single predictor. note added documentation details ?orsf explains using single predictor orsf() somewhat useless. done resolve https://github.com/mlr-org/mlr3extralearners/issues/259. predict.orsf_fit now accepts pred_horizon = 0 returns sensible values. Thanks @mattwarkentin feature request. added function perform variable selection, orsf_vs(). Made variable importance consistent respect group_factors. Originally, output orsf ungrouped VI values orsf_vi grouped values. update, orsf defaults grouped values. ungrouped values can still recovered. Fixed issue orsf_pd functions output data returned original scale.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-004","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.4","title":"aorsf 0.0.4","text":"CRAN release: 2022-11-07 orsf formulas now accepts Surv objects (see https://github.com/ropensci/aorsf/issues/11) Added verbose_progress input orsf, prints messages console indicating progress. Allowance missing values orsf. Mean mode imputation performed observations missing data. values can also used impute new data missing values. Centering scaling predictors now done prior growing forest.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-003","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.3","title":"aorsf 0.0.3","text":"CRAN release: 2022-10-09 Included rOpenSci reviewers Christopher Jackson, Marvin N Wright, Lukas Burk DESCRIPTION reviewers. Thank ! Added clarification docs pros/cons different variable importance techniques Added regression tests aorsf versus obliqueRSF (similar) Additional support tests functions long right hand sides Updated --bag vignette appropriate custom functions. Allow status values input data general, .e., just 0 1. Allow missing values predict functions, including partial dependence.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-002","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.2","title":"aorsf 0.0.2","text":"CRAN release: 2022-09-05 Modified unit tests compatibility extra checks run CRAN.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-001","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.1","title":"aorsf 0.0.1","text":"CRAN release: 2022-08-23 Added orsf_control_custom(), allows users submit custom functions identifying linear combinations inputs growing oblique decision trees. Added weights input orsf, allowing users fit orsf specific data training set. Added chf mort options predict.orsf_fit(). Mortality predictions fully implemented yet - supported partial dependence --bag error estimates. features added future update.","code":""},{"path":"https://bcjaeger.github.io/aorsf/news/index.html","id":"aorsf-0009000","dir":"Changelog","previous_headings":"","what":"aorsf 0.0.0.9000","title":"aorsf 0.0.0.9000","text":"Core features implemented: fit, interpret, predict using oblique random survival forests. Vignettes + Readme covering usage core features. Website hosted GitHub pages, managed pkgdown.","code":""}]