'[Wekalist] Some Questions About Random Forests'

[prev in list] [next in list] [prev in thread] [next in thread] 

List:       wekalist
Subject:    [Wekalist] Some Questions About Random Forests
From:       Alhamza Munther <alhamza80 () yahoo ! com>
Date:       2013-12-18 4:18:11
Message-ID: 1387340291.74897.YahooMailNeo () web163105 ! mail ! bf1 ! yahoo ! com
[Download RAW message or body]

[Attachment #2 (multipart/alternative)]

Dear all Wekalist members,

I have some questions about Random Forests
Algorithm as below:

1.  Can we visualize forests as in C4.5 tree? In other words, in
C4.5 after classified the data we can easily visualize the tree (by R-click on
J48 classifier and the select visualize tree) but with random forest this
option not available is there any way to visualize random forests?

2.  What is the type of random forests that is used in Weka? Where
in the main random forest algorithm that is proposed by (Leo Breiman 2001) he offered
different types of random forests called Forest-RI, Forest-RC each one has different
input selection (number of picked data to training it).

3.    Also I am confusing in one more thing. I have dataset with more
than 200 features and thousands of instances once I used Random forests to
classify it working well and gave a good results but it selected only 10 random
features from 200 to construct trees and based on my knowledge   random forests \
algorithm don't use feature selection. It selects sub features randomly from the main \
set of features to construct each tree. So why it selected only 10 features and \
ignored the rest features what are the criteria of selection?

4.  Anyone has tried to use Random MultiNomial Logit in Weka? Which
is proposed by Anita Prinzie? Details in this article: Random Forests for
multiclass classiﬁcation: Random MultiNomial Logit.

Your help and
time is greatly appreciated.
Have a nice
day for all
Alhamza

[Attachment #5 (text/html)]

<html><body><div style="color:#000; background-color:#fff; font-family:times new \
roman, new york, times, serif;font-size:10pt"><div class="MsoNormal" \
style="margin-bottom: 0.0001pt; text-align: justify;"><span style="font-size: 13px; \
font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', \
sans-serif;">Dear all Wekalist members,<o:p></o:p></span></div><div class="MsoNormal" \
style="margin-bottom: 0.0001pt; text-align: justify;"><o:p style="font-size: small; \
font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', \
sans-serif;">&nbsp;</o:p></div><div class="MsoNormal" style="margin-bottom: 0.0001pt; \
text-align: justify;"><span style="font-size: small; font-family: HelveticaNeue, \
'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif;">I have some \
questions about Random Forests Algorithm as below:<o:p></o:p></span></div><div \
class="MsoNormal" style="margin-bottom: 0.0001pt; text-align: justify;"><span \
style="font-size: small; font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, \
Arial, 'Lucida Grande', sans-serif;"><o:p>&nbsp;</o:p></span></div><div \
class="MsoListParagraphCxSpFirst" style="margin-bottom: 0.0001pt; text-align: \
justify; text-indent: -0.25in;"><span style="font-size: \
small; font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida \
Grande', sans-serif;"><span class="Apple-tab-span" \
style="white-space:pre">	</span>1.<span>&nbsp;</span><span \
dir="LTR"></span>Can we visualize forests as in C4.5 tree? In other words, in C4.5 \
after classified the data we can easily visualize the tree (by R-click on J48 \
classifier and the select visualize tree) but with random forest this option not \
available is there any way to visualize random forests?<o:p></o:p></span></div><div \
class="MsoListParagraphCxSpMiddle" style="margin-bottom: 0.0001pt; text-align: \
justify;"><o:p style="font-size: small; font-family: HelveticaNeue, 'Helvetica Neue', \
Helvetica, Arial, 'Lucida Grande', sans-serif;">&nbsp;</o:p></div><div \
class="MsoListParagraphCxSpLast" style="margin-bottom: 0.0001pt; text-align: justify; \
text-indent: -0.25in;"><span style="font-size: small; \
font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', \
sans-serif;"><span class="Apple-tab-span" \
style="white-space:pre">	</span>2.<span>&nbsp;</span>What is the type of random \
forests that is used in Weka? Where in the main random forest algorithm that is \
proposed by (Leo Breiman 2001) he offered different types of random forests called \
Forest-RI, Forest-RC each one has different input selection (number of picked data to \
training it).<o:p></o:p></span></div><div class="MsoNormal" style="margin-bottom: \
0.0001pt; text-align: justify;"><o:p style="font-size: small; font-family: \
HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', \
sans-serif;">&nbsp;</o:p></div><div class="MsoListParagraph" style="margin-bottom: \
0.0001pt; text-align: justify; text-indent: -0.25in;"><span \
style="font-size: 13px; font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, \
Arial, 'Lucida Grande', sans-serif;"><span class="Apple-tab-span" \
style="white-space:pre">	</span>3.<span>&nbsp;&nbsp;</span>Also I am confusing in one \
more thing. I have dataset with more than 200 features and thousands of instances \
once I used Random forests to classify it working well and gave a good results but it \
selected only 10 random features from 200 to construct trees and based on my \
knowledge &nbsp;random forests algorithm don't use feature selection. It selects sub \
features randomly from the main set of features to construct each tree. So why it \
selected only 10 features and ignored the rest features what are the criteria of \
selection?<o:p></o:p></span></div><div class="MsoNormal" style="margin-bottom: \
0.0001pt; text-align: justify;"><o:p style="font-size: small; font-family: \
HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', \
sans-serif;">&nbsp;</o:p></div><div class="MsoListParagraphCxSpFirst" \
style="margin-bottom: 0.0001pt; text-align: justify; text-indent: -0.25in;"><span style="font-size: small; font-family: HelveticaNeue, \
'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif;"><span \
class="Apple-tab-span" style="white-space:pre">	</span>4.<span>&nbsp;</span>Anyone \
has tried to use Random MultiNomial Logit in Weka? Which is proposed by Anita \
Prinzie? Details in this article: Random Forests for multiclass classiﬁcation: \
Random MultiNomial Logit.<o:p></o:p></span></div><div \
class="MsoListParagraphCxSpMiddle" style="margin-bottom: 0.0001pt; text-align: \
justify;"><o:p style="font-size: small; font-family: HelveticaNeue, 'Helvetica Neue', \
Helvetica, Arial, 'Lucida Grande', sans-serif;">&nbsp;</o:p></div><div \
class="MsoListParagraphCxSpMiddle" style="margin-bottom: 0.0001pt; text-align: \
justify;"><span style="font-size: 13px; font-family: HelveticaNeue, 'Helvetica Neue', \
Helvetica, Arial, 'Lucida Grande', sans-serif;">Your help and time is greatly \
appreciated.<o:p></o:p></span></div><div class="MsoListParagraphCxSpMiddle" \
style="margin-bottom: 0.0001pt; text-align: justify;"><span style="font-size: small; \
font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', \
sans-serif;">Have a nice day for all<o:p></o:p></span></div><div>

</div><div class="MsoListParagraphCxSpLast" style="margin-bottom: 0.0001pt; \
text-align: justify;"><span style="font-size: 13px; font-family: HelveticaNeue, \
'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', \
sans-serif;">Alhamza</span><o:p></o:p></div></div></body></html>

_______________________________________________
Wekalist mailing list
Send posts to: Wekalist@list.waikato.ac.nz
List info and subscription status: http://list.waikato.ac.nz/mailman/listinfo/wekalist
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html

[prev in list] [next in list] [prev in thread] [next in thread] 