What is tree pruning and how does it work?

This article gives the knowledge of decision tree pruning and how the decision tree pruning work, details study about approaches of tree pruning Postpruning and Prepruning. The Tree Prunnig is defined in details and the approaches uses for tree pruning is describe.

Tree Pruning

The Tree Pruning is used when the decision tree is built, because of the in Tree Pruning the remove the branches which reflect anomalies in the training data set's due to noise or outliers. The Tree Pruning methods address the anomalies in the training data set's of over fitting the data. In Tree Pruning method by using statistical measures remove the least reliable branches, as a result the faster classification and an improvement in the ability of tree to correctly classify independent test data's.
Finally the main question is the "How does tree pruning is work?"
There are two common approaches to tree pruning: Prepruning and Postpruning.

Prepruning Approach

In the prepruning approach, a tree is 'Pruned' by halting its construction early (Example, by deciding not to further split or partition the subset of training samples at a given node). Upon halting, the node becomes a leaf. The leaf may hold the most frequent class among the subset samples or the probability distribution of those samples. If partitioning the samples at a node would result in a split that falls below a pre-specified threshold value, then further partitioning of the given subset is halted. There are many difficulties, however, in choosing an appropriate threshold standard. High thresholds could result in over-simplified trees, while low thresholds could result in very little simplification.

PostPruning Approach

In Postpruning approach we removes branches from a fully grown tee. A tree node in pruned by removing it's branches. The cost complexity pruning algorithm is an example of the Postpruning approach. The pruned node becomes a leaf and is labeled by the most frequent class among it's former branches. For each non-leaf node in the tree, the algorithm calculates the expected error rate that would occur if the sub-tree at that node were pruned.


By using Tree Pruning approach we can minimizes the expected error rate is preferred. We can prune trees based on the number of bits required to encode them.

The Prepruning and Postpruning may be interleaved for a combined approach. Postpruning requires more computation than Prepruning.

Related Articles

How to take care of Bonsai plants?

This article is all about requirements and supplements needed for a bonsai plant to grow. Bonsai is an art of gardening in which miniature plants are grown in small pots. Though this is a part of Japanese gardening, but nowadays this technique has become very popular in India.

More articles: Bonsai


No responses found. Be the first to comment...

  • Do not include your name, "with regards" etc in the comment. Write detailed comment, relevant to the topic.
  • No HTML formatting and links to other web sites are allowed.
  • This is a strictly moderated site. Absolutely no spam allowed.
  • Name: