{"id":43710,"date":"2024-04-15T21:33:19","date_gmt":"2024-04-15T21:33:19","guid":{"rendered":"https:\/\/exam.pscnotes.com\/mcq\/?p=43710"},"modified":"2024-04-15T21:33:19","modified_gmt":"2024-04-15T21:33:19","slug":"how-to-select-best-hyperparameters-in-tree-based-models","status":"publish","type":"post","link":"https:\/\/exam.pscnotes.com\/mcq\/how-to-select-best-hyperparameters-in-tree-based-models\/","title":{"rendered":"How to select best hyperparameters in tree based models?"},"content":{"rendered":"<p>[amp_mcq option1=&#8221;measure performance over training data&#8221; option2=&#8221;measure performance over validation data&#8221; option3=&#8221;both of these&#8221; option4=&#8221;random selection of hyper parameters&#8221; correct=&#8221;option3&#8243;]<!--more--><\/p>\n<p>The correct answer is C. Both of these.<\/p>\n<p>Hyperparameters are the parameters that control the learning process of a machine learning model. They are not part of the model itself, but they can have a significant impact on the model&#8217;s performance.<\/p>\n<p>There are a number of different ways to select hyperparameters. One common approach is to use a validation set. The validation set is a set of data that is held out from the training process. The model is trained on the training set and then its performance is evaluated on the validation set. The hyperparameters are then adjusted to improve the model&#8217;s performance on the validation set.<\/p>\n<p>Another approach is to use cross-validation. Cross-validation is a technique that divides the training data into multiple subsets. The model is trained on one subset and then its performance is evaluated on the remaining subsets. This process is repeated multiple times, with each subset used once as the validation set. The hyperparameters are then adjusted to improve the model&#8217;s average performance over all of the validation sets.<\/p>\n<p>Random selection of hyperparameters is not a good approach. It is unlikely that the randomly selected hyperparameters will result in a good model. It is better to use a more systematic approach, such as using a validation set or cross-validation.<\/p>\n<p>Here are some additional details about each option:<\/p>\n<ul>\n<li>Option A: Measure performance over training data. This is not a good approach because the training data is used to learn the model. The model will always perform well on the training data, regardless of the hyperparameters.<\/li>\n<li>Option B: Measure performance over validation data. This is a good approach because the validation data is held out from the learning process. The model&#8217;s performance on the validation data is a good indication of how well it will perform on new data.<\/li>\n<li>Option C: Both of these. This is the best approach because it combines the benefits of both options. The model is trained on the training data and then its performance is evaluated on the validation set. The hyperparameters are then adjusted to improve the model&#8217;s performance on the validation set.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>[amp_mcq option1=&#8221;measure performance over training data&#8221; option2=&#8221;measure performance over validation data&#8221; option3=&#8221;both of these&#8221; option4=&#8221;random selection of hyper parameters&#8221; correct=&#8221;option3&#8243;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[729],"tags":[],"class_list":["post-43710","post","type-post","status-publish","format-standard","hentry","category-machine-learning","no-featured-image-padding"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v22.2 (Yoast SEO v23.3) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to select best hyperparameters in tree based models?<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/exam.pscnotes.com\/mcq\/how-to-select-best-hyperparameters-in-tree-based-models\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to select best hyperparameters in tree based models?\" \/>\n<meta property=\"og:description\" content=\"[amp_mcq option1=&#8221;measure performance over training data&#8221; option2=&#8221;measure performance over validation data&#8221; option3=&#8221;both of these&#8221; option4=&#8221;random selection of hyper parameters&#8221; correct=&#8221;option3&#8243;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/exam.pscnotes.com\/mcq\/how-to-select-best-hyperparameters-in-tree-based-models\/\" \/>\n<meta property=\"og:site_name\" content=\"MCQ and Quiz for Exams\" \/>\n<meta property=\"article:published_time\" content=\"2024-04-15T21:33:19+00:00\" \/>\n<meta name=\"author\" content=\"rawan239\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"rawan239\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How to select best hyperparameters in tree based models?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/exam.pscnotes.com\/mcq\/how-to-select-best-hyperparameters-in-tree-based-models\/","og_locale":"en_US","og_type":"article","og_title":"How to select best hyperparameters in tree based models?","og_description":"[amp_mcq option1=&#8221;measure performance over training data&#8221; option2=&#8221;measure performance over validation data&#8221; option3=&#8221;both of these&#8221; option4=&#8221;random selection of hyper parameters&#8221; correct=&#8221;option3&#8243;]","og_url":"https:\/\/exam.pscnotes.com\/mcq\/how-to-select-best-hyperparameters-in-tree-based-models\/","og_site_name":"MCQ and Quiz for Exams","article_published_time":"2024-04-15T21:33:19+00:00","author":"rawan239","twitter_card":"summary_large_image","twitter_misc":{"Written by":"rawan239","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/exam.pscnotes.com\/mcq\/how-to-select-best-hyperparameters-in-tree-based-models\/","url":"https:\/\/exam.pscnotes.com\/mcq\/how-to-select-best-hyperparameters-in-tree-based-models\/","name":"How to select best hyperparameters in tree based models?","isPartOf":{"@id":"https:\/\/exam.pscnotes.com\/mcq\/#website"},"datePublished":"2024-04-15T21:33:19+00:00","dateModified":"2024-04-15T21:33:19+00:00","author":{"@id":"https:\/\/exam.pscnotes.com\/mcq\/#\/schema\/person\/5807dafeb27d2ec82344d6cbd6c3d209"},"breadcrumb":{"@id":"https:\/\/exam.pscnotes.com\/mcq\/how-to-select-best-hyperparameters-in-tree-based-models\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/exam.pscnotes.com\/mcq\/how-to-select-best-hyperparameters-in-tree-based-models\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/exam.pscnotes.com\/mcq\/how-to-select-best-hyperparameters-in-tree-based-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/exam.pscnotes.com\/mcq\/"},{"@type":"ListItem","position":2,"name":"mcq","item":"https:\/\/exam.pscnotes.com\/mcq\/category\/mcq\/"},{"@type":"ListItem","position":3,"name":"Machine learning","item":"https:\/\/exam.pscnotes.com\/mcq\/category\/mcq\/machine-learning\/"},{"@type":"ListItem","position":4,"name":"How to select best hyperparameters in tree based models?"}]},{"@type":"WebSite","@id":"https:\/\/exam.pscnotes.com\/mcq\/#website","url":"https:\/\/exam.pscnotes.com\/mcq\/","name":"MCQ and Quiz for Exams","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/exam.pscnotes.com\/mcq\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/exam.pscnotes.com\/mcq\/#\/schema\/person\/5807dafeb27d2ec82344d6cbd6c3d209","name":"rawan239","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/exam.pscnotes.com\/mcq\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/761a7274f9cce048fa5b921221e7934820d74514df93ef195a9d22af0c1c9001?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/761a7274f9cce048fa5b921221e7934820d74514df93ef195a9d22af0c1c9001?s=96&d=mm&r=g","caption":"rawan239"},"sameAs":["https:\/\/exam.pscnotes.com"],"url":"https:\/\/exam.pscnotes.com\/mcq\/author\/rawan239\/"}]}},"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/exam.pscnotes.com\/mcq\/wp-json\/wp\/v2\/posts\/43710","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/exam.pscnotes.com\/mcq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/exam.pscnotes.com\/mcq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/exam.pscnotes.com\/mcq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/exam.pscnotes.com\/mcq\/wp-json\/wp\/v2\/comments?post=43710"}],"version-history":[{"count":0,"href":"https:\/\/exam.pscnotes.com\/mcq\/wp-json\/wp\/v2\/posts\/43710\/revisions"}],"wp:attachment":[{"href":"https:\/\/exam.pscnotes.com\/mcq\/wp-json\/wp\/v2\/media?parent=43710"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/exam.pscnotes.com\/mcq\/wp-json\/wp\/v2\/categories?post=43710"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/exam.pscnotes.com\/mcq\/wp-json\/wp\/v2\/tags?post=43710"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}