Grid search with Python

Grid search is a technique used to find the best hyperparameters for a machine learning model. It involves searching through a specified grid of hyperparameters and selecting the combination that results in the best performance. Step 1: Define the hyperparameter grid 
from sklearn.model_selection import GridSearchCV
from sklearn.ensemble import RandomForestClassifier

param_grid = {
    'n_estimators': [50, 100, 200],
    'max_depth': [None, 10, 20],
    'min_samples_split': [2, 5, 10]
}

Step 2: Instantiate the model and GridSearchCV 
rf = RandomForestClassifier()
grid_search = GridSearchCV(estimator=rf, param_grid=param_grid, cv=3, n_jobs=-1)

Step 3: Fit the model to the data 
grid_search.fit(X_train, y_train)

Step 4: Get the best hyperparameters and score 
best_params = grid_search.best_params_
best_score = grid_search.best_score_

print("Best hyperparameters:", best_params)
print("Best score:", best_score)

Comments

Post a Comment

Popular posts from this blog

What is the difference between a module and a package in Python?

In the first example, we are going to explore the concept of a module in Python. A module is a file containing Python code that can define functions, classes, and variables. It allows you to organize your code into reusable components. Here is an example code snippet demonstrating the use of a module in Python: # Create a module named mymodule.py # Define a function inside the module def greet(name): return "Hello, " + name In the code above, we have created a module named mymodule.py that defines a function called greet . This function takes a name as an argument and returns a greeting message. To use this module in another Python script, we can import it using the import keyword. import mymodule message = mymodule.greet("Alice") print(message) When we run the above code, it will import the mymodule module and use the greet function to print a greeting message for the name "Alice". In the second example, we are going to discuss the ...
Read more

What are the different evaluation metrics used in machine learning?

In the first example, we are going to demonstrate how to use accuracy as an evaluation metric in machine learning using Python. Here is the code: from sklearn.metrics import accuracy_score y_true = [0, 1, 1, 0, 1] y_pred = [0, 1, 0, 0, 1] accuracy = accuracy_score(y_true, y_pred) print("Accuracy:", accuracy) Step 1: Import the accuracy_score function from sklearn.metrics. Step 2: Define two lists, y_true and y_pred, containing the true and predicted values. Step 3: Calculate the accuracy score by calling the accuracy_score function with y_true and y_pred as arguments. Step 4: Print out the accuracy score. In the second example, we are going to demonstrate how to use precision and recall as evaluation metrics in machine learning using Python. Here is the code: from sklearn.metrics import precision_score, recall_score y_true = [0, 1, 1, 0, 1] y_pred = [0, 1, 0, 0, 1] precision = precision_score(y_true, y_pred) recall = recall_score(y_true, y_pred) print("Precis...
Read more

Sorting Algorithms in Python? - with practical example

Sorting algorithms are essential tools in computer science to organize data in a specific order. In Python, there are various sorting algorithms available that can be used to arrange elements in a list in a particular sequence. Two common sorting algorithms in Python are Bubble Sort and Merge Sort. Example 1: Bubble Sort Bubble Sort is a simple sorting algorithm that repeatedly steps through the list, compares adjacent elements, and swaps them if they are in the wrong order. This process is repeated until the list is sorted. Step 1: Compare the first two elements of the list. If the first element is greater than the second element, swap them. Step 2: Move to the next pair of elements and repeat the comparison and swapping process until the end of the list. Step 3: Repeat steps 1 and 2 until no more swaps are needed, indicating that the list is sorted. def bubble_sort(arr): n = len(arr) for i in range(n): for j in range(0, n-i-1): if arr[j] > arr[j+1]: ...
Read more