🚀 AI Interview Questions with Answers (Part 5)
41. What is the difference between regression and classification?
Regression and classification are two types of supervised learning problems.
Regression
Predicts continuous numerical values.
Output is a number.
Examples: House price prediction, stock price forecasting, sales prediction.
Classification
Predicts discrete categories or labels.
Output is a class.
Examples: Spam detection, disease diagnosis, sentiment analysis.
42. What is clustering, and what are the common clustering algorithms?
Clustering is an unsupervised learning technique that groups similar data points without using labeled data.
Common clustering algorithms:
K-Means
Hierarchical Clustering
DBSCAN
Mean Shift
Applications:
Customer segmentation
Image segmentation
Fraud detection
Document grouping
43. What is dimensionality reduction, and why is it important?
Dimensionality reduction is the process of reducing the number of input features while preserving the most important information.
Benefits:
Reduces training time
Improves model performance
Removes redundant features
Reduces overfitting
Makes data easier to visualize
Popular techniques include PCA and t-SNE.
44. What is Principal Component Analysis (PCA), and how does it work?
Principal Component Analysis (PCA) is a dimensionality reduction technique that transforms correlated features into a smaller set of uncorrelated variables called principal components.
Advantages:
Reduces feature dimensions
Improves computational efficiency
Removes redundancy
Helps visualize high-dimensional data
45. What is hyperparameter tuning, and why is it necessary?
Hyperparameter tuning is the process of finding the best values for parameters that are set before training a model.
Examples of hyperparameters:
Learning rate
Number of trees
Maximum tree depth
Batch size
Number of epochs
Proper tuning improves model accuracy and generalization.
46. What is Grid Search, and how does it optimize model performance?
Grid Search is a hyperparameter optimization technique that tries every possible combination of predefined parameter values.
Advantages:
Finds the optimal parameter combination
Easy to implement
Disadvantages:
Computationally expensive
Slow for large search spaces
47. What is Random Search, and how does it compare to Grid Search?
Random Search randomly selects combinations of hyperparameters instead of testing every possible combination.
Compared to Grid Search:
Faster
Less computationally expensive
Often finds equally good or better results for large parameter spaces
It is commonly used when computational resources are limited.
48. What is AutoML, and what are its benefits?
AutoML (Automated Machine Learning) automates many steps of the Machine Learning workflow, including:
Data preprocessing
Feature engineering
Model selection
Hyperparameter tuning
Model evaluation
Benefits:
Saves time
Reduces manual effort
Makes ML accessible to beginners
Speeds up model development
49. What is ensemble learning, and why is it effective?
Ensemble learning combines predictions from multiple models to produce a more accurate and robust result than a single model.
Advantages:
Higher accuracy
Better generalization
Reduced overfitting
More stable predictions
Popular ensemble methods include Random Forest, XGBoost, LightGBM, and AdaBoost.
50. What is the difference between bagging and boosting?
Bagging (Bootstrap Aggregating)
Trains multiple models independently.
Combines their predictions using voting or averaging.
Reduces variance.
Example: Random Forest.
Boosting
Trains models sequentially, where each new model focuses on correcting the errors of the previous one.
Reduces bias.
Examples: AdaBoost, Gradient Boosting, XGBoost, LightGBM, CatBoost.
Key Difference: Bagging builds independent models in parallel, while boosting builds dependent models sequentially to improve performance.
Double Tap ❤️ For Part-6