Skip to content
Free planNo credit card requiredStart writing
AI for Research home
AI for Research home
Dashboard
Sign inGet started

Search 250 million research papers

Read the abstract, see who wrote it and who cites it, and get the citation in APA, MLA, Chicago or Harvard.

About 10,000 papers for “machine learning methods”

Machine Learning Methods

Hang Li · 2023

This book provides a systematic introduction to the principal machine learning methods, covering both supervised and unsupervised learning methods

Cited by 20Open access

Machine learning methods.

Emily Gregg (14134332), Clive Beggs (2137552), Athanassios Bissas (17310357) et al. · Figshare · 2023

<div><p>Falls are a significant ongoing public health concern for older adults. At present, few studies have concurrently explored the influence of multiple measures when seeking to determine which variables are most predictive of fall risks. As such, this cross-sectional study aimed to identify those functional variables (i.e. balance, gait and clinical measures) and physical characteristics (i.e. strength and body composition) that could best distinguish between older female fallers and non-fallers, using a machine learning approach. Overall, 60 community-dwelling older women (≥65 years), retrospectively classified as fallers (n = 21) or non-fallers (n = 39), attended three data collection sessions. Data (281 variables) collected from tests in five separate domains (balance, gait, clinical measures, strength and body composition) were analysed using random forest (RF) and leave-one-variable-out partial least squares correlation analysis (LOVO PLSCA) to assess variable importance. The strongest discriminators from each domain were then aggregated into a multi-domain dataset, and RF, LOVO PLSCA, and logistic regression models were constructed to identify the important variables in distinguishing between fallers and non-fallers. These models were used to classify participants as either fallers or non-fallers, with their performance evaluated using receiver operating characteristic (ROC) analysis. The study found that it is possible to classify fallers and non-fallers with a high degree of accuracy (e.g. logistic regression: sensitivity = 90%; specificity = 87%; AUC = 0.92; leave-one-out cross-validation accuracy = 63%) using a combination of 18 variables from four domains, with the gait and strength domains being particularly informative for screening programmes aimed at assessing falls risk.</p></div>

Cited by 0Open access

Machine Learning Methods

Thomas Persson · RePEc: Research Papers in Economics

In high-dimensional regression settings with low signal-to-noise ratios, selecting an appropriate machine learning method is crucial for achieving reliable predictive performance. This study systematically evaluates several prevalent machine learning approaches, including regularised regression techniques (such as Lasso and Ridge), tree-based ensemble methods (such as Random Forest and Gradient Boosting), and neural networks. Through extensive simulations and real-world datasets, we assess their predictive accuracy, robustness to noise, and computational efficiency. Our findings provide insights into the relative strengths and weaknesses of these methods, offering practical guidelines for practitioners working with complex, high-dimensional data characterized by low signal-to-noise ratios.

Cited by 0

Classic Machine Learning Methods

Johann Faouzi, Olivier Colliot · Neuromethods · 2023

Abstract In this chapter, we present the main classic machine learning methods. A large part of the chapter is devoted to supervised learning techniques for classification and regression, including nearest neighbor methods, linear and logistic regressions, support vector machines, and tree-based algorithms. We also describe the problem of overfitting as well as strategies to overcome it. We finally provide a brief overview of unsupervised learning methods, namely, for clustering and dimensionality reduction. The chapter does not cover neural networks and deep learning as these will be presented in Chaps. 3 , 4 , 5 , and 6 .

Cited by 17Open access

Fundamental Machine Learning Methods

Erik Cuevas, Jorge Galvez, Omar Avalos et al. · 2024

This chapter focuses on core machine learning methodologies, particularly those that integrate well with metaheuristic methods, enhancing problem-solving strategies. It examines three fundamental techniques: regression, classification, and clustering. Regression models relationships between variables to predict continuous outcomes, widely used in fields like finance, biology, and engineering. Classification categorizes data into predefined groups, predicting discrete labels for applications such as spam detection and medical diagnostics. Clustering, an unsupervised learning technique, groups objects based on similarity without predefined categories, useful in exploratory data analysis and fields like market research and image analysis. The integration of these machine learning techniques with metaheuristic approaches offers significant improvements in various applications.

Cited by 2Open access

Machine-Learning Applied Methods

Mauricio Palacio, Sebastián · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · 2020

The presented discourse followed several topics where every new chapter introduced an economic prediction problem and showed how traditional approaches can be complemented with new techniques like machine learning and deep learning. These powerful tools combined with principles of economic theory is highly increasing the scope for empiricists. Chapter 3 addressed this discussion. By progressively moving from Ordinary Least Squares, Penalized Linear Regressions and Binary Trees to advanced ensemble trees. Results showed that ML algorithms significantly outperform statistical models in terms of predictive accuracy. Specifically, ML models perform 49-100\\% better than unbiased methods. However, we cannot rely on parameter estimations. For example, Chapter 4 introduced a net prediction problem regarding fraudulent property claims in insurance. Despite the fact that we got extraordinary results in terms of predictive power, the complexity of the problem restricted us from getting behavioral insight. Contrarily, statistical models are easily interpretable. Coefficients give us the sign, the magnitude and the statistical significance. We can learn behavior from marginal impacts and elasticities. Chapter 5 analyzed another prediction problem in the insurance market, particularly, how the combination of self-reported data and risk categorization could improve the detection of risky potential customers in insurance markets. Results were also quite impressive in terms of prediction, but again, we did not know anything about the direction or the magnitude of the features. However, by using a Probit model, we showed the benefits of combining statistic models with ML-DL models. The Probit model let us get generalizable insights on what type of customers are likely to misreport, enhancing our results. Likewise, Chapter 2 is a clear example of how causal inference can benefit from ML and DL methods. These techniques allowed us to capture that 70 days before each auction there were abnormal behaviors in daily prices. By doing so, we could apply a solid statistical model and we could estimate precisely what the net effect of the mandated auctions in Spain was. This thesis aims at combining advantages of both methodologies, machine learning and econometrics, boosting their strengths and attenuating their weaknesses. Thus, we used ML and statistical methods side by side, exploring predictive performance and interpretability.\n\n\t\t\t\t Several conditions can be inferred from the nature of both approaches. First, as we have observed throughout the chapters, ML and traditional econometric approaches solve fundamentally different problems. We use ML and DL techniques to predict, not in terms of traditional forecast, but making our models generalizable to unseen data. On the other hand, traditional econometrics has been focused on causal inference and parameter estimation. Therefore, ML is not replacing traditional techniques, but rather complementing them. Second, ML methods focus in out-of-sample data instead of in-sample data, while statistical models typically focus on goodness-of-fit. It is then not surprising that ML techniques consistently outperformed traditional techniques in terms of predictive accuracy. The cost is then biased estimators. Third, the tradition in economics has been to choose a unique model based on theoretical principles and to fit the full dataset on it and, in consequence, obtaining unbiased estimators and their respective confidence intervals. On the other hand, ML relies on data driven selection models, and does not consider causal inference. Instead of manually choosing the covariates, the functional form is determined by the data. This also translates to the main weakness of ML, which is the lack of inference of the underlying data-generating process. I.e. we cannot derive economically meaningful conclusions from the coefficients. Focusing on out-of-sample performance comes at the expense of the ability to infer causal effects, due to the lack of standard errors on the coefficients. Therefore, predictors are typically biased, and estimators may not be normally distributed. Thus, we can conclude that in terms of out-sample performance it is hard to compete against ML models. However, ML cannot contend with the powerful insights that the causal inference analysis gives us, which allow us not only to get the most important variables and their magnitude but also the ability to understand economic behaviors.

Cited by 0Open access

Robust machine learning methods

Osama, Muhammad · KTH Publication Database DiVA (KTH Royal Institute of Technology) · 2022

We are surrounded by data in our daily lives. The rent of our houses, the amount of electricity units consumed, the prices of different products at a supermarket, the daily temperature, our medicine prescriptions, our internet search history are all different forms of data. Data can be used in a wide range of applications. For example, one can use data to predict product prices in the future; to predict tomorrow's temperature; to recommend videos; or suggest better prescriptions. However in order to do the above, one is required to learn a model from data. A model is a mathematical description of how the phenomena we are interested in behaves e.g. how does the temperature vary? Is it periodic? What kinds of patterns does it have? Machine learning is about this process of learning models from data by building on disciplines such as statistics and optimization. Learning models comes with many different challenges. Some challenges are related to how flexible the model is, some are related to the size of data, some are related to computational efficiency etc. One of the challenges is that of data outliers. For instance, due to war in a country exports could stop and there could be a sudden spike in prices of different products. This sudden jump in prices is an outlier or corruption to the normal situation and must be accounted for when learning the model. Another challenge could be that data is collected in one situation but the model is to be used in another situation. For example, one might have data on vaccine trials where the participants were mostly old people. But one might want to make a decision on whether to use the vaccine or not for the whole population that contains people of all age groups. So one must also account for this difference when learning models because the conclusion drawn may not be valid for the young people in the population. Yet another challenge could arise when data is collected from different sources or contexts. For example, a shopkeeper might have data on sales of paracetamol when there was flu and when there was no flu and she might want to decide how much paracetamol to stock for the next month. In this situation, it is difficult to know whether there will be a flu next month or not and so deciding on how much to stock is a challenge. This thesis tries to address these and other similar challenges. In paper I, we address the challenge of data corruption i.e., learning models in a robust way when some fraction of the data is corrupted. In paper II, we apply the methodology of paper I to the problem of localization in wireless networks. Paper III addresses the challenge of estimating causal effect between an exposure and an outcome variable from spatially collected data (e.g. whether increasing number of police personnel in an area reduces number of crimes there). Paper IV addresses the challenge of learning improved decision policies e.g. which treatment to assign to which patient given past data on treatment assignments. In paper V, we look at the challenge of learning models when data is acquired from different contexts and the future context is unknown. In paper VI, we address the challenge of predicting count data across space e.g. number of crimes in an area and quantify its uncertainty. In paper VII, we address the challenge of learning models when data points arrive in a streaming fashion i.e., point by point. The proposed method enables online training and also yields some robustness properties.

Cited by 0Open access