首页|Data on Machine Learning Reported by Researchers at University of Mataram (Distributed Machine Learning using HDFS and Apache Spark for Big Data Challenges)
Data on Machine Learning Reported by Researchers at University of Mataram (Distributed Machine Learning using HDFS and Apache Spark for Big Data Challenges)
扫码查看
点击上方二维码区域，可以放大扫码查看
原文链接
NETL
NSTL
Researchers detail new data in artificial intelligence. According to news originating from the University of Mataram by NewsRx editors, the research stated, “Hadoop and Apache Spark have become popular frameworks for distributed big data processing. This research aims to configure Hadoop and Spark for conducting training and testing on big data using distributed machine learning methods with MLlib, including linear regression and multi-linear regression.” The news reporters obtained a quote from the research from University of Mataram: “Additionally, an external library, LSTM, is used for experimentation. The experiments utilize three desktop devices to represent a series of tests on single and multi-node networks. Three datasets, namely bitcoin (3,613,767 rows), gold-price (5,585 rows), and housing-price (23,613 rows), are employed as case studies. The distributed computation tests are conducted by allocating uniform core processors on all three devices and measuring execution times, as well as RMSE and MAPE values. The results of the single-node tests using MLlib (both linear and multi-linear regression) with variations of core utilization ranging from 2 to 16 cores, show that the overall dataset performs optimally using 12 cores, with an execution time of 532.328 seconds. However, in the LSTM method, core allocation variations do not yield significant results and require longer program execution times.”
University of MataramCyborgsEmerging TechnologiesMachine Learning
NETL
NSTL
