Main Content

Deploy Tall Arrays to a Spark Enabled Hadoop Cluster

R2026b
Create and execute MATLAB® applications with tall arrays against a Spark™ enabled Hadoop® cluster

Warning

Support for deploying tall array applications to Spark enabled Hadoop clusters will be removed in a future release.

Supported Platform: Linux® only.

Deploying a MATLAB application that contains tall arrays against a Spark enabled Hadoop cluster consists of two parts:

  • Creating and packaging a standalone application in the MATLAB desktop environment.

  • Executing the standalone application on a Spark enabled Hadoop cluster from a Linux shell.

For a complete example on deploying tall arrays to a Spark enabled Hadoop cluster, see Deploy Tall Arrays to a Spark Enabled Hadoop Cluster. You can follow the same instructions to deploy tall array Spark applications to CLOUDERA® CDH.

Classes

matlab.mapreduce.DeploySparkMapReducer(To be removed) Configure a MATLAB tall array application with Spark parameters as key-value pairs

Functions

mapreducerDefine execution environment for mapreduce or tall arrays

Topics