< Back

New-AzureRmHDInsightMapReduceJobDefinition

Tue Jan 29, 2019 9:48 pm

NAME New-AzureRmHDInsightMapReduceJobDefinition



SYNOPSIS

Creates a MapReduce job object.





SYNTAX

New-AzureRmHDInsightMapReduceJobDefinition [-Arguments <String[]>] -ClassName <String> [-DefaultProfile <IAzureContextContainer>] [-Defines

<Hashtable>] [-Files <String[]>] -JarFile <String> [-JobName <String>] [-LibJars <String[]>] [-StatusFolder <String>] [<CommonParameters>]





DESCRIPTION

The New-AzureRmHDInsightMapReduceJobDefinition cmdlet defines a new MapReduce job for use with an Azure HDInsight cluster.





PARAMETERS

-Arguments <String[]>

Specifies an array of arguments for the job. The arguments are passed as command-line arguments to each task.



Required? false

Position? named

Default value None

Accept pipeline input? False

Accept wildcard characters? false



-ClassName <String>

Specifies the job class in the JAR file.



Required? true

Position? named

Default value None

Accept pipeline input? False

Accept wildcard characters? false



-DefaultProfile <IAzureContextContainer>

The credentials, account, tenant, and subscription used for communication with azure



Required? false

Position? named

Default value None

Accept pipeline input? False

Accept wildcard characters? false



-Defines <Hashtable>

Specifies Hadoop configuration values to set for when the job runs.



Required? false

Position? named

Default value None

Accept pipeline input? False

Accept wildcard characters? false



-Files <String[]>

Specifies a collection of files that are associated with a Hive job.



Required? false

Position? named

Default value None

Accept pipeline input? False

Accept wildcard characters? false



-JarFile <String>

Specifies the JAR file to use for the job.



Required? true

Position? named

Default value None

Accept pipeline input? False

Accept wildcard characters? false



-JobName <String>

Specifies the name of the job.



Required? false

Position? named

Default value None

Accept pipeline input? False

Accept wildcard characters? false



-LibJars <String[]>

Specifies the lib JARS for the job.



Required? false

Position? named

Default value None

Accept pipeline input? False

Accept wildcard characters? false



-StatusFolder <String>

Specifies the location of the folder that contains standard outputs and error outputs for a job.



Required? false

Position? named

Default value None

Accept pipeline input? False

Accept wildcard characters? false



<CommonParameters>

This cmdlet supports the common parameters: Verbose, Debug,

ErrorAction, ErrorVariable, WarningAction, WarningVariable,

OutBuffer, PipelineVariable, and OutVariable. For more information, see

about_CommonParameters (http://go.microsoft.com/fwlink/?LinkID=113216).



INPUTS

None

This cmdlet does not accept any input.





OUTPUTS

Microsoft.Azure.Commands.HDInsight.Models.AzureHDInsightMapReduceJobDefinition







NOTES









Example 1: Create a MapReduce job definition



PS C:\\># Cluster info

PS C:\\>$clusterName = "your-hadoop-001"

PS C:\\>$clusterCreds = Get-Credential



PS C:\\>New-AzureRmHDInsightMapReduceJobDefinition -StatusFolder $statusFolder `

-ClassName $className `

-JarFile $jarFilePath `

| Start-AzureRmHDInsightJob `

-ClusterName $clusterName `

-ClusterCredential $clusterCreds



This command creates a MapReduce job definition.







RELATED LINKS

Online Version: https://docs.microsoft.com/en-us/powers ... definition

Start-AzureRmHDInsightJob