< Back
New-AzureRmHDInsightHiveJobDefinition
Post
NAME New-AzureRmHDInsightHiveJobDefinition
SYNOPSIS
Creates a Hive job object.
SYNTAX
New-AzureRmHDInsightHiveJobDefinition [-Arguments <String[]>] [-DefaultProfile <IAzureContextContainer>] [-Defines <Hashtable>] [-File <String>]
[-Files <String[]>] [-JobName <String>] [-Query <String>] [-RunAsFileJob] [-StatusFolder <String>] [<CommonParameters>]
DESCRIPTION
The New-AzureRmHDInsightHiveJobDefinition cmdlet defines a Hive job object for use with an Azure HDInsight cluster.
PARAMETERS
-Arguments <String[]>
Specifies an array of arguments for the job. The arguments are passed as command-line arguments to each task.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-DefaultProfile <IAzureContextContainer>
The credentials, account, tenant, and subscription used for communication with azure
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-Defines <Hashtable>
Specifies Hadoop configuration values to set for when the job runs.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-File <String>
Specifies the path to a file that contains the query to run. The file must be available on the storage account associated with the cluster.
You can use this parameter instead of the Query parameter.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-Files <String[]>
Specifies a collection of files that are associated with a Hive job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-JobName <String>
Specifies the name of the job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-Query <String>
Specifies the Hive query.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-RunAsFileJob [<SwitchParameter>]
Indicates that this cmdlet creates a file in the default Azure storage account in which to store a query. This cmdlet submits the job that
references this file as a script to run.
You can use this functionality to handle special characters such as percent sign (%) that would fail on a job submission through Templeton,
because Templeton interprets a query with a percent sign as a URL parameter.
Required? false
Position? named
Default value False
Accept pipeline input? False
Accept wildcard characters? false
-StatusFolder <String>
Specifies the location of the folder that contains standard outputs and error outputs for a job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
<CommonParameters>
This cmdlet supports the common parameters: Verbose, Debug,
ErrorAction, ErrorVariable, WarningAction, WarningVariable,
OutBuffer, PipelineVariable, and OutVariable. For more information, see
about_CommonParameters (http://go.microsoft.com/fwlink/?LinkID=113216).
INPUTS
None
This cmdlet does not accept any input.
OUTPUTS
Microsoft.Azure.Commands.HDInsight.Models.AzureHDInsightHiveJobDefinition
NOTES
Example 1: Create a Hive job definition
PS C:\\># Cluster info
PS C:\\>$clusterName = "your-hadoop-001"
PS C:\\>$clusterCreds = Get-Credential
# Hive job details
PS C:\\>$statusFolder = "<status folder>"
PS C:\\>$query = "SHOW TABLES"
PS C:\\>New-AzureRmHDInsightHiveJobDefinition -StatusFolder $statusFolder `
-Query $query `
| Start-AzureRmHDInsightJob `
-ClusterName $clusterName `
-ClusterCredential $clusterCreds
This command creates a Hive job definition.
RELATED LINKS
Online Version: https://docs.microsoft.com/en-us/powers ... definition
Start-AzureRmHDInsightJob
SYNOPSIS
Creates a Hive job object.
SYNTAX
New-AzureRmHDInsightHiveJobDefinition [-Arguments <String[]>] [-DefaultProfile <IAzureContextContainer>] [-Defines <Hashtable>] [-File <String>]
[-Files <String[]>] [-JobName <String>] [-Query <String>] [-RunAsFileJob] [-StatusFolder <String>] [<CommonParameters>]
DESCRIPTION
The New-AzureRmHDInsightHiveJobDefinition cmdlet defines a Hive job object for use with an Azure HDInsight cluster.
PARAMETERS
-Arguments <String[]>
Specifies an array of arguments for the job. The arguments are passed as command-line arguments to each task.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-DefaultProfile <IAzureContextContainer>
The credentials, account, tenant, and subscription used for communication with azure
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-Defines <Hashtable>
Specifies Hadoop configuration values to set for when the job runs.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-File <String>
Specifies the path to a file that contains the query to run. The file must be available on the storage account associated with the cluster.
You can use this parameter instead of the Query parameter.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-Files <String[]>
Specifies a collection of files that are associated with a Hive job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-JobName <String>
Specifies the name of the job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-Query <String>
Specifies the Hive query.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-RunAsFileJob [<SwitchParameter>]
Indicates that this cmdlet creates a file in the default Azure storage account in which to store a query. This cmdlet submits the job that
references this file as a script to run.
You can use this functionality to handle special characters such as percent sign (%) that would fail on a job submission through Templeton,
because Templeton interprets a query with a percent sign as a URL parameter.
Required? false
Position? named
Default value False
Accept pipeline input? False
Accept wildcard characters? false
-StatusFolder <String>
Specifies the location of the folder that contains standard outputs and error outputs for a job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
<CommonParameters>
This cmdlet supports the common parameters: Verbose, Debug,
ErrorAction, ErrorVariable, WarningAction, WarningVariable,
OutBuffer, PipelineVariable, and OutVariable. For more information, see
about_CommonParameters (http://go.microsoft.com/fwlink/?LinkID=113216).
INPUTS
None
This cmdlet does not accept any input.
OUTPUTS
Microsoft.Azure.Commands.HDInsight.Models.AzureHDInsightHiveJobDefinition
NOTES
Example 1: Create a Hive job definition
PS C:\\># Cluster info
PS C:\\>$clusterName = "your-hadoop-001"
PS C:\\>$clusterCreds = Get-Credential
# Hive job details
PS C:\\>$statusFolder = "<status folder>"
PS C:\\>$query = "SHOW TABLES"
PS C:\\>New-AzureRmHDInsightHiveJobDefinition -StatusFolder $statusFolder `
-Query $query `
| Start-AzureRmHDInsightJob `
-ClusterName $clusterName `
-ClusterCredential $clusterCreds
This command creates a Hive job definition.
RELATED LINKS
Online Version: https://docs.microsoft.com/en-us/powers ... definition
Start-AzureRmHDInsightJob