< Back
New-AzureRmHDInsightSqoopJobDefinition
Post
NAME New-AzureRmHDInsightSqoopJobDefinition
SYNOPSIS
Creates a Sqoop job object.
SYNTAX
New-AzureRmHDInsightSqoopJobDefinition [-Command <String>] [-DefaultProfile <IAzureContextContainer>] [-File <String>] [-Files <String[]>]
[-LibDir <String>] [-StatusFolder <String>] [<CommonParameters>]
DESCRIPTION
The New-AzureRmHDInsightSqoopJobDefinition cmdlet defines a Sqoop job object for use with an Azure HDInsight cluster.
PARAMETERS
-Command <String>
Specifies the Sqoop command.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-DefaultProfile <IAzureContextContainer>
The credentials, account, tenant, and subscription used for communication with azure
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-File <String>
Specifies the path to a file that contains the query to run. The file must be available on the Storage account associated with the cluster.
You can use this parameter instead of the Query parameter.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-Files <String[]>
Specifies a collection of files that are associated with a Hive job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-LibDir <String>
Specifies the library directory for the Sqoop job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-StatusFolder <String>
Specifies the location of the folder that contains standard outputs and error outputs for a job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
<CommonParameters>
This cmdlet supports the common parameters: Verbose, Debug,
ErrorAction, ErrorVariable, WarningAction, WarningVariable,
OutBuffer, PipelineVariable, and OutVariable. For more information, see
about_CommonParameters (http://go.microsoft.com/fwlink/?LinkID=113216).
INPUTS
None
This cmdlet does not accept any input.
OUTPUTS
Microsoft.Azure.Commands.HDInsight.Models.AzureHDInsightSqoopJobDefinition
NOTES
Example 1: Create a Sqoop job definition
PS C:\\># Cluster info
PS C:\\>$clusterName = "your-hadoop-001"
PS C:\\>$clusterCreds = Get-Credential
PS C:\\>New-AzureRmHDInsightSqoopJobDefinition -StatusFolder $statusFolder `
-Command $sqoopCommand `
| Start-AzureRmHDInsightJob -ClusterName $clusterName `
-ClusterCredential $clusterCreds
This command creates a Sqoop job definition.
RELATED LINKS
Online Version: https://docs.microsoft.com/en-us/powers ... definition
Start-AzureRmHDInsightJob
SYNOPSIS
Creates a Sqoop job object.
SYNTAX
New-AzureRmHDInsightSqoopJobDefinition [-Command <String>] [-DefaultProfile <IAzureContextContainer>] [-File <String>] [-Files <String[]>]
[-LibDir <String>] [-StatusFolder <String>] [<CommonParameters>]
DESCRIPTION
The New-AzureRmHDInsightSqoopJobDefinition cmdlet defines a Sqoop job object for use with an Azure HDInsight cluster.
PARAMETERS
-Command <String>
Specifies the Sqoop command.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-DefaultProfile <IAzureContextContainer>
The credentials, account, tenant, and subscription used for communication with azure
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-File <String>
Specifies the path to a file that contains the query to run. The file must be available on the Storage account associated with the cluster.
You can use this parameter instead of the Query parameter.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-Files <String[]>
Specifies a collection of files that are associated with a Hive job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-LibDir <String>
Specifies the library directory for the Sqoop job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
-StatusFolder <String>
Specifies the location of the folder that contains standard outputs and error outputs for a job.
Required? false
Position? named
Default value None
Accept pipeline input? False
Accept wildcard characters? false
<CommonParameters>
This cmdlet supports the common parameters: Verbose, Debug,
ErrorAction, ErrorVariable, WarningAction, WarningVariable,
OutBuffer, PipelineVariable, and OutVariable. For more information, see
about_CommonParameters (http://go.microsoft.com/fwlink/?LinkID=113216).
INPUTS
None
This cmdlet does not accept any input.
OUTPUTS
Microsoft.Azure.Commands.HDInsight.Models.AzureHDInsightSqoopJobDefinition
NOTES
Example 1: Create a Sqoop job definition
PS C:\\># Cluster info
PS C:\\>$clusterName = "your-hadoop-001"
PS C:\\>$clusterCreds = Get-Credential
PS C:\\>New-AzureRmHDInsightSqoopJobDefinition -StatusFolder $statusFolder `
-Command $sqoopCommand `
| Start-AzureRmHDInsightJob -ClusterName $clusterName `
-ClusterCredential $clusterCreds
This command creates a Sqoop job definition.
RELATED LINKS
Online Version: https://docs.microsoft.com/en-us/powers ... definition
Start-AzureRmHDInsightJob