@Generated(value="com.amazonaws:aws-java-sdk-code-generator") public class Crawler extends Object implements Serializable, Cloneable, StructuredPojo
Specifies a crawler program that examines a data source and uses classifiers to try to determine its schema. If successful, the crawler records metadata concerning the data source in the AWS Glue Data Catalog.
Constructor and Description |
---|
Crawler() |
Modifier and Type | Method and Description |
---|---|
Crawler |
clone() |
boolean |
equals(Object obj) |
List<String> |
getClassifiers()
A list of custom classifiers associated with the crawler.
|
String |
getConfiguration()
Crawler configuration information.
|
Long |
getCrawlElapsedTime()
If the crawler is running, contains the total time elapsed since the last crawl began.
|
Date |
getCreationTime()
The time when the crawler was created.
|
String |
getDatabaseName()
The database where metadata is written by this crawler.
|
String |
getDescription()
A description of the crawler.
|
LastCrawlInfo |
getLastCrawl()
The status of the last crawl, and potentially error information if an error occurred.
|
Date |
getLastUpdated()
The time the crawler was last updated.
|
String |
getName()
The crawler name.
|
String |
getRole()
The IAM role (or ARN of an IAM role) used to access customer resources, such as data in Amazon S3.
|
Schedule |
getSchedule()
For scheduled crawlers, the schedule when the crawler runs.
|
SchemaChangePolicy |
getSchemaChangePolicy()
Sets the behavior when the crawler finds a changed or deleted object.
|
String |
getState()
Indicates whether the crawler is running, or whether a run is pending.
|
String |
getTablePrefix()
The prefix added to the names of tables that are created.
|
CrawlerTargets |
getTargets()
A collection of targets to crawl.
|
Long |
getVersion()
The version of the crawler.
|
int |
hashCode() |
void |
marshall(ProtocolMarshaller protocolMarshaller) |
void |
setClassifiers(Collection<String> classifiers)
A list of custom classifiers associated with the crawler.
|
void |
setConfiguration(String configuration)
Crawler configuration information.
|
void |
setCrawlElapsedTime(Long crawlElapsedTime)
If the crawler is running, contains the total time elapsed since the last crawl began.
|
void |
setCreationTime(Date creationTime)
The time when the crawler was created.
|
void |
setDatabaseName(String databaseName)
The database where metadata is written by this crawler.
|
void |
setDescription(String description)
A description of the crawler.
|
void |
setLastCrawl(LastCrawlInfo lastCrawl)
The status of the last crawl, and potentially error information if an error occurred.
|
void |
setLastUpdated(Date lastUpdated)
The time the crawler was last updated.
|
void |
setName(String name)
The crawler name.
|
void |
setRole(String role)
The IAM role (or ARN of an IAM role) used to access customer resources, such as data in Amazon S3.
|
void |
setSchedule(Schedule schedule)
For scheduled crawlers, the schedule when the crawler runs.
|
void |
setSchemaChangePolicy(SchemaChangePolicy schemaChangePolicy)
Sets the behavior when the crawler finds a changed or deleted object.
|
void |
setState(String state)
Indicates whether the crawler is running, or whether a run is pending.
|
void |
setTablePrefix(String tablePrefix)
The prefix added to the names of tables that are created.
|
void |
setTargets(CrawlerTargets targets)
A collection of targets to crawl.
|
void |
setVersion(Long version)
The version of the crawler.
|
String |
toString()
Returns a string representation of this object; useful for testing and debugging.
|
Crawler |
withClassifiers(Collection<String> classifiers)
A list of custom classifiers associated with the crawler.
|
Crawler |
withClassifiers(String... classifiers)
A list of custom classifiers associated with the crawler.
|
Crawler |
withConfiguration(String configuration)
Crawler configuration information.
|
Crawler |
withCrawlElapsedTime(Long crawlElapsedTime)
If the crawler is running, contains the total time elapsed since the last crawl began.
|
Crawler |
withCreationTime(Date creationTime)
The time when the crawler was created.
|
Crawler |
withDatabaseName(String databaseName)
The database where metadata is written by this crawler.
|
Crawler |
withDescription(String description)
A description of the crawler.
|
Crawler |
withLastCrawl(LastCrawlInfo lastCrawl)
The status of the last crawl, and potentially error information if an error occurred.
|
Crawler |
withLastUpdated(Date lastUpdated)
The time the crawler was last updated.
|
Crawler |
withName(String name)
The crawler name.
|
Crawler |
withRole(String role)
The IAM role (or ARN of an IAM role) used to access customer resources, such as data in Amazon S3.
|
Crawler |
withSchedule(Schedule schedule)
For scheduled crawlers, the schedule when the crawler runs.
|
Crawler |
withSchemaChangePolicy(SchemaChangePolicy schemaChangePolicy)
Sets the behavior when the crawler finds a changed or deleted object.
|
Crawler |
withState(CrawlerState state)
Indicates whether the crawler is running, or whether a run is pending.
|
Crawler |
withState(String state)
Indicates whether the crawler is running, or whether a run is pending.
|
Crawler |
withTablePrefix(String tablePrefix)
The prefix added to the names of tables that are created.
|
Crawler |
withTargets(CrawlerTargets targets)
A collection of targets to crawl.
|
Crawler |
withVersion(Long version)
The version of the crawler.
|
public void setName(String name)
The crawler name.
name
- The crawler name.public String getName()
The crawler name.
public Crawler withName(String name)
The crawler name.
name
- The crawler name.public void setRole(String role)
The IAM role (or ARN of an IAM role) used to access customer resources, such as data in Amazon S3.
role
- The IAM role (or ARN of an IAM role) used to access customer resources, such as data in Amazon S3.public String getRole()
The IAM role (or ARN of an IAM role) used to access customer resources, such as data in Amazon S3.
public Crawler withRole(String role)
The IAM role (or ARN of an IAM role) used to access customer resources, such as data in Amazon S3.
role
- The IAM role (or ARN of an IAM role) used to access customer resources, such as data in Amazon S3.public void setTargets(CrawlerTargets targets)
A collection of targets to crawl.
targets
- A collection of targets to crawl.public CrawlerTargets getTargets()
A collection of targets to crawl.
public Crawler withTargets(CrawlerTargets targets)
A collection of targets to crawl.
targets
- A collection of targets to crawl.public void setDatabaseName(String databaseName)
The database where metadata is written by this crawler.
databaseName
- The database where metadata is written by this crawler.public String getDatabaseName()
The database where metadata is written by this crawler.
public Crawler withDatabaseName(String databaseName)
The database where metadata is written by this crawler.
databaseName
- The database where metadata is written by this crawler.public void setDescription(String description)
A description of the crawler.
description
- A description of the crawler.public String getDescription()
A description of the crawler.
public Crawler withDescription(String description)
A description of the crawler.
description
- A description of the crawler.public List<String> getClassifiers()
A list of custom classifiers associated with the crawler.
public void setClassifiers(Collection<String> classifiers)
A list of custom classifiers associated with the crawler.
classifiers
- A list of custom classifiers associated with the crawler.public Crawler withClassifiers(String... classifiers)
A list of custom classifiers associated with the crawler.
NOTE: This method appends the values to the existing list (if any). Use
setClassifiers(java.util.Collection)
or withClassifiers(java.util.Collection)
if you want to
override the existing values.
classifiers
- A list of custom classifiers associated with the crawler.public Crawler withClassifiers(Collection<String> classifiers)
A list of custom classifiers associated with the crawler.
classifiers
- A list of custom classifiers associated with the crawler.public void setSchemaChangePolicy(SchemaChangePolicy schemaChangePolicy)
Sets the behavior when the crawler finds a changed or deleted object.
schemaChangePolicy
- Sets the behavior when the crawler finds a changed or deleted object.public SchemaChangePolicy getSchemaChangePolicy()
Sets the behavior when the crawler finds a changed or deleted object.
public Crawler withSchemaChangePolicy(SchemaChangePolicy schemaChangePolicy)
Sets the behavior when the crawler finds a changed or deleted object.
schemaChangePolicy
- Sets the behavior when the crawler finds a changed or deleted object.public void setState(String state)
Indicates whether the crawler is running, or whether a run is pending.
state
- Indicates whether the crawler is running, or whether a run is pending.CrawlerState
public String getState()
Indicates whether the crawler is running, or whether a run is pending.
CrawlerState
public Crawler withState(String state)
Indicates whether the crawler is running, or whether a run is pending.
state
- Indicates whether the crawler is running, or whether a run is pending.CrawlerState
public Crawler withState(CrawlerState state)
Indicates whether the crawler is running, or whether a run is pending.
state
- Indicates whether the crawler is running, or whether a run is pending.CrawlerState
public void setTablePrefix(String tablePrefix)
The prefix added to the names of tables that are created.
tablePrefix
- The prefix added to the names of tables that are created.public String getTablePrefix()
The prefix added to the names of tables that are created.
public Crawler withTablePrefix(String tablePrefix)
The prefix added to the names of tables that are created.
tablePrefix
- The prefix added to the names of tables that are created.public void setSchedule(Schedule schedule)
For scheduled crawlers, the schedule when the crawler runs.
schedule
- For scheduled crawlers, the schedule when the crawler runs.public Schedule getSchedule()
For scheduled crawlers, the schedule when the crawler runs.
public Crawler withSchedule(Schedule schedule)
For scheduled crawlers, the schedule when the crawler runs.
schedule
- For scheduled crawlers, the schedule when the crawler runs.public void setCrawlElapsedTime(Long crawlElapsedTime)
If the crawler is running, contains the total time elapsed since the last crawl began.
crawlElapsedTime
- If the crawler is running, contains the total time elapsed since the last crawl began.public Long getCrawlElapsedTime()
If the crawler is running, contains the total time elapsed since the last crawl began.
public Crawler withCrawlElapsedTime(Long crawlElapsedTime)
If the crawler is running, contains the total time elapsed since the last crawl began.
crawlElapsedTime
- If the crawler is running, contains the total time elapsed since the last crawl began.public void setCreationTime(Date creationTime)
The time when the crawler was created.
creationTime
- The time when the crawler was created.public Date getCreationTime()
The time when the crawler was created.
public Crawler withCreationTime(Date creationTime)
The time when the crawler was created.
creationTime
- The time when the crawler was created.public void setLastUpdated(Date lastUpdated)
The time the crawler was last updated.
lastUpdated
- The time the crawler was last updated.public Date getLastUpdated()
The time the crawler was last updated.
public Crawler withLastUpdated(Date lastUpdated)
The time the crawler was last updated.
lastUpdated
- The time the crawler was last updated.public void setLastCrawl(LastCrawlInfo lastCrawl)
The status of the last crawl, and potentially error information if an error occurred.
lastCrawl
- The status of the last crawl, and potentially error information if an error occurred.public LastCrawlInfo getLastCrawl()
The status of the last crawl, and potentially error information if an error occurred.
public Crawler withLastCrawl(LastCrawlInfo lastCrawl)
The status of the last crawl, and potentially error information if an error occurred.
lastCrawl
- The status of the last crawl, and potentially error information if an error occurred.public void setVersion(Long version)
The version of the crawler.
version
- The version of the crawler.public Long getVersion()
The version of the crawler.
public Crawler withVersion(Long version)
The version of the crawler.
version
- The version of the crawler.public void setConfiguration(String configuration)
Crawler configuration information. This versioned JSON string allows users to specify aspects of a Crawler's behavior.
You can use this field to force partitions to inherit metadata such as classification, input format, output format, serde information, and schema from their parent table, rather than detect this information separately for each partition. Use the following JSON string to specify that behavior:
Example:
'{ "Version": 1.0, "CrawlerOutput": { "Partitions": { "AddOrUpdateBehavior": "InheritFromTable" } } }'
configuration
- Crawler configuration information. This versioned JSON string allows users to specify aspects of a
Crawler's behavior.
You can use this field to force partitions to inherit metadata such as classification, input format, output format, serde information, and schema from their parent table, rather than detect this information separately for each partition. Use the following JSON string to specify that behavior:
Example:
'{ "Version": 1.0, "CrawlerOutput": { "Partitions": { "AddOrUpdateBehavior": "InheritFromTable" } } }'
public String getConfiguration()
Crawler configuration information. This versioned JSON string allows users to specify aspects of a Crawler's behavior.
You can use this field to force partitions to inherit metadata such as classification, input format, output format, serde information, and schema from their parent table, rather than detect this information separately for each partition. Use the following JSON string to specify that behavior:
Example:
'{ "Version": 1.0, "CrawlerOutput": { "Partitions": { "AddOrUpdateBehavior": "InheritFromTable" } } }'
You can use this field to force partitions to inherit metadata such as classification, input format, output format, serde information, and schema from their parent table, rather than detect this information separately for each partition. Use the following JSON string to specify that behavior:
Example:
'{ "Version": 1.0, "CrawlerOutput": { "Partitions": { "AddOrUpdateBehavior": "InheritFromTable" } } }'
public Crawler withConfiguration(String configuration)
Crawler configuration information. This versioned JSON string allows users to specify aspects of a Crawler's behavior.
You can use this field to force partitions to inherit metadata such as classification, input format, output format, serde information, and schema from their parent table, rather than detect this information separately for each partition. Use the following JSON string to specify that behavior:
Example:
'{ "Version": 1.0, "CrawlerOutput": { "Partitions": { "AddOrUpdateBehavior": "InheritFromTable" } } }'
configuration
- Crawler configuration information. This versioned JSON string allows users to specify aspects of a
Crawler's behavior.
You can use this field to force partitions to inherit metadata such as classification, input format, output format, serde information, and schema from their parent table, rather than detect this information separately for each partition. Use the following JSON string to specify that behavior:
Example:
'{ "Version": 1.0, "CrawlerOutput": { "Partitions": { "AddOrUpdateBehavior": "InheritFromTable" } } }'
public String toString()
toString
in class Object
Object.toString()
public void marshall(ProtocolMarshaller protocolMarshaller)
marshall
in interface StructuredPojo
Copyright © 2018. All rights reserved.