Package org.apache.accumulo.core.client.mapreduce

Class AbstractInputFormat<K,​V>

  • Direct Known Subclasses:
    AccumuloMultiTableInputFormat, InputFormatBase
    @Deprecated
public abstract class AbstractInputFormat<K,​V>
extends org.apache.hadoop.mapreduce.InputFormat<K,​V>
    Deprecated.
    since 2.0.0; Use org.apache.accumulo.hadoop.mapreduce instead from the accumulo-hadoop-mapreduce.jar
    An abstract input format to provide shared methods common to all other input format classes. At the very least, any classes inheriting from this class will need to define their own RecordReader.

    • Field Detail

      • CLASS

        protected static final Class<?> CLASS
        Deprecated.

      • log

        protected static final org.apache.log4j.Logger log
        Deprecated.

    • Constructor Detail

      • AbstractInputFormat

        public AbstractInputFormat()
        Deprecated.

    • Method Detail

      • setClassLoaderContext

        public static void setClassLoaderContext​(org.apache.hadoop.mapreduce.Job job,
                                         String context)
        Deprecated.
        Sets the name of the classloader context on this scanner
        Parameters:
        job - the Hadoop job instance to be configured
        context - name of the classloader context
        Since:
        1.8.0

      • getClassLoaderContext

        public static String getClassLoaderContext​(org.apache.hadoop.mapreduce.JobContext job)
        Deprecated.
        Returns the name of the current classloader context set on this scanner
        Parameters:
        job - the Hadoop job instance to be configured
        Returns:
        name of the current context
        Since:
        1.8.0

      • setConnectorInfo

        public static void setConnectorInfo​(org.apache.hadoop.mapreduce.Job job,
                                    String principal,
                                    AuthenticationToken token)
                             throws AccumuloSecurityException
        Deprecated.
        Sets the connector information needed to communicate with Accumulo in this job.

        WARNING: Some tokens, when serialized, divulge sensitive information in the configuration as a means to pass the token to MapReduce tasks. This information is BASE64 encoded to provide a charset safe conversion to a string, but this conversion is not intended to be secure. PasswordToken is one example that is insecure in this way; however DelegationTokens, acquired using SecurityOperations.getDelegationToken(DelegationTokenConfig), is not subject to this concern.

        Parameters:
        job - the Hadoop job instance to be configured
        principal - a valid Accumulo user name (user must have Table.CREATE permission)
        token - the user's password
        Throws:
        AccumuloSecurityException
        Since:
        1.5.0

      • setConnectorInfo

        public static void setConnectorInfo​(org.apache.hadoop.mapreduce.Job job,
                                    String principal,
                                    String tokenFile)
                             throws AccumuloSecurityException
        Deprecated.
        Sets the connector information needed to communicate with Accumulo in this job.

        Stores the password in a file in HDFS and pulls that into the Distributed Cache in an attempt to be more secure than storing it in the Configuration.

        Parameters:
        job - the Hadoop job instance to be configured
        principal - a valid Accumulo user name (user must have Table.CREATE permission)
        tokenFile - the path to the token file
        Throws:
        AccumuloSecurityException
        Since:
        1.6.0

      • isConnectorInfoSet

        protected static Boolean isConnectorInfoSet​(org.apache.hadoop.mapreduce.JobContext job)
        Deprecated.
        Determines if the connector has been configured.
        Parameters:
        job - the Hadoop context for the configured job
        Returns:
        true if the connector has been configured, false otherwise
        Since:
        1.5.0
        See Also:
        setConnectorInfo(Job, String, AuthenticationToken)

      • getPrincipal

        protected static String getPrincipal​(org.apache.hadoop.mapreduce.JobContext job)
        Deprecated.
        Gets the user name from the configuration.
        Parameters:
        job - the Hadoop context for the configured job
        Returns:
        the user name
        Since:
        1.5.0
        See Also:
        setConnectorInfo(Job, String, AuthenticationToken)

      • getTokenClass

        @Deprecated
protected static String getTokenClass​(org.apache.hadoop.mapreduce.JobContext job)
        Deprecated.
        since 1.6.0; Use getAuthenticationToken(JobContext) instead.
        Gets the serialized token class from either the configuration or the token file.
        Since:
        1.5.0

      • getToken

        @Deprecated
protected static byte[] getToken​(org.apache.hadoop.mapreduce.JobContext job)
        Deprecated.
        since 1.6.0; Use getAuthenticationToken(JobContext) instead.
        Gets the serialized token from either the configuration or the token file.
        Since:
        1.5.0

      • setZooKeeperInstance

        @Deprecated
public static void setZooKeeperInstance​(org.apache.hadoop.mapreduce.Job job,
                                        String instanceName,
                                        String zooKeepers)
        Deprecated.
        since 1.6.0
        Configures a ZooKeeperInstance for this job.
        Parameters:
        job - the Hadoop job instance to be configured
        instanceName - the Accumulo instance name
        zooKeepers - a comma-separated list of zookeeper servers
        Since:
        1.5.0

      • setZooKeeperInstance

        public static void setZooKeeperInstance​(org.apache.hadoop.mapreduce.Job job,
                                        ClientConfiguration clientConfig)
        Deprecated.
        Configures a ZooKeeperInstance for this job.
        Parameters:
        job - the Hadoop job instance to be configured
        clientConfig - client configuration containing connection options
        Since:
        1.6.0

      • getInstance

        protected static Instance getInstance​(org.apache.hadoop.mapreduce.JobContext job)
        Deprecated.
        Initializes an Accumulo Instance based on the configuration.
        Parameters:
        job - the Hadoop context for the configured job
        Returns:
        an Accumulo instance
        Since:
        1.5.0

      • setLogLevel

        public static void setLogLevel​(org.apache.hadoop.mapreduce.Job job,
                               org.apache.log4j.Level level)
        Deprecated.
        Sets the log level for this job.
        Parameters:
        job - the Hadoop job instance to be configured
        level - the logging level
        Since:
        1.5.0

      • getLogLevel

        protected static org.apache.log4j.Level getLogLevel​(org.apache.hadoop.mapreduce.JobContext job)
        Deprecated.
        Gets the log level from this configuration.
        Parameters:
        job - the Hadoop context for the configured job
        Returns:
        the log level
        Since:
        1.5.0
        See Also:
        setLogLevel(Job, Level)

      • setScanAuthorizations

        public static void setScanAuthorizations​(org.apache.hadoop.mapreduce.Job job,
                                         Authorizations auths)
        Deprecated.
        Sets the Authorizations used to scan. Must be a subset of the user's authorization. Defaults to the empty set.
        Parameters:
        job - the Hadoop job instance to be configured
        auths - the user's authorizations

      • getScanAuthorizations

        protected static Authorizations getScanAuthorizations​(org.apache.hadoop.mapreduce.JobContext job)
        Deprecated.
        Gets the authorizations to set for the scans from the configuration.
        Parameters:
        job - the Hadoop context for the configured job
        Returns:
        the Accumulo scan authorizations
        Since:
        1.5.0
        See Also:
        setScanAuthorizations(Job, Authorizations)

      • getInputTableConfigs

        protected static Map<String,​InputTableConfig> getInputTableConfigs​(org.apache.hadoop.mapreduce.JobContext job)
        Deprecated.
        Fetches all InputTableConfigs that have been set on the given job.
        Parameters:
        job - the Hadoop job instance to be configured
        Returns:
        the InputTableConfig objects for the job
        Since:
        1.6.0

      • getInputTableConfig

        protected static InputTableConfig getInputTableConfig​(org.apache.hadoop.mapreduce.JobContext job,
                                                      String tableName)
        Deprecated.
        Fetches a InputTableConfig that has been set on the configuration for a specific table.

        null is returned in the event that the table doesn't exist.

        Parameters:
        job - the Hadoop job instance to be configured
        tableName - the table name for which to grab the config object
        Returns:
        the InputTableConfig for the given table
        Since:
        1.6.0

      • validateOptions

        protected static void validateOptions​(org.apache.hadoop.mapreduce.JobContext job)
                               throws IOException
        Deprecated.
        Check whether a configuration is fully configured to be used with an Accumulo InputFormat.
        Parameters:
        job - the Hadoop context for the configured job
        Throws:
        IOException - if the context is improperly configured
        Since:
        1.5.0

      • getClientConfiguration

        protected static ClientConfiguration getClientConfiguration​(org.apache.hadoop.mapreduce.JobContext job)
        Deprecated.
        Construct the ClientConfiguration given the provided context.
        Parameters:
        job - The Job
        Returns:
        The ClientConfiguration
        Since:
        1.7.0

      • getSplits

        public List<org.apache.hadoop.mapreduce.InputSplit> getSplits​(org.apache.hadoop.mapreduce.JobContext job)
                                                       throws IOException
        Deprecated.
        Gets the splits of the tables that have been set on the job by reading the metadata table for the specified ranges.
        Specified by:
        getSplits in class org.apache.hadoop.mapreduce.InputFormat<K,​V>
        Returns:
        the splits from the tables based on the ranges.
        Throws:
        IOException - if a table set on the job doesn't exist or an error occurs initializing the tablet locator