Add a resource to the list of distributed cache resources.
Add a resource to the list of distributed cache resources. This list can be sent to the ApplicationMaster and possibly the executors so that it can be downloaded into the Hadoop distributed cache for use by this application. Adds the LocalResource to the localResources HashMap passed in and saves the stats of the resources to they can be sent to the executors and verified.
FileSystem
Configuration
path to the resource
localResource hashMap to insert the resource into
LocalResourceType
link presented in the distributed cache to the destination
cache to store the file/directory stats
Whether to only add the resource to the app master
Returns true if all ancestors of the specified path have the 'execute' permission set for all users (i.
Returns true if all ancestors of the specified path have the 'execute' permission set for all users (i.e. that other users can traverse the directory heirarchy to the given path)
true if all ancestors have the 'execute' permission set for all users
Checks for a given path whether the Other permissions on it imply the permission in the passed FsAction
Checks for a given path whether the Other permissions on it imply the permission in the passed FsAction
true if the path in the uri is visible to all, false otherwise
Checks to see if the given uri exists in the cache, if it does it returns the existing FileStatus, otherwise it stats the uri, stores it in the cache, and returns the FileStatus.
Checks to see if the given uri exists in the cache, if it does it returns the existing FileStatus, otherwise it stats the uri, stores it in the cache, and returns the FileStatus.
FileStatus
Returns the local resource visibility depending on the cache file permissions
Returns the local resource visibility depending on the cache file permissions
LocalResourceVisibility
Returns a boolean to denote whether a cache file is visible to all(public) or not
Returns a boolean to denote whether a cache file is visible to all(public) or not
true if the path in the uri is visible to all, false otherwise
Adds the necessary cache archive env variables to the env passed in
Adds the necessary cache archive env variables to the env passed in
Adds the necessary cache file env variables to the env passed in
Adds the necessary cache file env variables to the env passed in
Client side methods to setup the Hadoop distributed cache