Index (Heritrix 3: 'commons' subproject (utility classes) 3.4.0-20210618 API)

A B C D E F G H I J K L M N O P Q R S T U V W _
All Classes|All Packages

A

AbstractLongFPSet - Class in org.archive.util: Shell of functionality for a Set of primitive long fingerprints, held in an array of possibly-empty slots.
AbstractLongFPSet() - Constructor for class org.archive.util.AbstractLongFPSet: To support serialization TODO: verify needed?
AbstractLongFPSet(int, float) - Constructor for class org.archive.util.AbstractLongFPSet: Create a new AbstractLongFPSet with a given capacity and load Factor
activateOptions() - Method in class org.archive.util.OneLineSimpleLayout
add(long) - Method in class org.archive.util.AbstractLongFPSet: Add the given value to this set
add(long) - Method in class org.archive.util.fingerprint.ArrayLongFPCache
add(long) - Method in interface org.archive.util.fingerprint.LongFPSet: Add a fingerprint to the set.
add(CharSequence) - Method in interface org.archive.util.BloomFilter: Adds a character sequence to the filter.
add(CharSequence) - Method in class org.archive.util.BloomFilter64bit: Adds a character sequence to the filter.
add(Iterator<E>) - Method in class org.archive.util.iterator.CompositeIterator: Add an iterator to the internal chain.
add(Histotable<K>) - Method in class org.archive.util.Histotable
addExternalPath(String) - Method in class org.archive.spring.KeyedProperties: Add a path by which the outside world can reach this map
addPropertyChangeListener(PropertyChangeListener) - Method in class org.archive.io.ReadSourceEditor
addPropertyChangeListener(PropertyChangeListener) - Method in class org.archive.spring.ConfigPathEditor
afterPropertiesSet() - Method in class org.archive.checkpointing.Checkpoint
allBeans - Variable in class org.archive.spring.ConfigPathConfigurer
allConfigPaths - Variable in class org.archive.spring.ConfigPathConfigurer
allErrors - Variable in class org.archive.spring.PathSharingContext
allowCreate - Variable in class org.archive.bdb.BdbModule.BdbConfig
appCtx - Variable in class org.archive.spring.ConfigPathConfigurer
append(int) - Method in class org.archive.util.PaddingStringBuffer: append an int to the buffer.
append(long) - Method in class org.archive.util.PaddingStringBuffer: append a long to the buffer.
append(String) - Method in class org.archive.util.PaddingStringBuffer: append a string directly to the buffer
Arc2Warc - Class in org.archive.io: Convert ARCs to (sortof) WARCs.
Arc2Warc() - Constructor for class org.archive.io.Arc2Warc
ArrayLongFPCache - Class in org.archive.util.fingerprint: Simple long fingerprint cache using a backing array; any long maps to one of 'smear' slots.
ArrayLongFPCache() - Constructor for class org.archive.util.fingerprint.ArrayLongFPCache
AUDIO_VIDEO_IMAGE_MIMETYPE_SET - Static variable in class org.archive.util.UriUtils
AUDIO_VIDEO_IMAGE_MIMETYPES - Static variable in class org.archive.util.UriUtils
AutoKryo - Class in org.archive.bdb: Extensions to Kryo to let classes control their own registration, suggest other classes to register together, and use the same (Sun-JVM-only) trick for deserializing classes without no-arg constructors.
AutoKryo() - Constructor for class org.archive.bdb.AutoKryo
autoregister(Class<?>) - Method in class org.archive.bdb.AutoKryo

B

base - Variable in class org.archive.spring.ConfigPath
Base32 - Class in org.archive.util: Deprecated.
Use BaseEncoding.base32()
Base32() - Constructor for class org.archive.util.Base32: Deprecated.
baseClass - Variable in class org.archive.bdb.KryoBinding
BdbConfig() - Constructor for class org.archive.bdb.BdbModule.BdbConfig
BdbModule - Class in org.archive.bdb: Utility module for managing a shared BerkeleyDB-JE environment
BdbModule() - Constructor for class org.archive.bdb.BdbModule
BdbModule.BdbConfig - Class in org.archive.bdb: Configuration object for databases.
beanFactory - Variable in class org.archive.spring.Sheet
BeanFieldsPatternValidator - Class in org.archive.spring
BeanFieldsPatternValidator(Class<?>, String...) - Constructor for class org.archive.spring.BeanFieldsPatternValidator
BeanFieldsPatternValidator.PropertyPatternRule - Class in org.archive.spring
bindObjectName(Context, ObjectName) - Static method in class org.archive.util.JndiUtils
bInheritHandle - Variable in class org.archive.util.FilesystemLinkMaker.Kernel32Library.LPSECURITY_ATTRIBUTES
BLOCK_SIZE - Static variable in interface org.archive.util.ms.BlockFileSystem: The size of a block in bytes.
BlockFileSystem - Interface in org.archive.util.ms: Describes the internal file system contained in .doc files.
BlockInputStream - Class in org.archive.util.ms: InputStream for a file contained in a BlockFileSystem.
BlockInputStream(BlockFileSystem, int) - Constructor for class org.archive.util.ms.BlockInputStream: Constructor.
BloomFilter - Interface in org.archive.util: Common interface for different Bloom filter implementations
BloomFilter64bit - Class in org.archive.util
BloomFilter64bit(long, int) - Constructor for class org.archive.util.BloomFilter64bit: Creates a new Bloom filter with given number of hash functions and expected number of elements.
BloomFilter64bit(long, int, boolean) - Constructor for class org.archive.util.BloomFilter64bit
BloomFilter64bit(long, int, Random, boolean) - Constructor for class org.archive.util.BloomFilter64bit: Creates a new Bloom filter with given number of hash functions and expected number of elements.
bucketFor(char[], int) - Method in class org.archive.util.LongToIntConsistentHash
bucketFor(long, int) - Method in class org.archive.util.LongToIntConsistentHash: Return the proper integer bucket-number for the given long hash, up to the given integer boundary (exclusive).
bucketFor(CharSequence, int) - Method in class org.archive.util.LongToIntConsistentHash: Convenience alternative which creates longHash from CharSequence
buffer - Variable in class org.archive.util.PaddingStringBuffer

C

cache - Variable in class org.archive.util.fingerprint.ArrayLongFPCache
cacheLength() - Method in class org.archive.util.fingerprint.ArrayLongFPCache
cachePercent - Variable in class org.archive.bdb.BdbModule
cacheSize - Variable in class org.archive.bdb.BdbModule
capacityPowerOfTwo - Variable in class org.archive.util.AbstractLongFPSet: the capacity of this set, specified as the exponent of a power of 2
cd(String) - Method in class org.archive.net.ClientSFTP
channel - Variable in class org.archive.net.ClientSFTP
channelSFTP - Variable in class org.archive.net.ClientSFTP
Checkpoint - Class in org.archive.checkpointing: Represents a single checkpoint, by its name and main store directory.
Checkpoint() - Constructor for class org.archive.checkpointing.Checkpoint
Checkpointable - Interface in org.archive.checkpointing: Interface for objects that can checkpoint their state, possibly but not necessarily into the provided Checkpoint instance, on request.
checkpointDir - Variable in class org.archive.checkpointing.Checkpoint: Checkpoints directory; either an absolute path, or relative to the CheckpointService's checkpointsDirectory (which will be inserted as the COnfigPath base before the Checkpoint is consulted).
circle - Variable in class org.archive.util.LongToIntConsistentHash
classCatalog - Variable in class org.archive.util.bdbje.EnhancedEnvironment
classCatalogDB - Variable in class org.archive.util.bdbje.EnhancedEnvironment
clazz - Variable in class org.archive.spring.BeanFieldsPatternValidator
clearAllOverrideContexts() - Static method in class org.archive.spring.KeyedProperties
clearAt(long) - Method in class org.archive.util.AbstractLongFPSet
clearAt(long) - Method in class org.archive.util.fingerprint.MemLongFPSet
clearOverridesFrom(OverlayContext) - Static method in class org.archive.spring.KeyedProperties
CLibrary - Interface in org.archive.util: Interface to standard C library functions; initially just link().
ClientFTP - Class in org.archive.net: Client for FTP operations.
ClientFTP() - Constructor for class org.archive.net.ClientFTP: Constructs a new ClientFTP.
ClientSFTP - Class in org.archive.net
ClientSFTP() - Constructor for class org.archive.net.ClientSFTP
close() - Method in class org.archive.bdb.BdbModule
close() - Method in class org.archive.bdb.StoredQueue
close() - Method in class org.archive.io.CrawlerJournal: Flush and close the underlying IO objects.
close() - Method in class org.archive.util.bdbje.EnhancedEnvironment
close() - Method in class org.archive.util.ObjectIdentityBdbManualCache
close() - Method in interface org.archive.util.ObjectIdentityCache: close/release any associated resources
close() - Method in class org.archive.util.ObjectIdentityMemCache
closeDatabase(Database) - Method in class org.archive.bdb.BdbModule
closeDatabase(String) - Method in class org.archive.bdb.BdbModule
closeDataConnection() - Method in class org.archive.net.ClientFTP
composeCacheSummary() - Method in class org.archive.util.ObjectIdentityBdbManualCache
CompositeIterator<E> - Class in org.archive.util.iterator: An iterator that's built up out of any number of other iterators.
CompositeIterator() - Constructor for class org.archive.util.iterator.CompositeIterator: Create an empty CompositeIterator.
CompositeIterator(Iterator<E>, Iterator<E>) - Constructor for class org.archive.util.iterator.CompositeIterator: Convenience method for concatenating together two iterators.
ConfigFile - Class in org.archive.spring: ConfigPath with added implication that it is an individual, readable/writable File.
ConfigFile() - Constructor for class org.archive.spring.ConfigFile
ConfigFile(String, String) - Constructor for class org.archive.spring.ConfigFile
ConfigFileEditor - Class in org.archive.spring: PropertyEditor allowing Strings to become ConfigFile instances.
ConfigFileEditor() - Constructor for class org.archive.spring.ConfigFileEditor
ConfigPath - Class in org.archive.spring: A filesystem path, as a bean, for the convenience of configuration via srping beans.xml or user interfaces to same.
ConfigPath() - Constructor for class org.archive.spring.ConfigPath
ConfigPath(String, String) - Constructor for class org.archive.spring.ConfigPath
ConfigPathConfigurer - Class in org.archive.spring: Bean to fixup all configuration-relative ConfigPath instances, and maintain an inventory of referenced paths.
ConfigPathConfigurer() - Constructor for class org.archive.spring.ConfigPathConfigurer
ConfigPathEditor - Class in org.archive.spring: PropertyEditor allowing Strings to become ConfigPath instances.
ConfigPathEditor() - Constructor for class org.archive.spring.ConfigPathEditor
ConfigString - Class in org.archive.spring: A configuration string that provides its own reader via the ReadSource interface, for convenient use in spring configuration where any of an inline string, path to local file (ConfigPath), or any other readable-text-source would all be equally welcome.
ConfigString() - Constructor for class org.archive.spring.ConfigString
ConfigString(String) - Constructor for class org.archive.spring.ConfigString
configurer - Variable in class org.archive.spring.ConfigPath
connect(String, String, int, String) - Method in class org.archive.net.ClientSFTP
considerTimestamp() - Method in class org.archive.io.CrawlerJournal: Write a timestamp line if appropriate
CONSTRUCTOR_CACHE - Static variable in class org.archive.bdb.AutoKryo
contains(int) - Method in class org.archive.util.ms.Piece
contains(long) - Method in class org.archive.util.AbstractLongFPSet: Does this set contain the given value?
contains(long) - Method in class org.archive.util.fingerprint.ArrayLongFPCache
contains(long) - Method in interface org.archive.util.fingerprint.LongFPSet: Does this set contain a given fingerprint.
contains(CharSequence) - Method in interface org.archive.util.BloomFilter: Checks whether the given character sequence is in this filter.
contains(CharSequence) - Method in class org.archive.util.BloomFilter64bit: Checks whether the given character sequence is in this filter.
controlConversation - Variable in class org.archive.net.ClientFTP
controlConversation - Variable in class org.archive.net.ClientSFTP
convertLevel(Level) - Method in class org.archive.util.OneLineSimpleLayout
count - Variable in class org.archive.util.AbstractLongFPSet: The current number of elements in the set
count - Variable in class org.archive.util.fingerprint.ArrayLongFPCache
count - Variable in class org.archive.util.ObjectIdentityBdbManualCache
count() - Method in class org.archive.util.AbstractLongFPSet: Return the number of entries in this set.
count() - Method in class org.archive.util.fingerprint.ArrayLongFPCache
count() - Method in interface org.archive.util.fingerprint.LongFPSet: get the number of elements in the Set
Cp1252 - Class in org.archive.util.ms: A fast implementation of code page 1252.
CrawlerJournal - Class in org.archive.io: Utility class for a crawler journal/log that is compressed and rotates by serial number at checkpoints.
CrawlerJournal(File) - Constructor for class org.archive.io.CrawlerJournal: Create a new crawler journal at the given location
CrawlerJournal(String, String) - Constructor for class org.archive.io.CrawlerJournal: Create a new crawler journal at the given location
createDiskMap(Database, StoredClassCatalog, Class) - Method in class org.archive.util.ObjectIdentityBdbManualCache
CreateHardLinkA(String, String, FilesystemLinkMaker.Kernel32Library.LPSECURITY_ATTRIBUTES) - Method in interface org.archive.util.FilesystemLinkMaker.Kernel32Library
CreateSymbolicLinkA(String, String, FilesystemLinkMaker.Kernel32Library.LPSECURITY_ATTRIBUTES) - Method in interface org.archive.util.FilesystemLinkMaker.Kernel32Library
currentIterator - Variable in class org.archive.util.iterator.CompositeIterator
currentLaunchDir - Variable in class org.archive.spring.PathSharingContext
currentLaunchId - Variable in class org.archive.spring.PathSharingContext

D

data - Variable in class org.archive.spring.PathSharingContext
databaseConfig() - Static method in class org.archive.bdb.StoredQueue: A suitable DatabaseConfig for the Database backing a StoredQueue.
dataSocket - Variable in class org.archive.net.ClientFTP
dataSocket - Variable in class org.archive.net.ClientSFTP
db - Variable in class org.archive.bdb.DisposableStoredSortedMap
db - Variable in class org.archive.util.ObjectIdentityBdbManualCache: The BDB JE database used for this instance.
decode(int) - Static method in class org.archive.util.ms.Cp1252: Returns the Unicode character for the given Cp1252 byte.
decode(String) - Static method in class org.archive.util.Base32: Deprecated.
Use BaseEncoding.base32()
DEFAULT_CAPACITY - Static variable in class org.archive.util.fingerprint.ArrayLongFPCache
DEFAULT_REPLICAS - Static variable in class org.archive.util.LongToIntConsistentHash
DEFAULT_SMEAR - Static variable in class org.archive.util.fingerprint.ArrayLongFPCache
DefaultBlockFileSystem - Class in org.archive.util.ms: Default implementation of the Block File System.
DefaultBlockFileSystem(SeekInputStream, int) - Constructor for class org.archive.util.ms.DefaultBlockFileSystem: Constructor.
deferredWrite - Variable in class org.archive.bdb.BdbModule.BdbConfig
degree - Variable in class st.ata.util.FPGenerator: The number of bits in fingerprints generated by this.
destroy() - Method in class org.archive.bdb.BdbModule
dir - Variable in class org.archive.bdb.BdbModule
DIRECTORY - org.archive.util.ms.Entry.EntryType
dirtyItems - Variable in class org.archive.util.ObjectIdentityBdbManualCache
dirtyKey(String) - Method in class org.archive.util.ObjectIdentityBdbManualCache
dirtyKey(String) - Method in interface org.archive.util.ObjectIdentityCache: force the persistent backend, if any, to eventually be updated with live object state for the given key
dirtyKey(String) - Method in class org.archive.util.ObjectIdentityMemCache
disconnect() - Method in class org.archive.net.ClientFTP
disconnect() - Method in class org.archive.net.ClientSFTP
diskMap - Variable in class org.archive.util.ObjectIdentityBdbManualCache: The Collection view of the BDB JE database used for this instance.
DisposableStoredSortedMap<K,V> - Class in org.archive.bdb: TempStoredSortedMap remembers its backing Database, and offers a dispose() method for closing/discarding the underlying Database.
DisposableStoredSortedMap(Database, EntryBinding<K>, EntityBinding<V>, boolean) - Constructor for class org.archive.bdb.DisposableStoredSortedMap
DisposableStoredSortedMap(Database, EntryBinding<K>, EntityBinding<V>, PrimaryKeyAssigner) - Constructor for class org.archive.bdb.DisposableStoredSortedMap
DisposableStoredSortedMap(Database, EntryBinding<K>, EntryBinding<V>, boolean) - Constructor for class org.archive.bdb.DisposableStoredSortedMap
DisposableStoredSortedMap(Database, EntryBinding<K>, EntryBinding<V>, PrimaryKeyAssigner) - Constructor for class org.archive.bdb.DisposableStoredSortedMap
dispose() - Method in class org.archive.bdb.DisposableStoredSortedMap
Doc - Class in org.archive.util.ms: Reads .doc files.
doCheckpoint(Checkpoint) - Method in class org.archive.bdb.BdbModule
doCheckpoint(Checkpoint) - Method in interface org.archive.checkpointing.Checkpointable: Do the actual checkpoint.
doRecover() - Method in class org.archive.bdb.BdbModule
downRemoteSingleFile(String, String) - Method in class org.archive.net.ClientSFTP

E

empty - Variable in class st.ata.util.FPGenerator: Fingerprint of the empty string of bytes.
EMPTY - Static variable in class org.archive.util.AbstractLongFPSet: A constant used to indicate that a slot in the set storage is empty.
encode(byte[]) - Static method in class org.archive.util.Base32: Deprecated.
Use BaseEncoding.base32()
EnhancedEnvironment - Class in org.archive.util.bdbje: Version of BDB_JE Environment with additional convenience features, such as a shared, cached StoredClassCatalog.
EnhancedEnvironment(File, EnvironmentConfig) - Constructor for class org.archive.util.bdbje.EnhancedEnvironment: Constructor
Entry - Interface in org.archive.util.ms
Entry.EntryType - Enum in org.archive.util.ms
entryString(Object) - Static method in class org.archive.util.Histotable: Utility method to convert a key->Long into the string "count key".
entryToObject(DatabaseEntry) - Method in class org.archive.bdb.KryoBinding
errorMessage - Variable in class org.archive.spring.BeanFieldsPatternValidator.PropertyPatternRule
escape(String) - Static method in class org.archive.util.JavaLiterals
evictorCoreThreads - Variable in class org.archive.bdb.BdbModule: Configure the number of evictor threads (-1 means use the default) https://docs.oracle.com/cd/E17277_02/html/java/com/sleepycat/je/EnvironmentConfig.html#EVICTOR_CORE_THREADS
evictorMaxThreads - Variable in class org.archive.bdb.BdbModule: Configure the maximum number of evictor threads (-1 means use the default) https://docs.oracle.com/cd/E17277_02/html/java/com/sleepycat/je/EnvironmentConfig.html#EVICTOR_MAX_THREADS
exactKey(String) - Static method in class org.archive.surt.SURTTokenizer
exit() - Method in class org.archive.net.ClientSFTP
expectedConcurrency - Variable in class org.archive.bdb.BdbModule: Expected number of concurrent threads; used to tune nLockTables according to JE FAQ http://www.oracle.com/technology/products/berkeley-db/faq/je_faq.html#33
extend(long, byte) - Method in class st.ata.util.FPGenerator: Extends fingerprint f by adding the low eight bits of "b".
extend(long, byte[], int, int) - Method in class st.ata.util.FPGenerator: Extends fingerprint f by adding "n" bytes of "buf" starting from "buf[start]".
extend(long, char) - Method in class st.ata.util.FPGenerator: Extends fingerprint f by adding (all bits of) "v".
extend(long, char[], int, int) - Method in class st.ata.util.FPGenerator: Extends fingerprint f by adding (all bits of) "n" characters of "buf" starting from "buf[i]".
extend(long, int) - Method in class st.ata.util.FPGenerator: Extends fingerprint f by adding (all bits of) "v".
extend(long, int[], int, int) - Method in class st.ata.util.FPGenerator: Extends fingerprint f by adding (all bits of) "n" characters of "buf" starting from "buf[i]".
extend(long, long) - Method in class st.ata.util.FPGenerator: Extends fingerprint f by adding (all bits of) "v".
extend(long, long[], int, int) - Method in class st.ata.util.FPGenerator: Extends fingerprint f by adding (all bits of) "n" characters of "buf" starting from "buf[i]".
extend(long, CharSequence) - Method in class st.ata.util.FPGenerator: Extends fingerprint f by adding (all bits of) the characters of "s".
extend_byte(long, int) - Method in class st.ata.util.FPGenerator: Extends f with lower eight bits of v without full reduction.
extend_char(long, int) - Method in class st.ata.util.FPGenerator: Extends f with lower sixteen bits of v.
extend_int(long, int) - Method in class st.ata.util.FPGenerator: Extends f with (all bits of) v.
extend_long(long, long) - Method in class st.ata.util.FPGenerator: Extends f with v.
extend8(long, char[], int, int) - Method in class st.ata.util.FPGenerator: Extends fingerprint f by adding the lower eight bits of "n" characters of "buf" starting from "buf[i]".
extend8(long, String) - Method in class st.ata.util.FPGenerator: Extends fingerprint f by adding the lower eight bits of the characters of "s".
externalPaths - Variable in class org.archive.spring.KeyedProperties: the alternate global property-paths leading to this map TODO: consider if deterministic ordered list is important

F

FILE - org.archive.util.ms.Entry.EntryType
FilesystemLinkMaker - Class in org.archive.util: Wrapper for platform-dependent hard link creation.
FilesystemLinkMaker() - Constructor for class org.archive.util.FilesystemLinkMaker
FilesystemLinkMaker.Kernel32Library - Interface in org.archive.util
FilesystemLinkMaker.Kernel32Library.LPSECURITY_ATTRIBUTES - Class in org.archive.util
finalize() - Method in class org.archive.util.ObjectIdentityBdbManualCache
find(SortedSet<String>, String) - Static method in class org.archive.util.PrefixFinder: Extracts prefixes of a given string from a SortedSet.
findKeys(SortedMap<String, ?>, String) - Static method in class org.archive.util.PrefixFinder
finishCheckpoint(Checkpoint) - Method in class org.archive.bdb.BdbModule
finishCheckpoint(Checkpoint) - Method in interface org.archive.checkpointing.Checkpointable: Cleanup/unlock; need not complete for a checkpoint to be valid.
fixupConfigPath(ConfigPath, String) - Method in class org.archive.spring.ConfigPathConfigurer
fixupPaths(Object, String) - Method in class org.archive.spring.ConfigPathConfigurer: Find any ConfigPath properties in the passed bean; ensure that if they have a null 'base', that is replaced with the job home directory.
forceScarceMemory() - Static method in class org.archive.util.TestUtils: Temporarily exhaust memory, forcing weak/soft references to be broken.
forgetAllButLatest - Variable in class org.archive.checkpointing.Checkpoint
format(LogRecord) - Method in class org.archive.util.OneLineSimpleLogger
format(LoggingEvent) - Method in class org.archive.util.OneLineSimpleLayout
fp(byte[], int, int) - Method in class st.ata.util.FPGenerator: Compute fingerprint of "n" bytes of "buf" starting from "buf[start]".
fp(char[], int, int) - Method in class st.ata.util.FPGenerator: Compute fingerprint of (all bits of) "n" characters of "buf" starting from "buf[i]".
fp(int[], int, int) - Method in class st.ata.util.FPGenerator: Compute fingerprint of (all bits of) "n" characters of "buf" starting from "buf[i]".
fp(long[], int, int) - Method in class st.ata.util.FPGenerator: Compute fingerprint of (all bits of) "n" characters of "buf" starting from "buf[i]".
fp(CharSequence) - Method in class st.ata.util.FPGenerator: Compute fingerprint of (all bits of) the characters of "s".
fp8(char[], int, int) - Method in class st.ata.util.FPGenerator: Compute fingerprint of the lower eight bits of "n" characters of "buf" starting from "buf[i]".
fp8(String) - Method in class st.ata.util.FPGenerator: Compute fingerprint of the lower eight bits of the characters of "s".
FPGenerator - Class in st.ata.util: This class provides methods that construct fingerprints of strings of bytes via operations in GF[2^d] for 0 < d <= 64.

G

generateFrom(ConfigPath, int) - Method in class org.archive.checkpointing.Checkpoint: Use immediately after instantiation to fill-in a Checkpoint created outside Spring configuration.
generator - Variable in class org.archive.io.Arc2Warc
get() - Method in class org.archive.util.Supplier
get(Object) - Method in class org.archive.util.Histotable: Return 0 instead of null for absent keys.
get(String) - Method in class org.archive.spring.KeyedProperties: Get the given value, checking override maps if appropriate.
get(String) - Method in class org.archive.util.ObjectIdentityBdbManualCache
get(String) - Method in interface org.archive.util.ObjectIdentityCache: get the object under the given key/name -- but should not mutate object state
get(String) - Method in class org.archive.util.ObjectIdentityMemCache
getAllConfigPaths() - Method in class org.archive.spring.ConfigPathConfigurer
getAllErrors() - Method in class org.archive.spring.PathSharingContext
getAsText() - Method in class org.archive.io.ReadSourceEditor
getAsText() - Method in class org.archive.spring.ConfigPathEditor
getAt(long) - Method in class org.archive.util.AbstractLongFPSet: Get the stored value at the given slot.
getAt(long) - Method in class org.archive.util.fingerprint.MemLongFPSet
getBase() - Method in class org.archive.spring.ConfigPath
getBeanName() - Method in class org.archive.spring.HeritrixLifecycleProcessor
getBit(long) - Method in interface org.archive.util.BloomFilter
getBit(long) - Method in class org.archive.util.BloomFilter64bit
getCachePercent() - Method in class org.archive.bdb.BdbModule
getCacheSize() - Method in class org.archive.bdb.BdbModule
getChannelSftp() - Method in class org.archive.net.ClientSFTP
getCharPosLimit() - Method in class org.archive.util.ms.Piece
getCharPosStart() - Method in class org.archive.util.ms.Piece
getCheckpointDir() - Method in class org.archive.checkpointing.Checkpoint
getChild() - Method in interface org.archive.util.ms.Entry
getClassCatalog() - Method in class org.archive.bdb.BdbModule
getClassCatalog() - Method in class org.archive.util.bdbje.EnhancedEnvironment: Return a StoredClassCatalog backed by a Database in this environment, either pre-existing or created (and cached) if necessary.
getCleanerThreads() - Method in class org.archive.bdb.BdbModule
getCompoundName(String) - Static method in class org.archive.util.JndiUtils
getCompoundName(ObjectName) - Static method in class org.archive.util.JndiUtils: Return name to use as jndi name.
getConfigurationFile() - Method in class org.archive.spring.PathSharingContext
getControlConversation() - Method in class org.archive.net.ClientFTP
getControlConversation() - Method in class org.archive.net.ClientSFTP
getCurrentLaunchDir() - Method in class org.archive.spring.PathSharingContext
getCurrentLaunchId() - Method in class org.archive.spring.PathSharingContext
getCustomEditor() - Method in class org.archive.io.ReadSourceEditor
getCustomEditor() - Method in class org.archive.spring.ConfigPathEditor
getData() - Method in class org.archive.spring.PathSharingContext
getDatabase(String) - Method in class org.archive.bdb.BdbModule
getDatabaseName() - Method in class org.archive.util.ObjectIdentityBdbManualCache
getDir() - Method in class org.archive.bdb.BdbModule
getEntry(int) - Method in class org.archive.util.ms.DefaultBlockFileSystem: Returns the entry with the given number.
getEntryByFrequencySortedSet() - Static method in class org.archive.util.Histotable: Get a SortedSet that, when filled with (String key)->(long count) Entry instances, sorts them by (count, key) descending, as is useful for most-frequent displays.
getEvictorCoreThreads() - Method in class org.archive.bdb.BdbModule
getEvictorMaxThreads() - Method in class org.archive.bdb.BdbModule
getExpectedConcurrency() - Method in class org.archive.bdb.BdbModule
getExpectedInserts() - Method in interface org.archive.util.BloomFilter: Report the number of expected inserts used at instantiation time to calculate the bitfield size.
getExpectedInserts() - Method in class org.archive.util.BloomFilter64bit
getFile() - Method in class org.archive.spring.ConfigPath
getFilePos() - Method in class org.archive.util.ms.Piece
getForgetAllButLatest() - Method in class org.archive.checkpointing.Checkpoint
getHashCount() - Method in interface org.archive.util.BloomFilter: Report the number of internal independent hash function (and thus the number of bits set/checked for each item presented).
getHashCount() - Method in class org.archive.util.BloomFilter64bit
getIndex() - Method in interface org.archive.util.ms.Entry
getInstance(String) - Static method in class org.archive.net.UURIFactory
getInstance(UURI, String) - Static method in class org.archive.net.UURIFactory
getJavaInitializationString() - Method in class org.archive.io.ReadSourceEditor
getJavaInitializationString() - Method in class org.archive.spring.ConfigPathEditor
getKey() - Method in interface org.archive.util.IdentityCacheable
getKeyedProperties() - Method in interface org.archive.spring.HasKeyedProperties
getKryo() - Method in class org.archive.bdb.KryoBinding
getLargestValue() - Method in class org.archive.util.Histotable: Return the largest value of any key that is larger than 0.
getLsFileMap(String) - Method in class org.archive.net.ClientSFTP
getMap() - Method in class org.archive.spring.Sheet: Return map of full bean-path (starting with a target bean-name) to the alternate value for that targeted property
getMap() - Method in class org.archive.util.ObjectIdentityMemCache: Offer raw map access for convenience of checkpoint/recovery.
getName() - Method in class org.archive.checkpointing.Checkpoint
getName() - Method in class org.archive.spring.ConfigPath
getName() - Method in class org.archive.spring.Sheet
getName() - Method in interface org.archive.util.ms.Entry
getNext() - Method in interface org.archive.util.ms.Entry
getNextBlock(int) - Method in interface org.archive.util.ms.BlockFileSystem: Returns the number of the block that follows the given block.
getNextBlock(int) - Method in class org.archive.util.ms.DefaultBlockFileSystem
getObjectCache(String, boolean, Class<V>) - Method in class org.archive.bdb.BdbModule
getObjectCache(String, boolean, Class<V>, Class<? extends V>) - Method in class org.archive.bdb.BdbModule: Get an ObjectIdentityCache, backed by a BDB Database of the given name, with objects of the given valueClass type.
getOIBCCache(String, boolean, Class<? extends V>) - Method in class org.archive.bdb.BdbModule: Get an ObjectIdentityBdbCache, backed by a BDB Database of the given name, with the given value class type.
getOrder() - Method in class org.archive.spring.ConfigPathConfigurer: Act as late as possible.
getOrUse(String, Supplier<V>) - Method in class org.archive.util.ObjectIdentityBdbManualCache
getOrUse(String, Supplier<V>) - Method in interface org.archive.util.ObjectIdentityCache: get the object under the given key/name, using (and remembering) the object supplied by the supplier if no prior mapping exists -- but should not mutate object state
getOrUse(String, Supplier<V>) - Method in class org.archive.util.ObjectIdentityMemCache
getOverlayMap(String) - Method in interface org.archive.spring.OverlayContext: get the map corresponding to the overlay name
getOverlayMap(String) - Method in interface org.archive.spring.OverlayMapsSource
getOverlayNames() - Method in interface org.archive.spring.OverlayContext: return a list of the names of overlay maps to consider
getOverrideKeys(String) - Method in class org.archive.spring.KeyedProperties: Compose the complete keys (externalPath + local key name) to use for checking for contextual overrides.
getPath() - Method in class org.archive.spring.ConfigPath
getPath() - Method in class org.archive.spring.ConfigPathConfigurer
getPrevious() - Method in interface org.archive.util.ms.Entry
getPrimaryConfigurationPath() - Method in class org.archive.spring.PathSharingContext
getRawInput() - Method in interface org.archive.util.ms.BlockFileSystem: Returns the raw input stream for this file system.
getRawInput() - Method in class org.archive.util.ms.DefaultBlockFileSystem
getReference(ObjectName) - Static method in class org.archive.util.JndiUtils
getReplyStrings() - Method in class org.archive.net.ClientFTP
getRoot() - Method in interface org.archive.util.ms.BlockFileSystem: Returns the root entry of the file system.
getRoot() - Method in class org.archive.util.ms.DefaultBlockFileSystem
getShortName() - Method in class org.archive.checkpointing.Checkpoint
getSizeBytes() - Method in interface org.archive.util.BloomFilter: The amount of memory in bytes consumed by the bloom bitfield.
getSizeBytes() - Method in class org.archive.util.BloomFilter64bit
getSlotState(long) - Method in class org.archive.util.AbstractLongFPSet: Check the state of a slot in the storage.
getSlotState(long) - Method in class org.archive.util.fingerprint.MemLongFPSet
getSortedByCounts() - Method in class org.archive.util.Histotable
getSortedByKeys() - Method in class org.archive.util.Histotable
getSortedDuplicates() - Method in class org.archive.bdb.BdbModule.BdbConfig
getStoredMap(String, Class<K>, Class<V>, boolean, boolean) - Method in class org.archive.bdb.BdbModule: Creates a database-backed TempStoredSortedMap for transient reporting requirements.
getStoredQueue(String, Class<K>, boolean) - Method in class org.archive.bdb.BdbModule
getSubContext(String) - Static method in class org.archive.util.JndiUtils: Get subcontext.
getSubContext(CompoundName) - Static method in class org.archive.util.JndiUtils: Get subcontext.
getSuccess() - Method in class org.archive.checkpointing.Checkpoint
getTags() - Method in class org.archive.io.ReadSourceEditor
getTags() - Method in class org.archive.spring.ConfigPathEditor
getTestEnvironment(File) - Static method in class org.archive.util.bdbje.EnhancedEnvironment: Create a temporary test environment in the given directory.
getText(File) - Static method in class org.archive.util.ms.Doc: Returns the text of the given .doc file.
getText(String) - Static method in class org.archive.util.ms.Doc: Returns the text of the .doc file with the given file name.
getText(SeekInputStream) - Static method in class org.archive.util.ms.Doc: Returns the text of the given .doc file.
getText(BlockFileSystem, int) - Static method in class org.archive.util.ms.Doc: Returns the text for the given .doc file.
getTotal() - Method in class org.archive.util.Histotable: Return the total of all tallies.
getType() - Method in interface org.archive.util.ms.Entry
getUseHardLinkCheckpoints() - Method in class org.archive.bdb.BdbModule
getUseSharedCache() - Method in class org.archive.bdb.BdbModule
getValidator() - Method in interface org.archive.spring.HasValidator
getValue() - Method in class org.archive.io.ReadSourceEditor
getValue() - Method in class org.archive.spring.ConfigFileEditor
getValue() - Method in class org.archive.spring.ConfigPathEditor
getValue() - Method in class org.archive.spring.ConfigString
gzipFile - Variable in class org.archive.io.CrawlerJournal: File we're writing journal to.

H

handleUnregisteredClass(Class) - Method in class org.archive.bdb.AutoKryo
hash(CharSequence) - Method in class org.archive.util.LongToIntConsistentHash
HasKeyedProperties - Interface in org.archive.spring: Interface indicating an object has an internal map of properties, and thus at least partially amenable to sheet-based contextual overriding of properties.
hasNext() - Method in class org.archive.util.iterator.CompositeIterator
HasValidator - Interface in org.archive.spring
hasValidStamp(File) - Static method in class org.archive.checkpointing.Checkpoint
haveOverlayNamesBeenSet() - Method in interface org.archive.spring.OverlayContext: test if this context has actually been configured with overlays (even if in fact no overlays were added)
headSetInclusive(SortedSet<String>, String) - Static method in class org.archive.util.PrefixFinder
HeritrixLifecycleProcessor - Class in org.archive.spring: Stand-in LifecycleProcessor to avoid a full automatic start() when our ApplicationContext (PathSharingContext) is built ('refreshed').
HeritrixLifecycleProcessor() - Constructor for class org.archive.spring.HeritrixLifecycleProcessor
Histotable<K> - Class in org.archive.util: Collect and report frequency information.
Histotable() - Constructor for class org.archive.util.Histotable
hookupDatabase(Database, Class<E>, StoredClassCatalog) - Method in class org.archive.bdb.StoredQueue
HTML_TAGS - Static variable in class org.archive.util.UriUtils

I

IdentityCacheable - Interface in org.archive.util: Common interface for objects held in ObjectIdentityCaches.
ignoresThrowable() - Method in class org.archive.util.OneLineSimpleLayout
INDEX_FORMAT - Static variable in class org.archive.checkpointing.Checkpoint: format for serial numbers
indexOfCurrentIterator - Variable in class org.archive.util.iterator.CompositeIterator
INITARGS - Static variable in class org.archive.bdb.AutoKryo
initialize(Environment, String, Class, StoredClassCatalog) - Method in class org.archive.util.ObjectIdentityBdbManualCache: Call this method when you have an instance when you used the default constructor or when you have a deserialized instance that you want to reconnect with an extant bdbje environment.
initialize(File) - Method in class org.archive.io.CrawlerJournal
initLaunchDir() - Method in class org.archive.spring.PathSharingContext
initLaunchId() - Method in class org.archive.spring.PathSharingContext
initLifecycleProcessor() - Method in class org.archive.spring.PathSharingContext: Initialize the LifecycleProcessor.
installReplicasUpTo(int) - Method in class org.archive.util.LongToIntConsistentHash: Install necessary replicas, if not already present.
instance - Variable in class org.archive.util.Supplier
INSTANCE - Static variable in interface org.archive.util.CLibrary
INSTANCE - Static variable in interface org.archive.util.FilesystemLinkMaker.Kernel32Library
interpolate(String) - Method in class org.archive.spring.ConfigPathConfigurer
invokeStatic(String, Class<?>, Class<?>[], Object[]) - Method in class org.archive.bdb.AutoKryo
isAllowCreate() - Method in class org.archive.bdb.BdbModule.BdbConfig
isARCType(String) - Method in class org.archive.io.Warc2Arc
isConnected() - Method in class org.archive.net.ClientSFTP
isDirectory(String) - Method in class org.archive.net.ClientSFTP
isEmpty() - Method in class org.archive.bdb.StoredQueue
isLikelyFalsePositive(CharSequence) - Static method in class org.archive.util.UriUtils
isLikelyUri(CharSequence) - Static method in class org.archive.util.UriUtils: Deprecated.
produces too many false positives, UriUtils.isVeryLikelyUri(CharSequence) is preferred
isLikelyUriHtmlContextLegacy(CharSequence) - Static method in class org.archive.util.UriUtils
isLikelyUriJavascriptContextLegacy(CharSequence) - Static method in class org.archive.util.UriUtils
isPaintable() - Method in class org.archive.io.ReadSourceEditor
isPaintable() - Method in class org.archive.spring.ConfigPathEditor
isPossibleUri(CharSequence) - Static method in class org.archive.util.UriUtils
isRunning - Variable in class org.archive.bdb.BdbModule
isRunning() - Method in class org.archive.bdb.BdbModule
isTransactional() - Method in class org.archive.bdb.BdbModule.BdbConfig
isUnicode() - Method in class org.archive.util.ms.Piece
isVeryLikelyUri(CharSequence) - Static method in class org.archive.util.UriUtils
iterator - Variable in class org.archive.util.Iteratorable
iterator() - Method in class org.archive.bdb.StoredQueue
iterator() - Method in class org.archive.util.Iteratorable
Iteratorable<K> - Class in org.archive.util: Make an Iterator usable as an Iterable (and thus enable new-style for-each loops).
Iteratorable(Iterator<K>) - Constructor for class org.archive.util.Iteratorable
iterators - Variable in class org.archive.util.iterator.CompositeIterator

J

JavaLiterals - Class in org.archive.util: Utility functions to escape or unescape Java literal strings.
JavaLiterals() - Constructor for class org.archive.util.JavaLiterals
jeCleanerThreads - Variable in class org.archive.bdb.BdbModule: Configure the number of cleaner threads (-1 means use the default) https://docs.oracle.com/cd/E17277_02/html/java/com/sleepycat/je/EnvironmentConfig.html#CLEANER_THREADS
JndiUtils - Class in org.archive.util: JNDI utilities.
JndiUtils() - Constructor for class org.archive.util.JndiUtils
JSONUtils - Class in org.archive.util: Utilities for working with JSON/JSONObjects.
JSONUtils() - Constructor for class org.archive.util.JSONUtils

K

KeyedProperties - Class in org.archive.spring: Map for storing overridable properties.
KeyedProperties() - Constructor for class org.archive.spring.KeyedProperties
keySet() - Method in class org.archive.util.ObjectIdentityBdbManualCache
keySet() - Method in interface org.archive.util.ObjectIdentityCache: set of all keys
keySet() - Method in class org.archive.util.ObjectIdentityMemCache
KeyTool - Class in org.archive.util: Wrapper for "keytool" utility main class.
KeyTool() - Constructor for class org.archive.util.KeyTool
KNOWN_GOOD_FILE_EXTENSIONS - Static variable in class org.archive.util.UriUtils
kryo - Variable in class org.archive.bdb.KryoBinding
KryoBinding<K> - Class in org.archive.bdb: Binding for use with BerkeleyDB-JE that uses Kryo serialization rather than BDB's (custom version of) Java serialization.
KryoBinding(Class<K>) - Constructor for class org.archive.bdb.KryoBinding: Constructor.

L

LIKELY_RELATIVE_URI_PATTERN - Static variable in class org.archive.util.UriUtils
LIKELY_URI_PATH - Static variable in class org.archive.util.UriUtils
linePos - Variable in class org.archive.util.PaddingStringBuffer
lines - Variable in class org.archive.io.CrawlerJournal: line count
link(String, String) - Method in interface org.archive.util.CLibrary
list() - Method in interface org.archive.util.ms.Entry
loadFactor - Variable in class org.archive.util.AbstractLongFPSet: The load factor, as a fraction.
loadJson(String) - Method in class org.archive.checkpointing.Checkpoint
loadOverridesFrom(OverlayContext) - Static method in class org.archive.spring.KeyedProperties
loadReader(String, String) - Method in class org.archive.checkpointing.Checkpoint
LOG_ERROR - Static variable in class org.archive.io.CrawlerJournal: prefix for error lines
LOG_TIMESTAMP - Static variable in class org.archive.io.CrawlerJournal: prefix for timestamp lines
LongFPSet - Interface in org.archive.util.fingerprint: Set for holding primitive long fingerprints.
LongFPSetCache - Class in org.archive.util.fingerprint: Like a MemLongFPSet, but with fixed capacity and maximum size.
LongFPSetCache() - Constructor for class org.archive.util.fingerprint.LongFPSetCache
LongFPSetCache(int, float) - Constructor for class org.archive.util.fingerprint.LongFPSetCache
LongFPSetTestCase - Class in org.archive.util.fingerprint: JUnit test suite for LongFPSet.
LongFPSetTestCase(String) - Constructor for class org.archive.util.fingerprint.LongFPSetTestCase: Create a new LongFPSetTest object
LongToIntConsistentHash - Class in org.archive.util: Simple consistent-hashing implementation: provided a long and an integer bucket-number upper-bound (exclusive), return the matching integer.
LongToIntConsistentHash() - Constructor for class org.archive.util.LongToIntConsistentHash
LongToIntConsistentHash(int) - Constructor for class org.archive.util.LongToIntConsistentHash
LPSECURITY_ATTRIBUTES() - Constructor for class org.archive.util.FilesystemLinkMaker.Kernel32Library.LPSECURITY_ATTRIBUTES
lpSecurityDescriptor - Variable in class org.archive.util.FilesystemLinkMaker.Kernel32Library.LPSECURITY_ATTRIBUTES
LRU<K,V> - Class in org.archive.util: A least-recently used cache.
LRU(int) - Constructor for class org.archive.util.LRU: Constructor.

M

main(String[]) - Static method in class org.archive.io.Arc2Warc: Command-line interface to Arc2Warc.
main(String[]) - Static method in class org.archive.io.Warc2Arc: Command-line interface to Arc2Warc.
main(String[]) - Static method in class org.archive.util.FilesystemLinkMaker
main(String[]) - Static method in class org.archive.util.JndiUtils: Testing code.
main(String[]) - Static method in class org.archive.util.KeyTool
main(String[]) - Static method in class org.archive.util.OneLineSimpleLogger: Test this logger.
make(long, int) - Static method in class st.ata.util.FPGenerator: Return a fingerprint generator.
makeDirty() - Method in interface org.archive.util.IdentityCacheable
makeHardLink(String, String) - Static method in class org.archive.util.FilesystemLinkMaker: Wrapper over platform-dependent system calls to create a hard link.
makeLongFPSet() - Method in class org.archive.util.fingerprint.LongFPSetTestCase
makeOne(String, boolean, String) - Method in class org.archive.net.UURIFactory
makeOne(UsableURI, UsableURI) - Method in class org.archive.net.UURIFactory
makePackageSuite(Class<?>) - Static method in class org.archive.util.TestUtils
makeSpace() - Method in class org.archive.util.AbstractLongFPSet: Make additional space to keep the load under the target loadFactor level.
makeSpace() - Method in class org.archive.util.fingerprint.LongFPSetCache
makeSpace() - Method in class org.archive.util.fingerprint.MemLongFPSet
makeSuite(File, File) - Static method in class org.archive.util.TestUtils
makeSymbolicLink(String, String) - Static method in class org.archive.util.FilesystemLinkMaker: Wrapper over platform-dependent system calls to create a symbolic link.
map - Variable in class org.archive.spring.Sheet: map of full property-paths (from BeanFactory to individual property) and their changed value when this Sheet of overrides is in effect
map - Variable in class org.archive.util.ObjectIdentityMemCache
MemLongFPSet - Class in org.archive.util.fingerprint: Open-addressing in-memory hash set for holding primitive long fingerprints.
MemLongFPSet() - Constructor for class org.archive.util.fingerprint.MemLongFPSet
MemLongFPSet(int, float) - Constructor for class org.archive.util.fingerprint.MemLongFPSet
memMap - Variable in class org.archive.util.ObjectIdentityBdbManualCache: in-memory map of new/recent/still-referenced-elsewhere instances
merge(ConfigPath) - Method in class org.archive.spring.ConfigPath: To maintain ConfigPath's 'base' and object-identity, this merge should be used to updated ConfigPath properties in other beans, rather than discarding the old value.
mkdir(String) - Method in class org.archive.net.ClientSFTP

N

NAIVE_LIKELY_URI_PATTERN - Static variable in class org.archive.util.UriUtils
name - Variable in class org.archive.checkpointing.Checkpoint
name - Variable in class org.archive.spring.ConfigPath
name - Variable in class org.archive.spring.HeritrixLifecycleProcessor
name - Variable in class org.archive.spring.Sheet: unique name of this Sheet; if Sheet has a beanName from original configuration, that is always the name -- but the name might also be another string, in the case of Sheets added after initial container wiring
newInstance(Class<T>) - Method in class org.archive.bdb.AutoKryo
newline() - Method in class org.archive.util.PaddingStringBuffer: Forces a new line in the buffer.
next() - Method in class org.archive.util.iterator.CompositeIterator
nextSearch() - Method in class org.archive.surt.SURTTokenizer: update internal state and return the next smaller search string for the url
nLength - Variable in class org.archive.util.FilesystemLinkMaker.Kernel32Library.LPSECURITY_ATTRIBUTES
noteAccess(long) - Method in class org.archive.util.fingerprint.LongFPSetCache
noteLine() - Method in class org.archive.io.CrawlerJournal: Count and note a line
numReplicas - Variable in class org.archive.util.LongToIntConsistentHash

O

ObjectIdentityBdbManualCache<V extends IdentityCacheable> - Class in org.archive.util: A BDB JE backed object cache.
ObjectIdentityBdbManualCache() - Constructor for class org.archive.util.ObjectIdentityBdbManualCache: Constructor.
ObjectIdentityCache<V extends IdentityCacheable> - Interface in org.archive.util: An object cache for create-once-by-name-and-then-reuse objects.
ObjectIdentityMemCache<V extends IdentityCacheable> - Class in org.archive.util: Trivial all-in-memory object cache, using a single internal ConcurrentHashMap.
ObjectIdentityMemCache() - Constructor for class org.archive.util.ObjectIdentityMemCache
ObjectIdentityMemCache(int, float, int) - Constructor for class org.archive.util.ObjectIdentityMemCache
objectToEntry(K, DatabaseEntry) - Method in class org.archive.bdb.KryoBinding: Copies superclass simply to allow different source for FastOoutputStream.
obtainReader() - Method in class org.archive.spring.ConfigFile
obtainReader() - Method in class org.archive.spring.ConfigString
obtainWriter() - Method in class org.archive.spring.ConfigFile
obtainWriter() - Method in interface org.archive.spring.WriteTarget: Obtain a Writer for changing this object's contents.
obtainWriter(boolean) - Method in class org.archive.spring.ConfigFile
obtainWriter(boolean) - Method in interface org.archive.spring.WriteTarget: Obtain a Writer for changing this object's contents.
offer(E) - Method in class org.archive.bdb.StoredQueue
onApplicationEvent(ApplicationEvent) - Method in class org.archive.spring.ConfigPathConfigurer: Fix all beans with ConfigPath properties that lack a base path or a name, to use a job-implied base path and name.
OneLineSimpleLayout - Class in org.archive.util
OneLineSimpleLayout() - Constructor for class org.archive.util.OneLineSimpleLayout
OneLineSimpleLogger - Class in org.archive.util: Logger that writes entry on one line with less verbose date.
OneLineSimpleLogger() - Constructor for class org.archive.util.OneLineSimpleLogger
onRefresh() - Method in class org.archive.spring.HeritrixLifecycleProcessor
open() - Method in interface org.archive.util.ms.Entry
openDatabase(Environment, String) - Method in class org.archive.util.ObjectIdentityBdbManualCache
openDatabase(String, BdbModule.BdbConfig, boolean) - Method in class org.archive.bdb.BdbModule: Open a Database inside this BdbModule's environment, and remember it for automatic close-at-module-stop.
openDataConnection(int, String) - Method in class org.archive.net.ClientFTP: Opens a data connection.
openSFTPChannel() - Method in class org.archive.net.ClientSFTP
org.archive.bdb - package org.archive.bdb
org.archive.checkpointing - package org.archive.checkpointing
org.archive.io - package org.archive.io
org.archive.net - package org.archive.net
org.archive.spring - package org.archive.spring
org.archive.surt - package org.archive.surt
org.archive.util - package org.archive.util
org.archive.util.bdbje - package org.archive.util.bdbje
org.archive.util.fingerprint - package org.archive.util.fingerprint
org.archive.util.iterator - package org.archive.util.iterator
org.archive.util.ms - package org.archive.util.ms: Memory-efficient reading of .doc files.
out - Variable in class org.archive.io.CrawlerJournal: Stream on which we record frontier events.
OverlayContext - Interface in org.archive.spring: Interface for objects that can contribute 'overlays' to replace the usual values in configured objects.
OverlayMapsSource - Interface in org.archive.spring: Interface for a source of overlay maps by name.
overridesActiveFrom(OverlayContext) - Static method in class org.archive.spring.KeyedProperties

P

PaddingStringBuffer - Class in org.archive.util: StringBuffer-like utility which can add spaces to reach a certain column.
PaddingStringBuffer() - Constructor for class org.archive.util.PaddingStringBuffer: Create a new PaddingStringBuffer
padTo(int) - Method in class org.archive.util.PaddingStringBuffer: Pad to a given column.
paintValue(Graphics, Rectangle) - Method in class org.archive.io.ReadSourceEditor
paintValue(Graphics, Rectangle) - Method in class org.archive.spring.ConfigPathEditor
parseRevision(String) - Static method in class org.archive.io.Warc2Arc
path - Variable in class org.archive.spring.ConfigPath
path - Variable in class org.archive.spring.ConfigPathConfigurer: 'home' directory for all other paths to be resolved relative to; defaults to directory of primary XML config file
PathSharingContext - Class in org.archive.spring: Spring ApplicationContext extended for Heritrix use.
PathSharingContext(String) - Constructor for class org.archive.spring.PathSharingContext
PathSharingContext(String[]) - Constructor for class org.archive.spring.PathSharingContext
PathSharingContext(String[], boolean) - Constructor for class org.archive.spring.PathSharingContext
PathSharingContext(String[], boolean, ApplicationContext) - Constructor for class org.archive.spring.PathSharingContext
PathSharingContext(String[], ApplicationContext) - Constructor for class org.archive.spring.PathSharingContext
peek() - Method in class org.archive.bdb.StoredQueue
peekItem - Variable in class org.archive.bdb.StoredQueue
Piece - Class in org.archive.util.ms
Piece(int, int, int, boolean) - Constructor for class org.archive.util.ms.Piece
poll() - Method in class org.archive.bdb.StoredQueue
polynomial - Variable in class st.ata.util.FPGenerator: The polynomial used by this to generate fingerprints.
polynomials - Static variable in class st.ata.util.FPGenerator: Array of irreducible polynomials.
popOverridesContext() - Static method in class org.archive.spring.KeyedProperties: Remove last-added override map from the stack
position() - Method in class org.archive.util.ms.BlockInputStream
position(long) - Method in class org.archive.util.ms.BlockInputStream
postProcessAfterInitialization(Object, String) - Method in class org.archive.spring.ConfigPathConfigurer: Remember all beans for later fixup.
postProcessBeforeInitialization(Object, String) - Method in class org.archive.spring.ConfigPathConfigurer
PrefixFinder - Class in org.archive.util: Utility class for extracting prefixes of a given string from a SortedMap.
PrefixFinder() - Constructor for class org.archive.util.PrefixFinder
prefixKey(String) - Static method in class org.archive.surt.SURTTokenizer
prime() - Method in class org.archive.spring.Sheet: Ensure any properties targeted by this Sheet know to check the right property paths for overrides at lookup time, and that the override values are compatible types for their destination properties.
propertyName - Variable in class org.archive.spring.BeanFieldsPatternValidator.PropertyPatternRule
PropertyPatternRule(String, String, String) - Constructor for class org.archive.spring.BeanFieldsPatternValidator.PropertyPatternRule
protocolCommandSent(ProtocolCommandEvent) - Method in class org.archive.net.ClientFTP
protocolReplyReceived(ProtocolCommandEvent) - Method in class org.archive.net.ClientFTP
pushOverrideContext(OverlayContext) - Static method in class org.archive.spring.KeyedProperties: Add an override map to the stack
put(FileInputStream, String) - Method in class org.archive.net.ClientSFTP
putAllAtomicLongs(Map<String, AtomicLong>, JSONObject) - Static method in class org.archive.util.JSONUtils
putAllLongs(Map<String, Long>, JSONObject) - Static method in class org.archive.util.JSONUtils

Q

QNV - Static variable in class org.archive.util.UriUtils
queueDb - Variable in class org.archive.bdb.StoredQueue
queueMap - Variable in class org.archive.bdb.StoredQueue
quickContains(long) - Method in class org.archive.util.AbstractLongFPSet: Low-cost, non-definitive (except when true) contains test.
quickContains(long) - Method in class org.archive.util.fingerprint.ArrayLongFPCache
quickContains(long) - Method in interface org.archive.util.fingerprint.LongFPSet: Do a contains() check that doesn't require laggy activity (eg disk IO).
quickContains(long) - Method in class org.archive.util.fingerprint.MemLongFPSet

R

raAppend(int, int) - Method in class org.archive.util.PaddingStringBuffer: Append an int right-aligned to the given column.
raAppend(int, long) - Method in class org.archive.util.PaddingStringBuffer: Append a long, right-aligned to the given column.
raAppend(int, String) - Method in class org.archive.util.PaddingStringBuffer: Append a string, right-aligned to the given columm.
read() - Method in class org.archive.util.ms.BlockInputStream
read(byte[]) - Method in class org.archive.util.ms.BlockInputStream
read(byte[], int, int) - Method in class org.archive.util.ms.BlockInputStream
readObjectData(Kryo, ByteBuffer) - Method in class org.archive.net.UURI
ReadSourceEditor<T> - Class in org.archive.io: PropertyEditor allowing Strings to become ConfigString instances (implementing ReadSource).
ReadSourceEditor() - Constructor for class org.archive.io.ReadSourceEditor
recordControlMessage(String, String) - Method in class org.archive.net.ClientFTP
recoveryCheckpoint - Variable in class org.archive.bdb.BdbModule
reduce(long) - Method in class st.ata.util.FPGenerator: Return a value equal (mod polynomial) to fp and of degree less than degree.
REFLECTION_FACTORY - Static variable in class org.archive.bdb.AutoKryo
registeredClasses - Variable in class org.archive.bdb.AutoKryo
relocate(long, long, long) - Method in class org.archive.util.AbstractLongFPSet
relocate(long, long, long) - Method in class org.archive.util.fingerprint.MemLongFPSet
remember(String, ConfigPath) - Method in class org.archive.spring.ConfigPathConfigurer
remove() - Method in class org.archive.util.iterator.CompositeIterator
remove(long) - Method in class org.archive.util.AbstractLongFPSet
remove(long) - Method in class org.archive.util.fingerprint.ArrayLongFPCache
remove(long) - Method in interface org.archive.util.fingerprint.LongFPSet: Remove a fingerprint from the set, if it is there
removeAt(long) - Method in class org.archive.util.AbstractLongFPSet: Remove the value at the given index, relocating its successors as necessary.
removeEldestEntry(Map.Entry<K, V>) - Method in class org.archive.util.LRU
removePropertyChangeListener(PropertyChangeListener) - Method in class org.archive.io.ReadSourceEditor
removePropertyChangeListener(PropertyChangeListener) - Method in class org.archive.spring.ConfigPathEditor
replicaLocation(int, int) - Method in class org.archive.util.LongToIntConsistentHash
replicasInstalledUpTo - Variable in class org.archive.util.LongToIntConsistentHash
ReportUtils - Class in org.archive.util
ReportUtils() - Constructor for class org.archive.util.ReportUtils
requiredPattern - Variable in class org.archive.spring.BeanFieldsPatternValidator.PropertyPatternRule
reset() - Method in class org.archive.util.PaddingStringBuffer: reset the buffer back to empty
rm(String) - Method in class org.archive.net.ClientSFTP
ROOT - org.archive.util.ms.Entry.EntryType
rotateForCheckpoint(Checkpoint) - Method in class org.archive.io.CrawlerJournal: Handle a checkpoint by rotating the current log to a checkpoint-named file and starting a new log.
rules - Variable in class org.archive.spring.BeanFieldsPatternValidator

S

saveJson(String, JSONObject) - Method in class org.archive.checkpointing.Checkpoint
saveWriter(String, String) - Method in class org.archive.checkpointing.Checkpoint
serialize(Object) - Static method in class org.archive.util.TestUtils
seriousError(String) - Method in class org.archive.io.CrawlerJournal: Note a serious error vioa a special log line
session - Variable in class org.archive.net.ClientSFTP
setAllowCreate(boolean) - Method in class org.archive.bdb.BdbModule.BdbConfig
setApplicationContext(ApplicationContext) - Method in class org.archive.spring.ConfigPathConfigurer: Remember ApplicationContext, and if possible primary configuration file's home directory.
setAsText(String) - Method in class org.archive.io.ReadSourceEditor
setAsText(String) - Method in class org.archive.spring.ConfigPathEditor
setAt(long, long) - Method in class org.archive.util.AbstractLongFPSet: Set the stored value at the given slot.
setAt(long, long) - Method in class org.archive.util.fingerprint.MemLongFPSet
setBase(ConfigPath) - Method in class org.archive.spring.ConfigPath
setBeanFactory(BeanFactory) - Method in class org.archive.spring.Sheet
setBeanName(String) - Method in class org.archive.spring.HeritrixLifecycleProcessor
setBeanName(String) - Method in class org.archive.spring.Sheet
setCachePercent(int) - Method in class org.archive.bdb.BdbModule
setCacheSize(int) - Method in class org.archive.bdb.BdbModule
setCapacity(int) - Method in class org.archive.util.fingerprint.ArrayLongFPCache
setCheckpointDir(ConfigPath) - Method in class org.archive.checkpointing.Checkpoint
setCleanerThreads(int) - Method in class org.archive.bdb.BdbModule
setConfigurer(ConfigPathConfigurer) - Method in class org.archive.spring.ConfigPath
setConsoleHandler() - Static method in class org.archive.util.OneLineSimpleLogger
setDeferredWrite(boolean) - Method in class org.archive.bdb.BdbModule.BdbConfig
setDir(ConfigPath) - Method in class org.archive.bdb.BdbModule
setEvictorCoreThreads(int) - Method in class org.archive.bdb.BdbModule
setEvictorMaxThreads(int) - Method in class org.archive.bdb.BdbModule
setExpectedConcurrency(int) - Method in class org.archive.bdb.BdbModule
setForgetAllButLatest(boolean) - Method in class org.archive.checkpointing.Checkpoint
setIdentityCache(ObjectIdentityCache<?>) - Method in interface org.archive.util.IdentityCacheable
setMap(Map<String, Object>) - Method in class org.archive.spring.Sheet: Set map of property full bean-path (starting with a target bean-name) to alternate values.
setName(String) - Method in class org.archive.spring.ConfigPath
setName(String) - Method in class org.archive.spring.Sheet
setPath(String) - Method in class org.archive.spring.ConfigPath
setRecoveryCheckpoint(Checkpoint) - Method in class org.archive.bdb.BdbModule
setRecoveryCheckpoint(Checkpoint) - Method in interface org.archive.checkpointing.Checkpointable: Used to inform a bean that it should restore its state from the given Checkpoint when launched (Lifecycle start()).
setSortedDuplicates(boolean) - Method in class org.archive.bdb.BdbModule.BdbConfig
setSuccess(boolean) - Method in class org.archive.checkpointing.Checkpoint
setTransactional(boolean) - Method in class org.archive.bdb.BdbModule.BdbConfig
setup(File, boolean) - Method in class org.archive.bdb.BdbModule
setUp() - Method in class org.archive.util.fingerprint.LongFPSetTestCase
setUseHardLinkCheckpoints(boolean) - Method in class org.archive.bdb.BdbModule
setUseSharedCache(boolean) - Method in class org.archive.bdb.BdbModule
setValue(Object) - Method in class org.archive.io.ReadSourceEditor
setValue(Object) - Method in class org.archive.spring.ConfigPathEditor
setValue(String) - Method in class org.archive.spring.ConfigString
Sheet - Class in org.archive.spring: Collection of overrides: alternative values for object properties that should apply in some contexts.
Sheet() - Constructor for class org.archive.spring.Sheet
shortName - Variable in class org.archive.checkpointing.Checkpoint
shortReportLine(Reporter) - Static method in class org.archive.util.ReportUtils: Utility method to get a String shortReportLine from Reporter
size() - Method in class org.archive.bdb.StoredQueue
size() - Method in interface org.archive.util.BloomFilter: The number of character sequences in the filter (considered to be the number of add()s that returned 'true')
size() - Method in class org.archive.util.BloomFilter64bit: The number of character sequences in the filter.
size() - Method in class org.archive.util.ObjectIdentityBdbManualCache
size() - Method in interface org.archive.util.ObjectIdentityCache: count of name-to-object contained
size() - Method in class org.archive.util.ObjectIdentityMemCache
skip(long) - Method in class org.archive.util.ms.BlockInputStream
slots - Variable in class org.archive.util.fingerprint.MemLongFPSet
smear - Variable in class org.archive.util.fingerprint.ArrayLongFPCache
sn - Variable in class org.archive.bdb.BdbModule: uniqueness serial number for temp map databases
snapshotToLaunchDir(File) - Method in class org.archive.spring.ConfigPathConfigurer
sortedDuplicates - Variable in class org.archive.bdb.BdbModule.BdbConfig
speculativeFixup(String, UURI) - Static method in class org.archive.util.UriUtils: Perform additional fixup of likely-URI Strings
st.ata.util - package st.ata.util
start() - Method in class org.archive.bdb.BdbModule
start() - Method in class org.archive.spring.PathSharingContext
startCheckpoint(Checkpoint) - Method in class org.archive.bdb.BdbModule
startCheckpoint(Checkpoint) - Method in interface org.archive.checkpointing.Checkpointable: Note a checkpoint is about to begin.
std24 - Static variable in class st.ata.util.FPGenerator: A standard 24-bit fingerprint generator using polynomials[0][24].
std32 - Static variable in class st.ata.util.FPGenerator: A standard 32-bit fingerprint generator using polynomials[0][32].
std40 - Static variable in class st.ata.util.FPGenerator: A standard 40-bit fingerprint generator using polynomials[0][40].
std64 - Static variable in class st.ata.util.FPGenerator: The standard 64-bit fingerprint generator using polynomials[0][64].
stop() - Method in class org.archive.bdb.BdbModule
StoredQueue<E extends Serializable> - Class in org.archive.bdb: Queue backed by a JE Collections StoredSortedMap.
StoredQueue(Database, Class<E>, StoredClassCatalog) - Constructor for class org.archive.bdb.StoredQueue: Create a StoredQueue backed by the given Database.
STRING_URI_DETECTOR - Static variable in class org.archive.util.UriUtils
STRING_URI_DETECTOR_EXCEPTIONS - Static variable in class org.archive.util.UriUtils
subtract(Histotable<K>) - Method in class org.archive.util.Histotable
success - Variable in class org.archive.checkpointing.Checkpoint
Supplier<V> - Class in org.archive.util: Class for optionally providing one instance of the parameterized type.
Supplier() - Constructor for class org.archive.util.Supplier
Supplier(V) - Constructor for class org.archive.util.Supplier
supports(Class<?>) - Method in class org.archive.spring.BeanFieldsPatternValidator
supportsCustomEditor() - Method in class org.archive.io.ReadSourceEditor
supportsCustomEditor() - Method in class org.archive.spring.ConfigPathEditor
SURTTokenizer - Class in org.archive.surt: provides iterative Url reduction for prefix matching to find ever coarser grained URL-specific configuration.
SURTTokenizer(String) - Constructor for class org.archive.surt.SURTTokenizer: constructor
symlink(String, String) - Method in interface org.archive.util.CLibrary
sync() - Method in class org.archive.util.ObjectIdentityBdbManualCache: Sync all in-memory map entries to backing disk store.
sync() - Method in interface org.archive.util.ObjectIdentityCache: force the persistent backend, if any, to be updated with all live object state
sync() - Method in class org.archive.util.ObjectIdentityMemCache

T

tailIndex - Variable in class org.archive.bdb.StoredQueue
tally(K) - Method in class org.archive.util.Histotable: Record one more occurrence of the given object key.
tally(K, long) - Method in class org.archive.util.Histotable: Record count more occurrence(s) of the given object key.
test(BeanWrapperImpl, Errors) - Method in class org.archive.spring.BeanFieldsPatternValidator.PropertyPatternRule
testAdd() - Method in class org.archive.util.fingerprint.LongFPSetTestCase: check that we can add fingerprints
testContains() - Method in class org.archive.util.fingerprint.LongFPSetTestCase: check that contains() does what we expect
testCount() - Method in class org.archive.util.fingerprint.LongFPSetTestCase: check count works ok
testRemove() - Method in class org.archive.util.fingerprint.LongFPSetTestCase: test remove() works as expected
testSerialization(Object) - Static method in class org.archive.util.TestUtils
TestUtils - Class in org.archive.util: Utility methods useful in testing situations.
TestUtils() - Constructor for class org.archive.util.TestUtils
testWithZero() - Method in class org.archive.util.fingerprint.LongFPSetTestCase: check we can call add/remove/contains() with 0 as a value
threadBuffer - Variable in class org.archive.bdb.KryoBinding
threadOverrides - Static variable in class org.archive.spring.KeyedProperties: ThreadLocal (contextual) collection of pushed override maps
timestamp_interval - Variable in class org.archive.io.CrawlerJournal: number of lines between timestamps
tmpDir() - Static method in class org.archive.util.TestUtils
toDatabaseConfig() - Method in class org.archive.bdb.BdbModule.BdbConfig
toString() - Method in class org.archive.util.ms.Piece
toString() - Method in class org.archive.util.PaddingStringBuffer
transactional - Variable in class org.archive.bdb.BdbModule.BdbConfig
transform(File, File, boolean) - Method in class org.archive.io.Arc2Warc
transform(File, File, String, String, boolean) - Method in class org.archive.io.Warc2Arc
transform(ARCReader, File) - Method in class org.archive.io.Arc2Warc
transform(WARCReader, ARCWriter) - Method in class org.archive.io.Warc2Arc

U

unbindObjectName(Context, ObjectName) - Static method in class org.archive.util.JndiUtils
unescape(String) - Static method in class org.archive.util.JavaLiterals
UriUtils - Class in org.archive.util: URI-related utilities.
UriUtils() - Constructor for class org.archive.util.UriUtils
useHardLinkCheckpoints - Variable in class org.archive.bdb.BdbModule: Whether to use hard-links to log files to collect/retain the BDB log files needed for a checkpoint.
useSharedCache - Variable in class org.archive.bdb.BdbModule
UURI - Class in org.archive.net: Usable URI.
UURI() - Constructor for class org.archive.net.UURI
UURI(String, boolean, String) - Constructor for class org.archive.net.UURI
UURI(UsableURI, UsableURI) - Constructor for class org.archive.net.UURI
UURIFactory - Class in org.archive.net: Factory that returns UURIs.
UURIFactory() - Constructor for class org.archive.net.UURIFactory

V

validate() - Method in class org.archive.spring.PathSharingContext
validate(Object, Errors) - Method in class org.archive.spring.BeanFieldsPatternValidator
VALIDITY_STAMP_FILENAME - Static variable in class org.archive.checkpointing.Checkpoint: Name of file written with timestamp into valid checkpoints
value - Variable in class org.archive.io.ReadSourceEditor
value - Variable in class org.archive.spring.ConfigPathEditor
value - Variable in class org.archive.spring.ConfigString
valueOf(String) - Static method in enum org.archive.util.ms.Entry.EntryType: Returns the enum constant of this type with the specified name.
values - Variable in class org.archive.util.fingerprint.MemLongFPSet
values() - Static method in enum org.archive.util.ms.Entry.EntryType: Returns an array containing the constants of this enum type, in the order they are declared.

W

Warc2Arc - Class in org.archive.io: Convert WARCs to (sortof) ARCs.
Warc2Arc() - Constructor for class org.archive.io.Warc2Arc
withOverridesDo(OverlayContext, Runnable) - Static method in class org.archive.spring.KeyedProperties
write(WARCWriter, ARCRecord) - Method in class org.archive.io.Arc2Warc
writeLine(MutableString) - Method in class org.archive.io.CrawlerJournal: Write a line.
writeLine(String...) - Method in class org.archive.io.CrawlerJournal: Write a line
writeObjectData(Kryo, ByteBuffer) - Method in class org.archive.net.UURI
WriteTarget - Interface in org.archive.spring: Interface for objects that can provide a Writer for replacing or appending to their textual contents.
writeValidity(String) - Method in class org.archive.checkpointing.Checkpoint

_

_connectAction_() - Method in class org.archive.net.ClientFTP

A B C D E F G H I J K L M N O P Q R S T U V W _
All Classes|All Packages