Computes the number of tasks needed to satisfy the quality-control algorithm given the already-collected list of tasks.
Computes the number of tasks needed to satisfy the quality-control algorithm given the already-collected list of tasks. Returns only newly-created tasks.
The complete list of previously-scheduled tasks
True if any of the latest batch of tasks suffered a timeout.
A list of new tasks to schedule on the backend.
Returns a list of blacklisted worker_ids given a set of tasks, completed or not.
Returns a list of blacklisted worker_ids given a set of tasks, completed or not.
The complete list of tasks.
A list of worker IDs.
Returns true if the strategy has enough data to stop scheduling work.
Returns true if the strategy has enough data to stop scheduling work.
The complete list of scheduled tasks.
Given a list of tasks, this method returns the same list with all but one task marked as DUPLICATE for each subset submitted by each distinct worker.
Given a list of tasks, this method returns the same list with all but one task marked as DUPLICATE for each subset submitted by each distinct worker. The task left as ANSWERED is chosen arbitrarily (the first one encountered).
A list of ANSWERED tasks.
A list of ANSWERED and DUPLICATE tasks.
Returns a string explaining why the worker's answer was not accepted.
Returns a string explaining why the worker's answer was not accepted.
The list of accepted tasks. Used to determine the correct answer.
Explanation string.
Returns the top answer.
Returns the top answer.
The complete list of tasks.
Top answer
Returns an appropriate response for when the computation ran out of money.
Returns an appropriate response for when the computation ran out of money.
The complete list of tasks.
The smallest amount of money needed to complete the computation under optimistic assumptions.
The amount of money we have.
A low-confidence or over-budget answer.