linkcheck.director.aggregator

Aggregate needed object instances for checker threads.

Functions

new_request_session(config, cookies)

Create a new request session.

Classes

Aggregate(config, urlqueue, robots_txt, …)

Store thread-safe data collections for checker threads.

class linkcheck.director.aggregator.Aggregate(config, urlqueue, robots_txt, plugin_manager, result_cache)[source]

Bases: object

Store thread-safe data collections for checker threads.

Store given link checking objects.

abort()[source]

Print still-active URLs and empty the URL queue.

add_downloaded_bytes(**kwargs)[source]

Add to number of downloaded bytes.

add_request_session(**kwargs)[source]

Add a request session for current thread.

cancel()[source]

Empty the URL queue.

end_log_output(**kwargs)[source]

Print ending output to log.

finish(**kwargs)[source]

Wait for checker threads to finish.

get_check_threads(**kwargs)[source]

Return iterator of checker threads.

get_request_session(**kwargs)[source]

Get the request session for current thread.

is_finished(**kwargs)[source]

Determine if checking is finished.

print_active_threads(**kwargs)[source]

Log all currently active threads.

remove_stopped_threads(**kwargs)[source]

Remove the stopped threads from the internal thread list.

start_threads(**kwargs)[source]

Spawn threads for URL checking and status printing.

visit_loginurl()[source]

Check for a login URL and visit it.

wait_for_host(**kwargs)[source]

Throttle requests to one host.

linkcheck.director.aggregator.new_request_session(config, cookies)[source]

Create a new request session.