elm.web.website_crawl.CrawlOutcome

class CrawlOutcome[source]

Bases: object

Helper class to track the outcome of a website crawl.

Methods

log_completion()

record_document(document)

Record a document retrieved during the crawl process.

record_step(result)

Record a step in the crawl process.

record_step(result)[source]

Record a step in the crawl process.

Parameters:

result (object) – The result object representing a step in the crawl process. It should have at least a “url” attribute.

record_document(document)[source]

Record a document retrieved during the crawl process.

Parameters:

document (object) – The document object retrieved during the crawl process.