Extraction

In order to save space, you might want to extract the information from the HTMLs directly, without saving the HTMLs themselves. The library does allow you to do that. In this section, we will show you how you can define your own extractors.

Contents:

• Extractor types
• Extractor Definition
  • Example 1.
• BaseExtractor
  • Extraction
  • Filtering
  • Example 2.
• Extractor config file
  • Structure
  • Example
  • __init__.py
  • Arbitrary Code Execution
• Extraction utils
  • Filtering
  • Extraction