Files
MediaFusion/scrappers/README.md
T

1.5 KiB

Scrapping with Media Fusion

The project offers scraping capabilities for TamilBlasters and TamilMV. Here are the guidelines on how to use these scrapers:

TamilBlasters

  1. Setup Playwright:

    If you intend to use the scraper with Playwright, you need to ensure the Playwright browser binaries are installed. Specifically, for Firefox:

    pipenv run playwright install firefox
    
  2. Get Help on Available Options:

    To understand the available options for the scraper, run:

    pipenv run python3 -m scrappers.tamil_blasters --help
    
  3. Run the Scraper:

    Execute the scraper with the desired options based on your requirements.

    e.g. To scrap all movies & series, run:

    pipenv run python3 -m scrappers.tamil_blasters --all --scrap-with-playwright
    

    Note: You may have to solve the cloudflare validation challenge manually when its required.

TamilMV

  1. Get Help on Available Options:

    To understand the available options for the TamilMV scraper, run:

     pipenv run python3 -m scrappers.tamilmv --help
    
  2. Run the TamilMV Scraper:

    Execute the scraper with the desired options based on your requirements.

    e.g. To scrap all movies & series from TamilMV for 5 pages, run:

     pipenv run python3 -m scrappers.tamilmv --all -p 5
    

    Note: Ensure you have Playwright set up as mentioned in the TamilBlasters section if you intend to use it with the TamilMV scraper.