95 Commits

Author SHA1 Message Date
mhdzumair 52c8a14fec Add delete action for torrent in scraper functionalities
Enhanced the torrent block feature to support a delete action. Updated HTML dropdown, backend handling, and Telegram notifications to reflect this change. Improved user feedback for block/delete operations and ensured schema validation.
2025-02-02 21:06:07 +05:30
mhdzumair 620ad95861 Fix parsing edge cases and Fix mediaflow private IP validation logic
Addressed cases where parsing would fail due to empty elements or missing data in BT4G scraper and streaming provider parsers. Enhanced IP validation in network utilities to handle IPv6 formats with ports and brackets accurately. These changes improve robustness and prevent errors in edge scenarios.
2025-02-01 22:54:55 +05:30
mhdzumair dd9d136b5f Add sorting and ordering support to MDBList integration
Introduced sorting and ordering functionality for MDBList, allowing users to customize the display order of items. Updated backend, frontend, and database schemas to support these options, including caching, API requests, and user interface enhancements. Adjusted styles and badges for better presentation of sorting information.
2025-01-31 00:43:28 +05:30
mhdzumair c2e7e6e995 Add support for new "Adults+" certification level 2025-01-14 14:12:56 +05:30
mhdzumair f2e9e51a45 Add route and schema for migrating mediafusion IDs to IMDb IDs 2025-01-09 23:49:23 +05:30
mhdzumair e2d1e07086 Add support for MDBList Catalog support 2025-01-05 22:01:13 +05:30
mhdzumair c5915d26e5 Fix debrid cache sync endpoint url 2025-01-02 12:00:34 +05:30
mhdzumair 3b5aac130a Add support for EasyDebrid streaming provider 2025-01-02 12:00:34 +05:30
mhdzumair 79e767d287 Fix Debrid cache sync feature 2024-12-30 17:34:21 +05:30
mhdzumair 9bfecfbcd7 Add support for displaying language country flags in streams description
Introduced a feature to show country flags instead of torrent languages, controlled via a new setting in the configuration UI. Updated the parser, constants, schemas, and frontend code to support this functionality. This enhancement improves user experience by providing visual cues for language-country associations.
2024-12-30 14:50:30 +05:30
mhdzumair 5bf349f826 Add support for MediaFusion Debrid cache sync and cache status checks
Introduced endpoints to check and submit cache statuses for info hashes. Enhanced cache helpers to integrate with MediaFusion Public Host for status retrieval and syncing. Added new schemas and configurations to support these operations.
2024-12-30 14:01:17 +05:30
mhdzumair 03297f2b22 Refactor database structure for metadata handling and episode processing.
Update Crud functions for new database structure & utlize 10x performance in the catalog data fetchers with new db structure and mongodb indexes. Added support for multi season pack torrents, Updated metadata handling to use a centralized fetching mechanism and improved filters for matching existing entries. Refactored episode processing logic to account for season and episode numbers more flexibly. Enhanced querying pipelines for better performance in catalog and metadata retrieval.
2024-12-30 13:45:03 +05:30
mhdzumair 70e8d1946b Add support for private, semi-private, and webseed torrent types for prowlarr & jackett & Manual imports; store torrent file content
- Updated streaming providers to allow adding torrents by file for webseed and private torrents.
- Implemented functionality to store the content of torrent files.
2024-12-22 18:21:58 +05:30
mhdzumair 402c86b907 Add support for specifying total pages in tgx scraper tasks 2024-12-15 23:00:29 +05:30
mhdzumair 47b164b60e Add support for "Unknown" filters in nudity and certification
This update introduces the "Unknown" option for nudity and certification filters, allowing more granular control over filtering logic. Adjustments were made to validation, database queries, and schemas to handle the new filter option seamlessly. The frontend configuration UI is also updated to reflect the changes.
2024-12-15 11:16:01 +05:30
mhdzumair 47c44dfe43 Add the contributor referral link for showing randomly 2024-12-15 00:39:27 +05:30
mhdzumair 49cc1b60eb Remove obsolete spiders Streamed and StreamBTW 2024-12-07 18:37:35 +05:30
mhdzumair 85672b558a Fix torrent sorting priority key handling 2024-11-30 19:13:05 +05:30
Munif Tanjim b52a7fdf7e Read redis debrid cache for StremThru (#383) 2024-11-30 06:41:31 +05:30
mhdzumair eb9d6790ec Use aliases in SortingOption config 2024-11-29 23:14:15 +05:30
mhdzumair 29f4bd11aa Improve stream sorting with direction toggle feature
Enhanced the stream sorting functionality to support sorting direction (ascending or descending) based on user preferences in both the backend and UI. Introduced 'SortingOption' in the schema to capture sorting criteria with direction, and updated the sorting logic to accommodate these changes. Additionally, modified the user interface to include buttons for toggling sort directions, providing a more intuitive sorting experience for users.
2024-11-29 23:08:15 +05:30
mhdzumair e23a7f0474 Remove EasyDebrid shady debrid service 2024-11-29 06:04:04 +05:30
mhdzumair eaf1fbdd96 Add support for disabling streaming providers and error handling
Introduce a system for toggling streaming providers, allowing specific providers to be disabled via configuration. Enhance error handling in user data decryption by adding validation checks and returning precise error messages in JSON responses. These changes improve flexibility for administrators and provide better feedback to users.
2024-11-28 18:44:52 +05:30
mhdzumair 1ea51d9c2e Add missing trigger scraper values arab_torrents, wwe_tgx, ufc_tgx 2024-11-27 23:34:06 +05:30
ragmehos 985b4cdfbf Added Easydebrid support (#378) 2024-11-27 05:58:00 +05:30
Munif Tanjim 73c9bf237a Add StremThru as streaming provider (#345)
* Add StremThru as streaming provider

* Refactoring on Stremthru

---------

Co-authored-by: mhdzumair <mhdzumair@gmail.com>
2024-11-19 14:44:01 +05:30
Mohamed Zumair 05fbafe8e6 Add configuration mode & Refactor stream filtering and catalog configuration (#340)
* Add configuration mode switch for user customization

Introduce a 'Configuration Mode' switch to toggle between 'Newbie' and 'Pro' modes, allowing users to select between simplified and advanced configurations. Updated CSS and JS to handle the display of specific settings and sections based on the selected mode, enhancing user experience and customization options.

* Update default language filters and sorting priority.

* Refactor stream filtering and catalog configuration.

Removed redundant catalog selection logic and refactored stream filtering to streamline the code. Updated configuration scripts and UI to align with new functionality, leading to cleaner and more maintainable code.
2024-11-01 23:00:41 +05:30
Mohamed Zumair f5c63f1205 Add 'live_search_streams' configuration option (#339)
Implemented a new configuration option 'live_search_streams' across the codebase. Updated the JavaScript, schema, HTML, and CRUD logic to support enabling or disabling live search streams functionality.
2024-11-01 17:58:36 +05:30
mhdzumair 8e8abbe961 Refactor database queries to improve efficiency 2024-11-01 16:42:39 +05:30
Mohamed Zumair ecaf7e5cf1 Added filter for only show cached stream, Redis lock for prevent concurrent live scrape, bug fixes & improvements (#325)
* cleanup lifespan vars

* Show API process time in logs

* store the cache validation of full URL for live sports event

* Add support for filter only show cached streams

* Update default configs

* properly handle prowlarr exception on MaxProcessLimitReached

* Add redis lock mechanism to prevent concurrent live scrapers from multiple instances of stremio addon installation users
2024-10-15 18:43:03 +05:30
Mohamed Zumair 52d8956034 Add ScrapeOps monitoring, Add zilean filtered endpoint, Fix Prowlarr scraping with download link & Fix PikPak login error etc (#319)
* Refactor ZileanScraper to use parallel requests for searching and filtering streams with new endpoints

* Fix DLHD scraping & enable DLHD without MediaFlow

* Switch to httpx for async HTTP requests

* Implement caching for PikPak token to reduce login error

* Refactor torrent cleanup logic

* Add inactivity monitor extension to close idle spiders

Introduced `InactivityMonitor` to automatically close spiders that remain inactive for a specified time. This extension checks activity at regular intervals and uses configurable settings for check intervals and inactivity timeouts. If no items are scraped within the timeout period, the spider is closed to free resources.

* Handle TypeError in dynamic sorting of streams

* Refactor torrent info scraper to support pre-processing.

Introduced a pre-processing function mapping to handle specific indexer requirements before parsing the HTML. Added a custom pre-processing function for "TheRARBG" to handle URL adjustments, improving modularity and readability in the `get_torrent_info` function.

* Refine error logging and fix hash key in spider

* Fix Prowlarr not stop on max process limit

* #315: Integrate ScrapeOps logging into all scrapers & spiders

Added ScrapeOps logging to Zilean, Torrentio, Prowlarr, and Prowlarr Feed scrapers to enhance request tracking and error handling. Configured ScrapeOps API key in settings and updated Pipfile/Pipfile.lock with scrapeops-python-requests and scrapeops-scrapy dependencies.

* Refactor scraper cache status handler

* verify torrent before parsing on prowlarr & prioritize magnet on badass_torrents

* Add support for provide locally hosted mediaflow proxy public address and reduce the time leg on private ip address checking

* handle RD exception cases

* do not setup scrapeops when api key is none

* Enhanced dynamic sorting of torrent streams

Revised the dynamic_sort_key function to handle different key types more efficiently with match-case. Simplified error handling and improved logging to capture sorting data in the case of exceptions.

* add missing last update date for metadata

* update domain for nowmesports
2024-10-14 05:58:23 +05:30
Mohamed Zumair 64773baecb Add torrent blocking feature for DMCA (#302) 2024-09-28 09:44:53 +05:30
Mohamed Zumair 0e7a5126f5 Add centralized config management for spiders & Remove deprecated spiders and update related configurations (#299)
* Add centralized config management for spiders

* Remove deprecated spiders and update related configurations
2024-09-27 21:50:29 +05:30
Mohamed Zumair 709dc25d94 Enhance TV streaming functionality with MPD DRM support, and updated spiders & Bugfixes (#298)
* Refactor stream parsing and handling for DRM and MediaFlow

* Add encryption support for mediaflow url and refactor URL validation

* Enhance LiveTV spider to support MPD and handle new player API logic

* Update TV stream validation and add DRM fields in UI

* Add mediaflow_proxy_required.mp4 exception video

* Add FlareSolverr integration to scrapy spiders

* [WIP] TamilBulb spider to scraper

* Update StreamedSpider to new API and adjust schedulers
2024-09-27 08:13:10 +05:30
Mohamed Zumair c8f660b7ee Add Support for download streams via web browser & support disabling the metadata for imdb title (#287)
* Add Support for download streams via web browser & support disabling the metadata for imdb title

* Add env config to enable or disable download via browser feature
2024-09-18 06:54:37 +05:30
Mohamed Zumair d169b28aec Add support for RPDB posters & Support fallback posters via MediaFusion posters (#284) 2024-09-12 12:17:33 +05:30
Mohamed Zumair 76980a92dd Added new MediaFusion configuration setup for Kodi Add-On with QR code & Configure URL setup (#282)
* Added new MediaFusion configuration setup for Kodi Add-On with QR code & Configure URL setup

* remove test codes & correctly generate qr code with existing secret
2024-09-12 01:59:28 +05:30
Mohamed Zumair e502d0f10e Add support for MediaFlow Proxy for Debrid stream & Live stream (#271)
* Add support for MediaFlow Proxy for Debrid stream & Live stream

* Add emoji for mediaflow proxy stream and add error logging
2024-08-29 10:02:01 +05:30
Mohamed Zumair 3ccd1f8a55 Sort & Filter stream languages, quality based on user preference & Reduce userdata size (#250)
* feat: Sort & Filter stream languages, quality based on user preference

* feat: Use field aliases & compress after encrypt user data to reduce the config user data size

* Refactor catalog parsing logic and add CatalogParsePipeline

* Update language handling in stream creation

* update packages

* Update README

* refactor parse torrent streams

* use lru cache for common function

* handle item checking

* address code review

* Update PTT & parse complete language

* cleanup
2024-08-26 22:38:27 +05:30
Mohamed Zumair e379f09f35 Add support Zilean DMM scraper (#239)
* Zilean scraper

* Torbox optimization

---------

Co-authored-by: Rag <ragmehos@gmail.com>
2024-07-21 17:56:16 +05:30
Mohamed Zumair 130b4c06a5 Add support for parental guides nudity filter and certification filter in user config (#244)
* Add support for parental guides nudity filter and certification filter in user config

* refactor validator according to review
2024-07-21 09:18:19 +05:30
Rag 53a5736577 Proxy debrid provider via mediafusion instance 2024-07-14 06:05:38 -07:00
mhdzumair 2a7a75498f #210: Add category field to QBittorrent 2024-06-16 22:40:24 +05:30
mhdzumair f563d49a30 Rebrand scripts of mhdtv to nowmetv 2024-06-09 23:17:12 +05:30
mhdzumair 0a1c54b42d Add support for filename & videoSize in streams data for utilize by subtitle addons 2024-06-06 07:02:01 +05:30
mhdzumair 4b926b0535 Add support namespace in Live TV streams to store specific to elfhosted tenants namespace 2024-06-03 13:17:07 +05:30
mhdzumair d3c5d3f961 Show torrent full name by default 2024-05-28 18:15:43 +05:30
mhdzumair ade259cd57 PikPak: Fix auth errror & Update streaming provider username field to email 2024-05-26 07:21:54 +05:30
mhdzumair ca18ff7efb add support for IMDB rating and releaseInfo in metadata 2024-05-14 13:52:48 +05:30
mhdzumair 388a640dc4 Remove live stream redirect feature since stremio server can do the redirection 2024-05-12 19:28:49 +05:30