128 Commits

Author SHA1 Message Date
Mohamed Zumair 649de9e503 Update Python version & refactror Redis client usage and streaming provider route endpoints (#277)
* Update Python version

* Refactor Redis client

* Refactor streaming routes endpoint functions
2024-09-05 06:46:07 +05:30
Mohamed Zumair bd43ee4c3f Bugfixes (#272)
* Kodi: handle connection errors in fetch data

* feat: Update scraper URLs and fix streamed.su live sport event

* use only url for cache validation in live stream validation

* Handle debrid service downtime error & tracker fetch error

* handle review
2024-08-29 10:05:39 +05:30
Mohamed Zumair 3ccd1f8a55 Sort & Filter stream languages, quality based on user preference & Reduce userdata size (#250)
* feat: Sort & Filter stream languages, quality based on user preference

* feat: Use field aliases & compress after encrypt user data to reduce the config user data size

* Refactor catalog parsing logic and add CatalogParsePipeline

* Update language handling in stream creation

* update packages

* Update README

* refactor parse torrent streams

* use lru cache for common function

* handle item checking

* address code review

* Update PTT & parse complete language

* cleanup
2024-08-26 22:38:27 +05:30
Mohamed Zumair 9558586b6b Update scraper URL & Fixed streamed.su (#268)
* Update scraper URLs

* Fixed streamed.su live sport event

* revert url
2024-08-26 11:58:21 +05:30
Mohamed Zumair 85033a9069 Update scraper URLs (#262) 2024-08-18 00:43:36 +05:30
Jishnu R 2a10947df5 Display Time for Sports Events Poster (#249) 2024-07-27 15:03:05 +05:30
Mohamed Zumair 130b4c06a5 Add support for parental guides nudity filter and certification filter in user config (#244)
* Add support for parental guides nudity filter and certification filter in user config

* refactor validator according to review
2024-07-21 09:18:19 +05:30
mhdzumair 632e321c0f increase playwright context & pages & use Common for source 2024-07-20 07:24:33 +05:30
mhdzumair b3167534f9 Handle TamilMV & TamilBlasters error torrent page into scraped urls for avoid checking the page again & again 2024-07-20 07:19:19 +05:30
mhdzumair 1552499f3b chore: Update resolution labels to use lowercase "k" for 4K 2024-07-20 07:16:38 +05:30
mhdzumair f19993eb66 Migrate to PTT for parsing torrent titles effectively 2024-07-20 07:15:35 +05:30
mhdzumair d2083f7052 more var fix for tamilblaster 2024-07-10 15:36:18 +05:30
mhdzumair cd96c27f93 Fix TamilMV & TamilBlaster scraping only one torrent bug per movie 2024-07-09 08:46:12 +05:30
mhdzumair d231bbb8b7 Utilize cinemagoerng for imdb scraping & improvements 2024-07-08 14:15:16 +05:30
mhdzumair ad57412761 Added support for Fighting (WWE & UFC) scrapy for TGX 2024-07-08 00:13:58 +05:30
mhdzumair d9051b3bc9 refactoring: separate it out scrapy pipelines 2024-07-01 12:19:16 +05:30
mhdzumair 4975cb9695 Fix streamed.su subdomain typo fix 2024-06-30 05:44:53 +05:30
mhdzumair 7cf4bba365 Add support for scraping tgx through playwright & browserless integration 2024-06-28 12:00:24 +05:30
mhdzumair 605825f0bf Fix dlhd streams 2024-06-27 18:01:40 +05:30
mhdzumair aaa932e259 Update streamed.su subdomain 2024-06-27 17:53:09 +05:30
mhdzumair 8ddd88d6be Update NowMeTV & NowMeSports url & scheduler time 2024-06-16 22:45:19 +05:30
mhdzumair 2821bc2401 update dlhd url and enable dlhd scraping 2024-06-16 22:42:16 +05:30
mhdzumair f563d49a30 Rebrand scripts of mhdtv to nowmetv 2024-06-09 23:17:12 +05:30
mhdzumair 35f7635f49 Scrapy: Fix magnet download parser pipeline 2024-06-08 22:09:58 +05:30
mhdzumair c721895569 Store scrapy stats to redis for monitoring 2024-06-08 20:59:28 +05:30
mhdzumair 5fbfbbb9dc Store scrapy stats to redis for monitoring 2024-06-08 20:57:57 +05:30
mhdzumair 0055d13fe9 #166: Added Arab-Torrent scrapy 2024-05-25 15:52:05 +05:30
mhdzumair 5df488c536 Update tamilmv movie page css element pickers 2024-05-25 15:38:35 +05:30
mhdzumair f1f70ec723 Add MagnetDownloadAndParsePipeline for processing magnet links 2024-05-25 15:37:18 +05:30
mhdzumair e0d3ff2815 Fix live stream headers for StreamBTW 2024-05-22 10:52:53 +05:30
mhdzumair 49c2950ed3 Scraped only relevant m3u8 with channel id & Update MHDTV URLs 2024-05-22 10:27:28 +05:30
mhdzumair 9a0626b6a1 Scrape data only within specified time range & add more category images 2024-05-12 23:23:45 +05:30
mhdzumair 114a46f87f #173: Fix poster scraping attribute from TB 2024-05-12 21:55:02 +05:30
mhdzumair 388a640dc4 Remove live stream redirect feature since stremio server can do the redirection 2024-05-12 19:28:49 +05:30
mhdzumair 9768a19a0e Add support for MotoGP & refactor 2024-05-07 13:58:43 +05:30
mhdzumair c22bb09c23 bugfix live stream resolver pipeline 2024-05-07 10:34:10 +05:30
mhdzumair ace2dde969 Update DLHD scraping & add support for setting streaming headers 2024-05-06 00:20:48 +05:30
mhdzumair 68949b3ae4 Update Streamed.su referer 2024-05-06 00:14:11 +05:30
mhdzumair 79d9a4d694 separate scrapy tasks to be run on different queue 2024-05-01 00:07:09 +05:30
mhdzumair 7efe216c7b add support for all instance at once 2024-05-01 00:04:46 +05:30
mhdzumair bbf207f61d format 2024-04-28 23:00:42 +05:30
mhdzumair d3cead63e0 Refactor StreamedSpider 2024-04-28 22:52:41 +05:30
mhdzumair 7ff883678b Add DaddyLiveHD scraper and scheduler 2024-04-28 22:47:57 +05:30
mhdzumair 3f8ceebd98 Update referer for streamed.su & improve event name parser 2024-04-27 17:10:37 +05:30
mhdzumair 3779efbd6b Implement TaskManager for dramatiq worker to maintain minimum iterval before triggering same scraper task & worker improvments 2024-04-27 17:08:55 +05:30
mhdzumair c9244d09df format mrgamingstreams 2024-04-24 09:34:44 +05:30
mhdzumair 59947456e3 Add support for load balancer sub-domains & language text in streams description & refactor 2024-04-24 09:33:33 +05:30
mhdzumair c1017c3c92 Bugfix & utlize LiveStreamResolverPipeline for CricTime spider 2024-04-24 09:32:17 +05:30
mhdzumair 7449ff1006 Fix & Refactor title for sports event from sports_video spider 2024-04-24 09:31:30 +05:30
mhdzumair 24ea4f9063 Update user-agent and spider URLs 2024-04-22 23:19:19 +05:30