245 Commits

Author	SHA1	Message	Date
Ashish	9572eaaa11	[ShemarooMe] Add extractor (#332) ... Closes #307 Co-authored-by: Ashish0804, pukkandan	2021-05-23 12:42:50 +05:30
pukkandan	8d68ab98a7	[youtube] Fix bug where not all hls formats were extracted ... Bug introduced in 9297939ec3	2021-05-23 03:53:17 +05:30
Ashish	135e6b93f4	[SonyLIV] Add SonyLIVSeriesIE (#331) ... Authored by: Ashish0804	2021-05-22 17:53:06 +05:30
king-millez	13a49340ed	[telemundo] add extractor (#327) ... Closes #284 Authored by: king-millez	2021-05-22 17:17:49 +05:30
pukkandan	09f1580e2d	[youtube] /live URLs should raise error if channel is not live ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/29090	2021-05-21 20:05:54 +05:30
pukkandan	b73612a254	Update to ytdl-commit-dfbbe29 ... [redbulltv] fix embed data extraction dfbbe2902f	2021-05-20 21:13:18 +05:30
king-millez	5014558ab9	[parlview] Add extractor (#322) ... Authored by: king-millez	2021-05-20 18:35:37 +05:30
coletdjnz	00ae27690d	[youtube] Add html5=1 param to get_video_info page requests (#329) ... Workaround for #319, https://github.com/ytdl-org/youtube-dl/issues/29086 Authored by: colethedj	2021-05-20 15:56:57 +05:30
pukkandan	9d5d4d64f8	[youtube] Better message when login required	2021-05-20 15:55:55 +05:30
king-millez	98784ef8d6	[audius:artist] Add extractor (#323) ... Authored by: king-millez	2021-05-20 15:55:55 +05:30
pukkandan	d3fc8074a4	[youtube] Sort audio-only formats correctly ... Closes #317	2021-05-19 18:29:20 +05:30
pukkandan	07cce701de	[cleanup] linter, code formatting and readme	2021-05-19 16:48:20 +05:30
king-millez	74e001af1d	[tenplay] Fix extractor (#314) ... Authored by: king-millez	2021-05-19 16:43:34 +05:30
pukkandan	ff2751ac9c	[youtube] Always extract maxresdefault thumbnail ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/29049	2021-05-18 19:31:17 +05:30
pukkandan	abcdd12b26	[youtube:tab] Support youtube music MP pages	2021-05-18 19:31:08 +05:30
pukkandan	18db754858	[youtube:tab] Redirect UC channels that doesn't have a videos tab ... Many topic URLs don't have a videos tab, but has an equivalent `UU` playlist. If there is no playlist, fallback to using channel page	2021-05-18 19:31:07 +05:30
pukkandan	fe03a6cdc8	[youtube:tab] Support youtube music VL and browse pages	2021-05-18 19:31:06 +05:30
pukkandan	cd684175ad	[youtube:tab] Support channel search ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/29071	2021-05-18 19:30:21 +05:30
pukkandan	da692b7920	[cleanup] youtube tests	2021-05-18 18:10:15 +05:30
pukkandan	95c01b6c16	[youtube:tab] Show alerts only from the final webpage	2021-05-18 18:09:04 +05:30
pukkandan	a06916d98e	[extractor] Add write_debug and get_param	2021-05-17 18:59:51 +05:30
coletdjnz	9297939ec3	[Youtube] Extract more formats for music.youtube URLs (#311) ... Based on: https://github.com/ytdl-org/youtube-dl/pull/28778, https://github.com/ytdl-org/youtube-dl/pull/26160 Co-authored-by: craftingmod, colethedj, pukkandan	2021-05-15 20:08:47 +05:30
pukkandan	774d79cc4c	[youtube] Add language names ... Co-authored by: nixxo, tpikonen Based on: https://github.com/ytdl-org/youtube-dl/pull/26112 Closes: #310	2021-05-15 19:27:53 +05:30
pukkandan	2412044c90	Add field name for subtitles ... Co-authored by: pukkandan, tpikonen Based on: #310, https://github.com/ytdl-org/youtube-dl/pull/26112	2021-05-15 19:27:52 +05:30
pukkandan	120916dac2	[youtube] multiple subtitles in same language ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/21164 Related: #310, https://github.com/ytdl-org/youtube-dl/pull/26112	2021-05-15 19:27:48 +05:30
pukkandan	0fb983f62d	[youtube] Extract audio language	2021-05-14 13:15:48 +05:30
pukkandan	0760b0a7e2	Standardize write_debug	2021-05-14 13:15:29 +05:30
pukkandan	d908aa636a	[cleanup] Fix typos	2021-05-11 23:34:40 +05:30
pukkandan	3d89341b47	[common] bugfix for when compat_opts is not given	2021-05-11 23:29:26 +05:30
pukkandan	d8ec40b39f	[rmcdecouverte] Generalize _VALID_URL ... Closes #291	2021-05-11 18:57:55 +05:30
pukkandan	fac988053f	Release 2021.05.11 ... * and some documentation improvements	2021-05-11 13:35:05 +05:30
pukkandan	61241abbb0	[generic] Respect the encoding in manifest	2021-05-11 13:32:03 +05:30
pukkandan	53ed7066ab	Option --compat-options to revert some of yt-dlp's changes ... * Deprecates `--list-formats-as-table`, `--list-formats-old`	2021-05-11 13:30:48 +05:30
pukkandan	2f567473c6	[Plugins] Prioritize plugins over standard extractors ... and prevent plugins from overwriting the standard extractor classes Closes #304	2021-05-09 04:22:27 +05:30
pukkandan	41d1cca328	Update to ytdl-commit-a726009 ... [blinkx] Remove extractor a726009987	2021-05-06 21:31:20 +05:30
pukkandan	12e73423f1	[plutotv] Fix format extraction for some urls ... * And fallback to the first urls if ad-free urls can't be found Closes #299	2021-05-06 20:28:57 +05:30
pukkandan	7700b37f39	[plutotv] Extract subtitles from manifests	2021-05-06 20:28:56 +05:30
Ashish	c28cfda81f	[SonyLiv] Fix title and series extraction (#301) ... Authored by: Ashish0804	2021-05-06 20:27:43 +05:30
pukkandan	3158150cb7	[utils] Add network_exceptions	2021-05-04 22:36:18 +05:30
pukkandan	06425e9621	[blinkx] Minor fix ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/28941	2021-05-04 22:27:44 +05:30
pukkandan	1815d1028b	[zee5] Fix py2 compatibility	2021-05-03 22:49:03 +05:30
The Hatsune Daishi	0fa9a1e236	[whowatch] Add extractor #292 ... closes #223 Authored by: nao20010128nao Modified from: 9e4a0e061a/youtube_dl/extractor/whowatch.py	2021-05-02 19:43:37 +05:30
pukkandan	80185155a1	[ukcolumn] Add Extractor ... Closes #287	2021-05-02 13:57:50 +05:30
pukkandan	c755f1901f	[CBS] Improve _VALID_URL to support movies ... Closes #290 Tested by: BeeMuffins	2021-05-01 21:32:14 +05:30
pukkandan	68b91dc905	[youtube] Add oembed to reserved names	2021-05-01 21:24:31 +05:30
pukkandan	88f06afc0c	[rmcdecouverte] Improve _VALID_URL ... Closes #291	2021-05-01 21:24:31 +05:30
CXwudi	40078a55e2	[niconico] Fix bug in thumbnail extraction #289 ... Bug from: 6b1d8c1e30 Authored by: CXwudi	2021-05-01 19:35:47 +05:30
pukkandan	07e4a40a9a	[crackle] Improve extraction (See desc) ... Closes #282 * Refactor authorization as an extension to `_download_json` * Better error messages and warnings * Respect `--ignore-no-formats-error` * Extract subtitles from manifests * Try with crackle's geo-location service if all hard-coded countries fail	2021-04-29 05:20:16 +05:30
pukkandan	e28f1c0ae8	[cleanup] Fix linter and some typos ... * Also remove inconsistent use of `"` in setup.py	2021-04-28 19:59:40 +05:30
pukkandan	ef39f8600a	[curiositystream] Fix collections ... Closes #277 * A bug with authentication was reported in <https://github.com/yt-dlp/yt-dlp/issues/277#issuecomment-828254721> but cannot be tested without an account	2021-04-28 19:29:33 +05:30
pukkandan	2291dbce2a	[niconico] Fix HLS formats ... Closes #171 * The structure of the API JSON was changed * Smile Video seems to be no longer available. So remove the warning * Move ping to downloader * Change heartbeat interval to 40sec * Remove unnecessary API headers Authored-by: CXwudi, tsukumijima, nao20010128nao, pukkandan Tested by: tsukumijima	2021-04-28 19:18:29 +05:30
pukkandan	895b0931e5	[youtube:tab] Detect playlists inside community posts	2021-04-28 19:18:06 +05:30
pukkandan	1ad047d0f7	[nebula] Move to nebula.app ... Closes #272 Tested by: Lamieur	2021-04-28 19:18:06 +05:30
pukkandan	be6202f12b	Subtitle extraction from streaming media manifests #247 ... Authored by fstirlitz Modified from: https://github.com/ytdl-org/youtube-dl/pull/6144 Closes: #73 Fixes: https://github.com/ytdl-org/youtube-dl/issues/6106 https://github.com/ytdl-org/youtube-dl/issues/14977 https://github.com/ytdl-org/youtube-dl/issues/21438 https://github.com/ytdl-org/youtube-dl/issues/23609 https://github.com/ytdl-org/youtube-dl/issues/28132 Might also fix (untested): https://github.com/ytdl-org/youtube-dl/issues/15424 https://github.com/ytdl-org/youtube-dl/issues/18267 https://github.com/ytdl-org/youtube-dl/issues/23899 https://github.com/ytdl-org/youtube-dl/issues/24375 https://github.com/ytdl-org/youtube-dl/issues/24595 https://github.com/ytdl-org/youtube-dl/issues/27899 Related: https://github.com/ytdl-org/youtube-dl/issues/22379 https://github.com/ytdl-org/youtube-dl/pull/24517 https://github.com/ytdl-org/youtube-dl/pull/24886 https://github.com/ytdl-org/youtube-dl/pull/27215 Notes: * The functions `extractor.common._extract_..._formats` are still kept for compatibility * Only some extractors have currently been moved to using `_extract_..._formats_and_subtitles` * Direct subtitle manifests (without a master) are not supported and are wrongly identified as containing video formats * AES support is untested * The fragmented TTML subtitles extracted from DASH/ISM are valid, but are unsupported by `ffmpeg` and most video players * Their XML fragments can be dumped using `ffmpeg -i in.mp4 -f data -map 0 -c copy out.ttml`. Once the unnecessary headers are stripped out of this, it becomes a valid self-contained ttml file * The ttml subs downloaded from DASH manifests can also be directly opened with <https://github.com/SubtitleEdit> * Fragmented WebVTT files extracted from DASH/ISM are also unsupported by most tools * Unlike the ttml files, the XML fragments of these cannot be dumped using `ffmpeg` * The webtt subs extracted from DASH can be parsed by <https://github.com/gpac/gpac> * But validity of the those extracted from ISM are untested	2021-04-28 19:02:43 +05:30
Felix S	e8f834cd8d	[threeqsdn] Extract subtitles from streaming manifests	2021-04-28 17:24:50 +05:30
Felix S	e0e624ca7f	[canvas] Extract subtitles from streaming manifests	2021-04-28 17:24:19 +05:30
Felix S	ec4f374c05	[wat] Extract subtitles from streaming manifests	2021-04-28 17:24:08 +05:30
Felix S	c811e8d8bd	[atresplayer] Extract subtitles from streaming manifests	2021-04-28 17:23:56 +05:30
Felix S	b2cd5da460	[francetv] Extract subtitles from the HLS manifest	2021-04-28 17:23:47 +05:30
Felix S	2de3b21e05	[uplynk] Extract subtitles from HLS manifests	2021-04-28 17:23:37 +05:30
Felix S	4bed436371	[twitter] Extract subtitles from HLS manifests	2021-04-28 17:23:27 +05:30
Felix S	efe9dba595	[srgssr] Extract subtitles from HLS manifests	2021-04-28 17:23:16 +05:30
Felix S	47f4203dd3	[nytimes] Extract subtitles from HLS manifests	2021-04-28 17:23:05 +05:30
Felix S	015c10aeec	[roosterteeth] Use common code for subtitle extraction	2021-04-28 17:22:56 +05:30
Felix S	a00d781b73	[elonet] Use common code for subtitle extraction	2021-04-28 17:22:45 +05:30
Felix S	0c541b563f	[tv4] Extract subtitles from streaming manifests	2021-04-28 17:22:36 +05:30
Felix S	64a5cf7929	[byutv] Extract subtitles from streaming manifests	2021-04-28 17:22:27 +05:30
Felix S	7a450a3b1c	[generic] Extract subtitles from direct SSTR manifest links	2021-04-28 17:22:18 +05:30
Felix S	7de27caf16	[generic] Extract subtitles from direct DASH manifest links	2021-04-28 17:22:07 +05:30
Felix S	c26326c1be	[generic] Extract subtitles from direct HLS manifest links	2021-04-28 17:21:55 +05:30
Felix S	66a1b8643a	[downloader/ism] Support muxing TTML subtitles	2021-04-28 17:21:45 +05:30
Felix S	4a2f19abbd	[downloader/hls] Assemble single-file WebVTT subtitles from HLS segments	2021-04-28 17:21:14 +05:30
Felix S	f6a1d69a87	[extractor/common] Extend _extract_akamai_formats to also extract subtitle tracks	2021-04-28 17:20:29 +05:30
Felix S	fd76a14259	[extractor/common, downloader/ism] Extract SSTR subtitle tracks ... _parse_ism_formats was extended into _parse_ism_formats_and_subtitles; all direct users were updated, though _extract_ism_formats was left as a compatibility wrapper. The SSTR downloader was also modified in order to prepare for muxing subtitle streams, although no support for any subtitle codecs was added in this commit.	2021-04-28 17:20:20 +05:30
Felix S	171e59edd4	[extractor/common] Extract DASH subtitle tracks ... _extract_mpd_formats and _parse_mpd_formats were extended into _…_formats_and_subtitles; wrappers with old names are provided for compatibility.	2021-04-28 17:20:11 +05:30
Felix S	a0c3b2d5cf	[extractor/common] Extract HLS subtitle tracks ... _extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles and extended to handle subtitle tracks instead of skipping them; a wrapper with the old name is provided for compatibility. _parse_m3u8_formats is likewise renamed and extended, but without adding the compatibility wrapper; the test suite is adjusted to test the enhanced method instead.	2021-04-28 17:19:57 +05:30
Felix S	19bb39202d	[extractor/common] Generalise _merge_subtitles ... This allows modifying a subtitles dictionary in-place.	2021-04-28 17:19:46 +05:30
Hadi0609	db9a564b6a	[zee5] Fix extraction for some URLs (#279) ... Closes: #278	2021-04-28 14:51:54 +05:30
Felix S	c72967d5de	[mediasite] Generalize URL pattern (#275) ... Authored by: fstirlitz	2021-04-26 17:23:20 +05:30
pukkandan	b982cbdd0e	[limelight] Obey allow_unplayable_formats	2021-04-26 10:56:55 +05:30
pukkandan	6a04a74e8b	[FormatSort] Fix for when some formats have quality and others don't	2021-04-26 10:56:54 +05:30
CXwudi	6b1d8c1e30	[niconico] Fix title and thumbnail extraction (#273) ... Authored by: CXwudi	2021-04-26 08:23:57 +05:30
Ashish	87c3d06271	[Mxplayer] Add MxplayerShowIE (#270) ... Authored by: Ashish0804	2021-04-26 08:12:51 +05:30
pukkandan	cf9d6cfb0c	[tubi] Raise "no video formats" error when video url is empty ... Related: #266	2021-04-24 17:52:33 +05:30
pukkandan	bbed5763f1	[francetvinfo] Improve video id extraction ... Closes #261	2021-04-23 00:01:09 +05:30
pukkandan	1bdae7d312	Update to ytdl-commit-7e8b3f9 ... [youtube] Remove unused code 7e8b3f9439	2021-04-22 16:54:07 +05:30
Felix S	a471f21da6	[mildom] Remove proxy (#260) ... Closes #251 Makes 2cff495997, ab406a1c0e, #252 obsolete Authored by: fstirlitz	2021-04-22 16:52:22 +05:30
pukkandan	6efb071135	[BilibiliChannel] Fix pagination ... Closes #222 ccca21d7f5 Coauthored by: nao20010128nao, pukkandan	2021-04-22 04:19:33 +05:30
pukkandan	3b4775e021	[go] Fix _VALID_URL ... Closes #255	2021-04-21 15:43:53 +05:30
pukkandan	ab406a1c0e	[mildom] Warn user of proxy	2021-04-21 15:43:22 +05:30
pukkandan	8c54a3051d	[youtube] Bugfix in _extract_ytcfg	2021-04-21 10:37:24 +05:30
pukkandan	3097d9e512	[mildom:user:vod] Download only necessary amount of pages	2021-04-19 11:41:49 +05:30
pukkandan	c1df120eda	[mildom:vod] Remove proxy ... * Proxy is needed only for live videos	2021-04-19 11:41:40 +05:30
pukkandan	2cff495997	[mildom] Change proxy ... Related: #251 Closes #252	2021-04-19 11:41:33 +05:30
pukkandan	d0491a1ebe	[twitcasting] Fix extractor ... * `Origin: https://twitcasting.tv` must be sent when requesting the webpage. Otherwise the extracted `m3u8` will always give a `502` * Fix regex for when `data-movie-playlist` is a dict containing the needed list * media initialization is fully supported; so change downloader to native Closes #220	2021-04-18 17:57:46 +05:30
nixxo	b9d68c199b	[rai] Add support for http formats (#208) ... Authored by: nixxo	2021-04-17 22:42:28 +05:30
pukkandan	201c145953	Update to ytdl-commit-9f6c03 ... [cbsnews] Fix extraction for python <3.6 9f6c03a006	2021-04-17 08:40:31 +05:30
pukkandan	5d34200268	[youtube:tab] Reload with unavailable videos for all playlists ... If the unavailable video is in a later page, the warning and button are not shown in the initial webpage So we force all playlists' initial page to reload with the correct params	2021-04-17 08:40:30 +05:30
pukkandan	b7da73eb19	Add option --ignore-no-formats-error ... * Ignores the "no video format" and similar errors * Experimental - Some extractors may still throw these errors	2021-04-17 08:40:30 +05:30
pukkandan	6a39ee13f7	Fix inconsistent use of report_warning	2021-04-17 04:16:41 +05:30