A lot of people seem to be confused by how streaming services serve content using segments, but it's actually remarkably simple and easy to understand. Let's first look at how a segmented MP4 file is laid out:

- Formatted as ISO-BMFF (https://www.w3.org/TR/mse-byte-stream-format-isobmff/)

- A "map" file contains the DRM information and all associated data needed to construct the stream; it's essentially the header data. Disney+ calls this, "map.mp4" and others call it something different; the manifest will contain:

#EXT-X-MAP:URI="<URL_OF_MAP_MP4>" - if the service is using HLS like Disney+ does

initialization="8744630-JD2qW_A-manifest-$RepresentationID$.dash" - if the service uses an MPD (Media Presentation Descriptor) Manifest like most others do

Either way, the layout of the MP4 delivery is identical whether HLS or DASH is being used. They're both ISO-BMFF (regardless of file extension). As with all MP4 files, they can contain audio, video or both. The track information is stored in the initialisation/map file.

Now, what about the media itself? The map file is the header data, so all other segments are the content itself laid out sequentially. Generally, DASH manifests have a 'timescale' (HLS does too sometimes). This simply means each segment lasts for a predetermined amount of time before the next one needs to be fetched, decrypted and played back.

In saying that, how does playback with segments actually work?

It's surprisingly simple. The map file contains information about it's DRM scheme in a 'PSSH' box; special data encoded for the player software. What happens, is during playback, each segment is appended to the map file and played like a normal MP4. Appending like this:

MAP.M4S->SEGMENT.M4S

...will yield an encrypted mp4 that you can decrypt using the Widevine L3 Decryptor extension (this is easy enough to find on this subreddit; and it also is 100% compatible with Firefox WebExtensions). So, to simply yield a full encrypted file like on Amazon Prime, you can (on a basic level) use the UNIX cat command as described perfectly here.

What you end up with is this:

map.m4s->segment1.m4s->segment2.m4s->segment3.m4s and so on. Essentially, grab the raw bytes themselves from each file and literally append them straight onto the map file. You're building an encrypted mp4 file from the ground up with

I'm having trouble getting more than ~40% of my rated speed when transferring files from my ultraseedbox to my local machine (via FileZilla).

I've tested that Internet Download Manager is able to get slightly over 100% of my rated speed by using segmented downloading, but I'd rather not pay for a license if possible. I see that CuteFTP also supports segmented downloading, but same problem with the cost.

Any suggestions? Thanks :)

I purchased cuteftp pro just for this purpose, but it does not display properly on high-res screens. If you set your OS display scaling anything larger than 100%, cuteftp pro does not adapt. Not surprising since it hasn't been updated in years. What do you use to max out your connection from seedbox to home?

Hi everyone. Looking for an application that allows segmented downloading. My main use case scenario would be grabbing files from a seedbox.

The most common suggestion I've found via search is lftp via Cygwin but I'd really rather not use a command line interface if I can avoid it.

BitKinex hasn't been updated since 2010 although it seems to work fairly well.

Looked into CuteFTP and SmartFTP Pro and I was willing to purchase them even though the price seems fairly steep but I need a license for each machine I want to install it on and that would be at least 4 licenses at $60 and $80 per license respectively.

Any other suggestions? Thank you in advance.

Basically want a client with a GUI like for example CuteFTP in Windows which supports segmented downloading with a minimum of 8 parts. I know about LFTP but I am specifically looking for something with a GUI.

I signed up with Feral a few nights ago, traffic on my torrents seems to be fine.

Now I'm trying to get files via FTP and my speed rates are hovering around 700 KiB/s via FileZilla, both straight connection and through Private Internet Access. I'm on a 50mbps plan and currently getting 42mbps on speedtest.net.

I bought Captain FTP as it was stated to be the only segmented downloader available for OS X, but even on 500MB files and multi-GB folders, set it up with the recommendation to segment anything over 10MB, but still nothing seems to be segmenting and the segment button is grayed out.

I've also paused all my torrents on the seedbox, in case that impacted FTP speed.

On PC we have apps like bitxinex(free) and CuteFTP which can do segmented downloads. However, on android, I am unaware of any such app which can download one file using multi segment download, effectively increasing the download rate, as opening just one download channel often means slower transfers.

So if you know about any such app, please let me know!

I think I've tried around 20 products over the last 6 months with no success. All the segmented download software for Android either wouldn't handle FTP/SFTP at all, or wouldn't handle the user/pass authentication with HTTP/HTTPS. So I was stuck downloading with a single thread when using Android.

I could download fine with ES File Explorer using SFTP, but it doesn't support segmented downloading, and my speeds suffered as a result.

As for my motivation, I travel regularly and have a limited 4G with slow Wifi in hotels. Occasionally I'll run a speedtest in a certain Cafe or similar, and it's really fast. I want to take advantage of that and grab a few files off my seedbox with the best speeds possible, without having to lug my laptop around with me.

So all you do is install ES File Explorer & ADM (Advanced Download Manager). Create an SFTP folder for your seedbox in ES, navigate to the file you want to download, click it, and choose to open in ADM. ES automagically changes the URL to a HTTP on local host (127.0.0.1) that ADM can handle, whilst ES handles the authentication. ADM handles the segmented downloading. Works awesome, give it a try and see if it improves your transfer speeds with android, it's made a huge difference for me.

I'm unsure about any network security issues with the URL being changed to plain HTTP on the local host in ADM (maybe someone knowledgeable in that area could let me know?) but I run everything through a VPN anyway, and the password isn't shown in the URL so I'm assuming it's all good.

It is increasingly more common on youtube to upload albums as a single video with titled markers inside showing where the songs begins and end, instead of playlists of many shorter videos/songs. As an example, let's take this video of a full album: https://www.youtube.com/watch?v=yQHWpvHauo0

As you can see, the full length video is of a whole album (43:53), which, when downloaded with simply youtube-dl --extract-audio --audio-format mp3 "https://www.youtube.com/watch?v=yQHWpvHauo0", would result in a 43 minute long audio file. I have tried using --audio-format m4a instead in hope that it will provide chapter markers (like in podcasts or audio books) and I could later use an m4a splitting utility, but no luck, mp4chaps reports "no chapter markers" in the resulting m4a file.

Ideally, instead of a 43 minute-long Birocratic - Beets 4 [full album]-yQHWpvHauo0.mp3 file, one would get a 3:06 long Birocratic - Beets 4 [full album]-01-Bob Ross Goes to Hollywood-yQHWpvHauo0.mp3 file, 3:16 long Birocratic - Beets 4 [full album]-02-Sleepyface-yQHWpvHauo0.mp3 file, etc.

What would be the simplest way to achieve this?

When using --external-downloader ffmpeg, to add timestamps, sometimes it works and sometimes it does not, depending on the website.

If it is not supported the whole video is downloaded.

Is there a way to pre-determine if the site supports it or not?

Running the brew ports version of ffmpeg 4.4. Trying to download something using youtube-dl and it works gloriously except for the error below. It will miss a single .ts file which equates to a few seconds of skippage. It doesn't seem to try to redownload that file, it just breezes on by.

Here is the command line that ytd is using to invoke ffmpeg: ffmpeg -y -loglevel verbose -reconnect 1 -reconnect_streamed 1 -reconnect_on_network_error 1 but that still results in the error below.

Any thoughts? (Or should I be asking somewhere else?) Thank you!

[tcp @ 0x7fee4bb04b00] Starting connection attempt to 192.229.210.181 port 80
[tcp @ 0x7fee4bb04b00] Connection attempt to 192.229.210.181 port 80 failed: Operation timed out
[tcp @ 0x7fee4bb04b00] Connection to tcp://x-default-stgec.uplynk.com:80 failed: Operation timed out
[crypto @ 0x7fee4bb04640] Unable to open resource: http://x-default-stgec.uplynk.com/ausw/slices/4a4/d874124ecca24c88a3c9575e78686acf/4a47cf52cf9d49dd8834d237269c0c03/J0000003C.ts?pbs=8d59703edfcd4282b491a393dcc8ded1&euid=2C2AF8EA-0C36-4333-BEB0-3B899ABB60D6_000_0_001_lf_01-06-00_NA&cloud=aws&si=0
[hls @ 0x7fee4b009600] Failed to open segment 60 of playlist 0
[hls @ 0x7fee4b009600] HLS request for url 'http://x-default-stgec.uplynk.com/ausw/slices/4a4/d874124ecca24c88a3c9575e78686acf/4a47cf52cf9d49dd8834d237269c0c03/J0000003D.ts?pbs=8d59703edfcd4282b491a393dcc8ded1&euid=2C2AF8EA-0C36-4333-BEB0-3B899ABB60D6_000_0_001_lf_01-06-00_NA&cloud=aws&si=0', offset 0, playlist 0

So if I download m3u8 with this command ffmpeg -i "URL" -f segment -c copy -y out%03d.ts

And if error occurred in segment 312 How would the file names follow then?

Would it skip segment312 and be like segment313=out313.ts or would it segment313=out312.ts

How would it follow?

Hi, I tried this Guide to rip The Mandalorian from Disney+. This tutorial worked for many movies and series, but when it came to The Mandalorian it didn't. I copied the link and pasted it in "n_m3u8DL-CLI" but it only downloaded this Disney+ original opening. Someone told that the solution to this is downloading all the segments separately and merging them. Well since am a noob and idk how to do this, I really hope that help me here.

When I download a m3u8 video file with youtube-dl I'm getting this error "Failed to open segment 791 of playlist 0" on some segments. YouTube-dl skips segment 791.How can make YouTube-dl not skip the segment.

The segments that the error occurred are missing in the full downloaded video. example if the video full video is 60seconds the downloaded video will be 58seconds when the error occurs.

How can I make YouTube-dl keep retrying until it downloads the missing segment 791?

When I download a m3u8 video youtube-dl merges the file in one. Can I disable the merging so that '.ts' files will be downloaded separately?

I know youtube-dl works with Twitch on Linux but it does not seem to support downloading between specified timestamps. Downloading the whole VOD and cutting it afterwards would mean tens of gigabytes of unnecessary downloads in my case.

I would prefer to use a CLI tool on linux that offers similar functionality as twitch-leecher.

Do you know of any tool to accomplish this or do I need to use a Windows VM?

https://i.imgur.com/A7UojHf.png

As you can see it's very very slow downloading stuff from 4 days ago.

Before power outage logs show geth was synced and working properly.

Is this 4 day sync that's taking so long normal?

I started 8 instances of youtube-dl on my pi to download 8 different videos (generic m3u8, not youtube) at once (single segment at a time is throttled to 500kbps so if I start 8 it saturates it a bit more across different videos), and to my amazement it didn't crash. It's a raspberry pi 2 which has 1 GB of ram. am I underestimating the overhead of just downloading ts segments and piping to rclone? What is the realistic max of videos I can download at once? I can simply start as many bash commands as I want so the limit is the pi's resources. I just don't want it to hit disk because that would burn out my SD card. Is the memory requirements for simply sending ts segments to rclone? My memory usage is at 60% and CPU usage across all cores is between 40-60. Should I bother adding more instances? Thanks.

The site i want to download videos is not really a mainstream movie site, it's a virtual college classes collection.

I don't think this counts as piracy, maybe it is? I think this seems like the best place to ask since it involves downloads.

The problem is, every video downloader i tried shows the video as hundreds of "segments", and they only appear as i watch the video (even if i saw it before, i have to re-watch it).

Instead of 1 video file there are like 300+ small segments of 80kb to 400kb or so.

I would like to download the classes in case i don't have internet or they are removed, but i have no idea if it's even possible.

I tried this guide but it doesn't work in this case.

What's up? ???

Where does it happen? any v.reddit video on at least, but not limited to, a chrome desktop on win10 with or without RES.

Screenshots or mock-ups https://imgur.com/a/kacaVgm

What browser extensions are installed?

: Slides : version 0_10 : Simple Allow Copy : version 0_8_2 : Web Store : version 0_2 : Docs : version 0_10 : Google Drive : version 14_2 : YouTube : version 4_2_8 : Honey : version 11_7_3 : Flickr Right Click : version 2_0_2 : uBlock Origin : version 1_23_0 : Tampermonkey : version 4_8_41 : Dark Mode : version 0_3_5 : Adobe Acrobat : version 15_1_1_3 : Facebook Pixel Helper : version 1_2_0 : Full Page Screen Capture : version 6_2 : Sheets : version 1_2 : iCloud Bookmarks : version 2_1_2 : Feedback : version 1_0 : Google Docs Offline : version 1_7 : Save to Google Drive : version 2_1_1 : Read Aloud: A Text to Speech Voice Reader : version 1_23_0 : LastPass: Free Password Manager : version 4_36_0_1 : Make Trump Tweets Eight Again : version 2_1_7 : Reddit Enhancement Suite : version 5_18_6 : Betaflight - Configurator : version 10_4_1 : CryptoTokenExtension : version 0_9_74 : Application Launcher for Drive (by Google) : version 3_2 : Cloud Print : version 0_1 : Chrome PDF Viewer : version 1 : Google Network Speech : version 1_0 : Google Hangouts : version 1_3_14 : Chrome Web Store Payments : version 1_0_0_5 : Downloader for Instagram™ + Direct Message : version 5_4_0 : Gmail : version 8_2 : Chrome Media Router : version 7819_902_0_1

• Night mode: true
• RES Version: 5.18.6
• Browser: Chrome
• Browser Version: 78
• Cookies Enabled: true
• Reddit beta: false

https://preview.redd.it/61hdn2cjnm871.png?width=1426&format=png&auto=webp&s=efe295194054a2e93d72b6f17cb25cbe548c3308

__________________________________________________________________

🎤🎸🥁 🦍Welcome to the Jungle🦍🥁🎸🎤

__________________________________________________________________

Today's Recap 📈

$GME Closing Price: $204.36

Open Price: $213.40

Daily High: $216.83

Daily Low: $202.00

Volume: 2.72 MM

_____________________________________________________________________

🖍🍎🚌GME 101🚌🍎🖍

If you're new to Superstonk, start here!

Superstonk FAQ (Updates coming soon)

Superstonk Wiki

NEW!! We will be having a "Smooth Brain Sunday Megathread" every Sunday as a place to ask all the questions you've been wanting to get answered! Please be advised that all answers provided are from individual users and, as always, any information you receive requires doing your own due diligence!!

The apes of r/Superstonk sincerely appreciate the time and effort put into getting this information out there. 🦍🤝💪

_______________________________________________________________________________

PSA- Stop and think before you click the link

Important announcement regarding 3rd party links like Google Drive

Brent Rambo doesn't click random links. Be like Brent Rambo.

Being a savvy ape means staying 10 steps ahead of anyone that may be coming at you to undermine you. We mods try to stay ahead of the curve on upcoming FUD trends and while it is exhausting to keep up with the ever-changing tactics, we have managed to curb the FUD as it rushes in. But there's a new phishy tactic in town that has me on high alert.

Google drive links that are always purported to have enticing, must-read DD, which is usually deleted or somehow missing.

**This has been a FUD tactic used and abused by kn

$Wish is fundamentally a very strong company with approx. $2 billion is cash.

Most downloaded e-commerce app in the world for last 3 years. Expected revenue for 2021 is $3.2 billions and revenue is up 75% compared to last year.

It is on right track and they have moved into logistic and that will help profit margin in the near future. They are employing technologies such as machine learning to help their customer needs and as they wean from the traditional marketing on Facebook, profit margins will improve even more.

With current market value of approx. $6 billion and 2 billion in cash, Enterprise Value is only 1.25 times the expected 2021 revenue.

So why Mr. Market is pricing this e-commerce company at such dirt cheap level? It can’t be because of the fundamentals as company is very strong as indicated above.

So what’s going on? I think it is due to merciless short sellers attack for past 4 months which has draw down the price from $32 (February 2021) to $8 until last week. With volume increasing, short sellers will have to cover their short positions sooner rather than later and stock price will move to $40 level.

In my personal opinion just hold on to your stocks as short sellers are grasping the last straw.

--- EDIT: DEBUNKED. Bloomberg geographic data seems to be garbage. Sorry folks. End of Edit ----

https://preview.redd.it/vhceawxjsf571.png?width=800&format=png&auto=webp&s=cf609e25ab084b678e7eb42b74433ec1e9b0d727

About a week ago, I came across a comment by u/evertwindelen referencing an official report that was published by the Netherlands Authority for the Financial Markets (AFM) discussing the GameStop phenomenon and how it impacted Dutch investors (Link to an English version of the report, but it downloads a PDF). These guys are basically the Netherlands' version of the SEC. The whole report is super interesting, but I'm only going to cover the highlights that are relevant to this particular discussion.

• The report covers GameStop trading activity by private Dutch investors (aka retail) during the period of January 18 2021 - March 18 2021.
• During this timeframe, 29,394 investors traded GME, none of whom had invested in GME before (though if someone wants to confirm this translation, it’s just under figure 1 - Edit: Translation confirmed)
• The average total purchased value within this group of investors was $11,532.
• The average purchase price within this group of investors was $189 per share.

So let's start with that. $11,532 / $189 = 61.015873 shares on average, multiplied by 29,394 investors = 1,793,501 shares purchased in the Netherlands between January 18 and March 18. A note here: this is a cumulative number, so if someone bought 10 shares, sold them all, bought 10 more, sold them all, then bought 10 more again, it would be represented here as 30 shares, not as 10 shares.

Great, that's cool, but... so what? Well, if we know what portion of shares were held in the Netherlands at that time, then we can establish how many shares there were worldwide. Let's take a look at what the Bloomberg terminal has to say about share distribution across different geographic locations around this timeframe (huge thank you to u/ravada for providing these screenshots!) - the Bloomberg terminal doesn't allow specifically selecting a mid-week date, so we'll see what t