Home Creators Posts Import Register Favorites Logout

Content

Like pretty much everyone that's worked with video as long as we have, we've built up a huge amount of footage over the years. In the first image, you can see some of our earliest external hard drives which are bulky and weird shaped. They have to be close to 20 years old at this point! 

For the majority of the time we've been doing Half in the Bag and beyond, we've stored all our raw footage and edits on these Western Digital drives and when one fills up, we just move on to a new one. We've got a ton of these drives now! Way more than what you see in these photos. They're still great for storing everything and we still have all our raw footage from pretty much everything we've ever shot on them, minus a couple of drives that have just stopped working over the years. 

A year or two ago, we finally got a NAS server to have a secure and complete archive of every video we've ever made all in one place. If you're not familiar with a NAS, it stands for Network Attached Storage and it's basically just a bay of hard drives that all work together to create one big storage pool. All our raw footage is still just backed up on those Western Digital drives, but the final videos are stored on the NAS (in a RAID 6 configuration so if one or even two of the drives fails, all the data is still safe) and another storage unit is synced to it via USB to create a backup copy of the archive. With this set up, we should be in pretty good shape of never losing anything important from a hard drive failure.

Before the NAS archive, if we wanted to use a clip from an older video, we'd have to dig through our dozens of external drives to find the right one that has what we're looking for on it or we'd just download the youtube version and use that. But now we have every video and every short film and every feature we've ever done for the past 20+ years all saved in one place in full resolution. Organization is fun!

Files

Comments

Minimag

Get a longer USB and keep them as far apart as you can. If a pipe burst above then they're still both toast.

Rainbow Randolph

Nice! NAS is a great solution to those external drives. Hopefully you have backups off site, yes? ... Yes?

TeilzeitVisionär

thank you for that incredible insight! just installed a NAS for my sister today and i keep telling everyone to use such a system for being safe with the tons of data nowadays

plop

probably a good idea to sync to a second nas and store it off site. re sync periodically. or do tape backups and store them offsite. Natural disasters and fires and crap happen!

Tom McGraw

this is awesome behind the scenes stuff! have wondered before how so many years of content is stored and organized.

Karkhon

I mean as everyone already said, you also need an off-site backup to go along with your NAS. With your amount of storage maybe you should invest in a bigger server with something like TrueNAS that can also house the raw footage. Then you can off-site backup that one, at that scale cloud is not really something you should think about, better get another NAS. Maybe think about ingesting data directly to the server, and when filming video from static camera maybe bypass recording to sd-cards and the like all together.

Katy

Aren't you glad you shared these images and in return got a ton of unsolicited and uninformed advice on how to manage your data?

Ryan Cassidy

As a librarian, this makes me happy

Eric Darancette

Curious, how much usable storage space do you have on your new NAS?

JTruts

Good call, always remember the golden rule of hard drives: eventually all hard drives will fail. It's only a matter of time, glad to see you've worked on your archives!

Jazz Jackrabbit

Somewhere in these drives is the review of The Batman.

Erd

Ok time to call level1techs and do a collab vid upgrading the nas and network infra. Would be amazing

The Real Zam

A word of warning. Old school spinning HDD's don't like sitting around unused for an extended period of time. The official parlance is 3-5yr reliable shelf life, but that's very pessimistic. Expect about 3% of drives to fail within that period. Want them to last longer? Store them in a cool, dry place (desiccant is your friend). Don't throw them around when you don't need to. Spin them up once a year. When you do use a program that can read the reliability data on the drive. Not sure what platform you guys run, but you can look for programs that can read "SMART" data off of a USB drive. If the drive gives you warnings or is acting strange, move that data to a better storage format. Want better reliability? SSD's will last forever and you can get 2.5in drives for super cheap, just steer clear of SanDisk as their SSDs are currently subject to a class action suit. The 2.5in form factor is also more reliable for spinning HDD's. They can also run off of USB power so you don't need to worry about a power brick, or the potential of a failure of the internal power supply inside the drive enclosure. The simplest and cheapest fix would be to put each drive in an antistatic bag with some desiccant.

Daniel

Never thought about all of the footage you guys have.

David Sarginson

I mean clearly all your work needs transferring to fine grain 35mm archival film prints and stored in a salt mine to survive for future generations after the apocalypse, but I guess this is a fine temporary solution.

John Kott

I would love to purchase a DVD of "RLM Archive Collection Volume Two".

The dood

Hey, I build NASes professionally! Always nice to see folks move from the hellscape of loose external hard drives and switch to more friendly storage solutions.

Bill Wilson

This is like the epilogue of Raiders, when they store the Ark with all the other crates of presumed weird stuff. Except instead of face melting, this'd fart wetting. Still, very interesting share.

Jason DeMaria

I get two free streaming services through my phone plan. Otherwise, I don’t pay anything to cable or anyone else. I get to choose to back RLM, and I’m damn happy to do it. I like an update like this. Makes me feel like I’m a small part of making things better for the crew.

capnchamomile

Pretty cool! As an IT guy I wouldn't be doing my due diligence if I didn't say please setup an off-site backup if you don't already have one! Companies like Backblaze offer cloud storage for dirt cheap and you can get software that will backup there directly from the NAS. Keep up the cool vids dudes 😎

mike bouchard

Can you guesstimate how many terabytes you're storing? This is very interesting!

Vix S.

This is the power of math people!!!!?

Antone Bajor

The raw footage of Rich watching Diamond Cobra Vs. The White Fox must be preserved!

Kendel Fargo

You see you guys do more than entertain you also educate as far as I knew, they were devices for aficionados of porn. Or so I heard her. You learn something new every day.👍🎅🏿👍!

Lou Enriquez

If you still have the dead drives, there are services that can pull the platters and get your data off of them. I believe even Western Digital offers this.

Joshua Cubbin

“When the light is green, the drive is clean. The footage is incarcerated here in our custom-made storage facility.” I can’t be the only one who sees the Ghostbusters containment unit in the last picture of the RLM archive NAS. It’s just asking for them build a replica around it.

Connor Martin

So... somewhere amongst all those ones and zeroes... is the last remaining evidence of the re:view of diamond fox vs the white cobra... Breathtaking.

Jared Blando

That is rad, but please tell me you have offsite cloud storage like Carbonite or an equivalent service. God forbid you guys have a fire or some such in the studio and these drives are destroyed, all your hard work would be safe and sound so you can redownload to physical media.

Joel Smith

But when do I get recognition for listening to the “Mr. Plinkett’s Bee Bustin’ Service” commentary track? You asked us to tell you, Jay! You asked us!

Warren McHenry

Ditto to the offsite/cloud advice. Even if you don't want to pay somebody to host your data, at least archive them to another set of drives/another NAS, and have friends or family hold onto them. Given the level of insane bullshit you guys get into, it's not impossible to imagine the sprinklers getting tripped and the NAS ending up soaked or in a dangerously humid environment.

Adriana Lee Lopez

Christ! I did wonder how y’all stayed organized.

Analog Pill

Is the server on site or somewhere else? Was there a lot of hardware support needed for such a setup? Seems like something I should think about for my storage as well. I assume you would reccomend it?

Bonorum Malorum

The clips are a source of unspeakable power and they have to be reused. By whom? Top Men.

Timothy Liebe

Want to join in and say you need an offsite backup as well—Francis Coppola lost the script and production note files of his early movies, originals and backups, when criminals broke into his house in Argentina and stole them from his office.

SKP

So. Basically you still have a copy of Diamond Cobra vs White Fox Spotlight, right?

Scott

This is cool stuff to see. You guys probably know you have a heap of nerd fans. I'd be super curious just how big the NAS is. It must be absolutely massive. I'm going to guess in excess of 150TB? Just be sure to ALSO back that up. Things go wrong sometimes!

Hidde Jansen

These are the Black Spines I'd actually wanna watch.

Jessie Zimmer

So organized so pretty. What's the over/under on whether Mike or Jay wrote this post purely so they could nerd out about organization? (I say as a fellow organization nerd ...)

Eric Radtke

Bravo, as an IT person I applaud your data storage evolution!

PACMKEInk

Great write up! Always like to hear some of the bts stuff

Paul Hackett

That's so cool. I'd always wondered what your backup/storage system was like.

Carl Simon

Also consider backing up the data to a cloud service like Microsoft Azure or Amazon Web Services. Since transmitting through the internet isn't realistic, the cloud service can ship you a storage device to load your data into. For example, Microsoft offers Azure Data Box and Amazon has AWS Snowball. After shipping the device back, you'll be able to see your data online in a few days.

David

Ooooh, that seagate in the middle right. I had one of those; ordered a 250gb one when I was in Iraq to "borrow" music and tv shows from the morale drive. That thing will probably still boot up, but it's a pain as it requires an outlet for power.

Mr. Rivers

Man guys thanks for all you do! I know that is not easy. Hours and hours of staring at a screen, hoping it works with no mistakes.

Kellic

Just in case you aren't.....Keep your QNAP up to date, Software wise QNAP is really bad about security. (Less of an issue as long as you don't have internet services enabled.) You guys might want to buy a few 20TB drives. Throw them in here https://www.amazon.com/GLOTRENDS-Protection-Resistant-Photography-B86/dp/B09CYZPR3F/ref=asc_df_B01LXO6HLG And store them offsite. Just a thought as god forbid you guys ever have a fire or a tornado or something and lose that archive. I have a QNAP NAS that up and died on me a few months back. I only had 60% of 83TB backed up. I'm was able to import the storage back on a new NAS and am in the process of backing up to 5x Ironwolf Pro 20TB drives for offsite backups at an aunts house a few miles away. :) If something nukes my house and her's well I have bigger issues to deal with. PS also put your NAS on a UPS if you haven't. The file systems on QNAP do NOT like going down hard.