NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
▲Seagate's new hybrid drive raises some old questions (arstechnica.com)
linsomniac 1 days ago [-]
I've often wondered why there aren't any (that I'm aware of anyway) Linux hierarchical storage managers (HSM). I realize they are typically used in big iron with things like tape as the base level of storage, but especially when it looked like Optane was going to be a thing it seemed like spinning<->SSD<->Optane<->RAM could be a huge performance opportunity. Though, I guess that's a "layering violation"... Honestly, at this point we've gone almost entirely SSD except for our ZFS backup servers, and that layering violation already has an SSD and RAM cache in it...
uniqueuid 1 days ago [-]
When you're running ZFS (or probably some other clever layering violation like bcachefs) on heterogeneous workloads, you will quickly run into the limits of built-in assumptions. At least that's my experience:

- ARC may require manual tuning for size and metadata size to accommodate page cache, in-app caches, file count etc

- L2ARC and SLOGs are very obviously useful for some clear workloads, but have some cliffs you don't expect, such as ram required for L2ARC mapping, unexpected cold/hot/boot behavior

- Reasoning about reliability becomes harder the more tiers you have

Just imagine, to pick a simple example, you're running postgres, thousands of sqlite3 dbs and one huge duckdb (larger-than-ram) on a single such system - it would perhaps manage to adapt to one such workload at a time, but would it balance all three at the same time?

So much as I'd love to see this direction, I can also imagine the pains coming with it.

bilegeek 1 days ago [-]
The best solution is metadata-only caching, as that's mostly random I/O and would leave the mechanical bandwidth fully for the data itself. The downside is that L2ARC won't have everything, as it isn't proactive; there is the special device, but then the metadata is SSD-only, with that one failure point unless you run mirrors.

If they'd get around to merging Special Failsafe [1] and hybrid drives could address the flash space separately like under SAS, it would be a no-brainer.

[1]https://github.com/openzfs/zfs/pull/16185

1 days ago [-]
ssl-3 1 days ago [-]
Right now at the ZFS-using desktop PC I write this with:

640GB of total L2ARC, 66% utilized (34% available). 664MB of RAM is used to keep track of this.

The machine only has an uptime of a little over a week right now, but over that period L2ARC had a 93% hit rate.

L2ARC would fill more-completely but the machine is low on free RAM right now; Firefox is being a pig, and that means that some things get ejected from ARC before they can be sent to L2ARC.

It's generally quite responsive despite being a box that exclusively uses spinning rust as primary storage.

In terms of absolute reliability: RAIDZ2 is in-use, which allows two drives to fail without data loss. Adding the L2ARC did not change this: Either or both of L2ARC devices could die in an instant and the machine would keep moving along (at reduced performance).

(I'd planned to upgrade the hard drives to something bigger, which is a simple process with ZFS, and also add more RAM, but the market moved faster than I did and I'll be stuck with this for awhile.)

1 days ago [-]
rendaw 16 hours ago [-]
What do you mean by clever layering violation?
j_not_j 1 days ago [-]
Even the corporate/enterprise multi-level HSMs has had to compete with rapid improvement in disk drive capacity.

Buying a Sony or IBM HSM with 20GB tapes backing a 5TB store (built with 2GB disks) soon looks pretty stupid when drives exceeded 40 and 80GB. (Adjust your calendar or drive scaling to match your expectations.)

Back in the day I worked on a quote for a European weather agency who wanted a CD-ROM archive built with robots. CD-ROM! DVD-R was just coming up in those days. The effective product lifespan would only have been 2 or 3 years until large scale enterprise disk would have superceded it.

Nowadays with multi-TB tapes the minimum viable archivable unit is in the gigabytes. Nobody would be 2million files on a single LTO tape.

HSM is really a product category: do you want write-only archive (think weather data, satellite images, etc). Are some files expirable so you want to actually eventually "delete" files by re-writing tapes with only valid data? What's the allowable time-to-first-byte on retrieval? What kind of redundancy is appropriate? What is the operating cost vs capital cost tradeoff? And, importantly, what database is supporting the metadata and how is it maintained?

Antipatterns:

- grep on a caching filesystem backed with a tape library - monthly retrievals of the same file year after year (even LTO has a limited tape operation lifetime) - management failure/refusal to migrate to newer tech every 4 years - buying 10 years of capacity in advance

You can get a lot done with tar, mt, and bash in a grow-your-own nearline archive with a tape technology of your choice.

lubitelpospat 1 days ago [-]
I was lucky to find you comment about how a lot can be done with tar mt and bash, I was doing something along the lines of trying to fit as much data as possible into a single tape without writing there more than it can be fit into one if possible, would you kind internet stranger happen to have a few wise words pointing me towards the solution or maybe a GitHub gist with an example of something along these lines? Thank you very much upfront!
cowlevel 14 hours ago [-]
to be fair a CD archive would've also supported DVD and BluRay with no mechanical changes, since the disks and drives are the same size.
lizknope 1 days ago [-]
There is bcache and dm-cache. bcache was the basis for bcachefs but I don't know anyone who uses them or dm-cache

https://en.wikipedia.org/wiki/Bcache

https://en.wikipedia.org/wiki/Dm-cache

Sometimes I shoot over 100GB of raw photos and don't finish processing it all in 1 session. It would be nice if that got cached in an SSD rather than having to read the hard drive every time. But it's not a big enough issue for me test one of the caching layers.

arjie 1 days ago [-]
It’s just easier done at the application layer. At a previous engagement, in the Before AI era, we originally had a block-level tiering solution that went from RAM to local nvme to NAS on striped flash to S3. It worked okay, but the application-level tiering worked better.

Would have loved a read-through union filesystem but you pretty much had to do your own.

rythie 1 days ago [-]
There is LVM Cache which uses dm-cache. That allows you to use SSDs to cache HDDs. Either can be RAIDed too. You can choose your file system because it happens at the block layer.
saltcured 5 hours ago [-]
Yeah, I used this in workstations many years ago. My basic idiom was a RAID-1 pair of SSDs as a writeback cache on top of a RAID-1 pair of large HDDs.

In the machine room, the moral equivalent was just a rackmount server with large RAM for Linux buffer cache and a RAID card with self-powered writeback caching. This could scale to roughly 8-12 HDDs. If we had need for larger stuff, we'd go with conventional NAS/SAN solutions. Eventually, the SaaS equivalents like EBS and S3 took over, and our group retired its onsite iron.

I also stopped doing LVM Cache as a number of trends converged. SSDs got faster and higher capacity, and changing work environments made the desk-side workstation less attractive. Now I just have a single NVME device and nightly cloud backups.

It's been a while, so I don't remember the LVM Cache intricacies. I think I had a mix of some LVs which were SSD-only, some which were this writeback-cached stack, and some which were HDD-only, allocated from the same 4 physical drives. I don't exactly recall how the caching part appeared in the logical hierarchy. I.e. was it a preallocated pool of cached storage, or just a per-LV assignment of chunks from SSD and HDD PVs..?

InsidiousWombat 23 hours ago [-]
There is bcache which is basically SSD cache for slower backend.

It's just pretty niche. And in cases where you want it it's often better to have the hot/caching tier be application data aware, for example for caching web requests you might want to cache different objects for different duration, or selectively purge them when app invalidates some data.

niltecedu 9 hours ago [-]
I think SSDs getting cheaper and faster kinda made it moot, same for HDDs as well, like they are wayy more faster than the ones you see 10 years ago. If it wasn't for the AI Boom, SSDs would have been common place for all of our servers
Schlaefer 1 days ago [-]
RAM cache is already layered in front of persistent storage. When it comes to easy hybrid SSD/HDD setups bcachefs was close to deliver, but then things jumped the shark.
vbezhenar 1 days ago [-]
Isn't bcache that thing you're looking for?

RAM is always used first for caching, so it's a given.

ThatPlayer 1 days ago [-]
bcache is just the block level caching, with a different filesystem running on top of it. There's bcachefs. I'm using it on a computer exactly for this purpose.
netrap 9 hours ago [-]
There was hooks to XFS but they were removed because there wasn't the "manager" part.
nielsole 1 days ago [-]
Besides the trivial caching on SSD there's also ways to do write buffering quite easily. I did that once a long time back when SSDs were too expensive for getting a 2TB disk. So probably ~10 years back.
cowlevel 14 hours ago [-]
Because nobody wrote one. It's the curse of open source.
lostmsu 1 days ago [-]
That's exactly why I keep Windows on my NAS. You can configure storage tiering with arbitrary redundancy. You can have different redundancy on SSD and HDD tiers. As far as I am concerned ReFS gives me all the features of ZFS and doesn't eat my RAM. Also BitLocker + Secure Boot aren't pain in the ass there.
dabinat 1 days ago [-]
> …comes in 8TB ($699) or 20TB ($899) HDD configurations—neither of which includes the required SSD.

The 8TB version seems like very poor value for money. For comparison, Amazon is selling 24 TB Seagate Exos drives for $799.

hinkley 1 days ago [-]
I will never buy electronics off of Amazon ever again. Whether they’ve fixed their mingling or not, they did it for years with no regrets. That level of contempt for customers deserves to be boycotted in perpetuity.
thaumasiotes 13 hours ago [-]
> Whether they’ve fixed their mingling or not, they did it for years with no regrets.

This appears to be a logical impossibility. If they had no regrets, why would they have fixed it?

leafbox 13 hours ago [-]
Change does not have to come from regret. The tradeoffs might shift due to the circumstance (customer pressure/bad PR/...) and Amazon followed through with an action that appears as a fix from a consumer viewpoint.

I am not sure if it is a fixed problem now, it has been years since I purchased electronics from Amazon in part due to that exact issue.

hinkley 2 hours ago [-]
Why would you imagine fixing the problem has anything to do with guilt instead of $$$? Sociopaths fear reprisal, they have no guilt. C Corps are almost by definition sociopaths.

When be boycott a product, that company has already proven to be a drag on society. Getting them to change isn't about a Christmas Miracle, although every once in a while someone steps down and the new person is less obviously malignant. Instead it's making sure everyone else sees the consequences. Sometimes that makes it possible for a decent person to get votes past the board of directors, because at least a few fear punishment.

cowlevel 14 hours ago [-]
Note the dark pattern here - even if you only needed 8TB and would have paid $699 for it because you need it (that's expensive for 8TB) you're more likely to buy the 20TB option and give them an extra $200.

In fact you're so much more likely, you're more likely to buy the 20TB option than if it was the only option you had!

This is well known in marketing but I'm struggling to find its name with Google - it's close to the "decoy effect", which is a form of "menu dependence".

jesse9766 4 hours ago [-]
Anchoring
bajard 1 days ago [-]
But you have to buy a pair, so the price is double.

You need a pair because if one HDD starts failing, you need to recover the data. Reading a 20 TB HDD takes an entire day of continuous reads, and a failing HDD can't handle that, so you need RAID 1 or a backup.

ddorian43 15 hours ago [-]
If you think like that, you should know that they both might fail together at the same time too! Like your second drive may fail while recovering from the first failure (rebuilding the raid with a new drive).
bajard 12 hours ago [-]
Yes, but the point is that smaller HDDs gave you enough warning time, and 20 TB disks do not, because they are too slow. So, if you buy one disk to have your data saved, you are deluding yourself.

A 20 TB disk has a 20% chance of failing within 10 years (at least industrial ones, which tend to be higher quality than consumer ones). But the probability of two disks failing simultaneously within the data recovery period of the first failing disk is less than 1 in 16,400.

The exact numbers aren't the point, but the order of magnitude.

21 hours ago [-]
PorciiVorbesc 1 days ago [-]
> Amazon is selling 24 TB Seagate Exos drives for $799

Might be a scam, you might get a used or a refurb drive. I wouldn't' trust Amazon for such purchases, if the price feels too good.

16 hours ago [-]
zx8080 1 days ago [-]
Make sure it's not amazon.DE as those are usually scam.
choppaface 1 days ago [-]
nice find! ServerPartDeals seems to be cheaper than Amazon tho. Sadly Amazon blocks agentic price watching but https://instinct.com/ has otherwise been great at watching HD prices.
Marsymars 1 days ago [-]
There are existing price watch services for amazon (e.g. camelcamelcamel) that work very well... if you need agentic price watching in your workflow, just have your agent watch your email for price alerts.
Dylan16807 18 hours ago [-]
> According to data collected by Tom’s Hardware, some solid-state drives now cost two to three times their historic lows, and it’s not just SSDs.

The 1-2TB TLC drives that were the best deal before are more like 4x their lowest price.

robotnikman 1 days ago [-]
I used to have one of their 2.5in hybrid drive in a laptop. Seemed to work well for games. But once SSD's became cheap the tech was not longer worth it. Also, 2.5in drives topped out at 2TB of storage, while NVME and 2.5 Sata SSD's continued to grow in size.
31rf89e1f5e6 1 days ago [-]
No? Plenty of 2.5" drives in 4TB size and bigger, for example the ST5000LM000 or a WD50NPZZ are 5TB ones. Unless you mean strictly newer laptops, that take 9.5mm or 7mm drives. Which are slim ones.
Marsymars 1 days ago [-]
Kinda, but I don't think there are any non-discontinued, 2.5" PMR drives larger than 2TB, regardless of physical size.
justsomehnguy 7 hours ago [-]
> Unless you mean strictly newer laptops

NB 'strictly newer' doesn't even have 2.5" at all. Out of ~1000 of laptops at my local, pretty big shop - there are only 6 (six) with 2.5" bay.

justsomehnguy 1 days ago [-]
These are SMR. Thanks, no.
Nexxxeh 23 hours ago [-]
You're lucky you swapped it out. Those Seagate SSHD hybrid drives seemed to fail at higher vastly rates than HDDs or SSDs, and were an absolute nightmare.
Grombobulous 1 days ago [-]
If you have to provide your own SSD, I would think that the target audience already knows how to set up a cache disk in their NAS solution of choice, and they'd save a bunch of money that way.
Eric_WVGG 19 hours ago [-]
Apple’s “Fusion Drives” were great!

I had a 2009-ish 17" Macbook Pro (the Cafeteria Tray), removed the optical drive and replaced it with an SSD, then reformatted the whole thing using a bit of voodoo to turn it into an unsupported Fusion Drive. Gave it to my father when I upgraded a few years later and forgot about it. One day he took it in to the Genius Bar for some kind of service, drew a whole crowd of Apple Store employees who had never seen a Macbook modified under-the-hood before…

GaryBluto 1 days ago [-]
It's neat, but isn't it more of mixed-medium RAID-like setup than a "hybrid" drive? Especially since the SSD isn't included.
mikae1 1 days ago [-]
> According to PCServerParts, a Seagate Exos 24TB drive that sold for $298.99 in the summer of 2025 was priced at $699.99 by August 2026.

Spoiled Americans. That drive is $1393 (14160 SEK) here in Sweden now[1]. A year ago it was 4160 SEK...

Three times as expensive in 12 months seems true for most drives.

I'm just praying no drives in my NAS are going to crap out anytime soon...

[1] https://www.prisjakt.nu/produkt.php?p=12519318

robin_reala 1 days ago [-]
Yeah, wow. I hadn’t realised that the prices had gone up that much on hard disks as well. A pair of Synology 4TBs I bought for 2500SEK 18 months ago are now 3400SEK each from the same vendor.
reeredfdfdf 14 hours ago [-]
There are still okay deals to be made in the used market. I can find slightly used 4TB drives for about 80 euros a piece, or 8TB for 120. Obviously no warranty, but if the drive has lasted a year or two, there's a good chance it will last many years more.
rwmj 1 days ago [-]
Worse than that, sellers on Amazon all seem to be scams now[1], and my trusted local supplier (who has genuine parts) is only selling one hard disk per customer. Good luck populating a NAS.

[1] example from when I was trying to buy NAS drives a few weeks back: https://www.amazon.co.uk/sp?marketplaceID=A1F83G8C2ARO7P&sel...

justsomehnguy 1 days ago [-]
> is only selling one hard disk per customer

The dreaded communism came to the capitalistic states but not the way capitalists expected.

mistyvales 1 days ago [-]
I have 6x unused 6TB SAS drives I bought for $50 each in 2024. I assume they are $150 each now. I can't afford cold storage right now so I rely on raidz2 and can replace drives as they die.. But they have 2 years and no SMART errors.
bajard 20 hours ago [-]
You can buy from Amazon USA and have it shipped internationally.
larodi 13 hours ago [-]
They are taking the opportunity to still some more of older tech while demand lasts and it can well last into the next decade.
liquid_thyme 1 days ago [-]
Isn't this (architecture) basically like a NAS w/ SSD caching ? (w/ the caveat of not being on the network obviously)
debrisontrack 1 days ago [-]
The only relevant question seems to be "will these prices ever go down?"
kotaKat 1 days ago [-]
"According to Seagate’s press release, the Alkemi intelligent storage platform takes a different approach. Where Apple’s Fusion Drives used tiering managed by macOS, Alkemi manages the storage pool directly from the enclosure."

Soooooo... it's gonna be like the old days of Drobo, where a little VXworks box did all the heavy lifting of BeyondRAID and transparently exposed it as a big ol' block device to your OS? Good times.

rbanffy 1 days ago [-]
I’m not sure it’s realistic to expect an ordinary user to manage and tune tiered storage, so making it opaque to the OS, or even somewhat aware of the OS running on the computer via a device or filesystem driver, might be a sensible decision.
kogasa240p 1 days ago [-]
Hybrid drives are back? Thought they faded into obscurity a decade ago but it makes sense that they're returning.

>Users will have to bring their own SSD

uhhhhhhhh

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 00:18:27 GMT+0000 (Coordinated Universal Time) with Vercel.