So, yes, SSDs will improve. But they exist in a different tier/market segment until they can close that cost gap.
My perception of the future is maybe a 20TB SSD for $2000 vs 15TB HDDs for $500.
And 60 TB in 3.5": https://arstechnica.com/gadgets/2016/08/seagate-unveils-60tb...
No spinning rust drive comes close.
Another important factor to remember is that your HDD will give you 200 MB/s of sequential data. If you have a random pattern it's going to drop to 10 MB/s or less. (15K RPM SAS drives can do around 150-170 random IOPS, assume 32 KB per operation and you're looking at 6 MB/s.) SSD will push out 10x+ that rate for random IOPS. A 100 TB HDD sitting behind 200 MB/s is painful but sitting behind 5 MB/s is insane. There's a place for such devices, but it's not serving your OLTP databases or kafka message queues.
WD might expect the price-fixing will continue for several more years, though. The corrupt South Korean administration dropped their investigation into price-fixing in the NAND market several months back. I don't know what impact that will have on the general international effort to prove the collusion that seems so obvious.
I just want a 20TB SSD for $500. It's 2017 and no, that's not too much to ask. They're friggin parallel grids of NAND gates with a bunch of multiplexor/demultiplexors bolted on. All photolithography. I don't need them to be those tiny little M.2 sticks, go ahead and give me one in a friggin 5.25" case. At this point they've gone about a mile past where I got fed up with this crap.
Why not both?
WD bought SansDisk for a reason. WD is likely going to be investing in both Hard Drives AND NAND Flash in the near future.
I'm curious what the other factors are beyond just the cost per TB/PB in each rack. Like reliability over very long time scales... beyond the cost factor and into archival territory. Or in an emergency or destructive scenario (i.e. do platter drives fair better in a fire than SSDs)
It's hard to actually rewrite spinning rust 2000 times a year. That's exceeding 100% utilization with completely optimal sequential write pattern on 7200 RPM drives. Say you can write 200 MB/s continuously[0]. That's about 6 PB/year. With a 6 TB harddrive, that's only 1000 full overwrites a year.
Maybe 10k or 15k RPM drives can overwrite 2000 times a year, but those have vastly higher cost than 7200 RPM drives. At some point, you just overprovision the flash enough to bring the number of required overwrites down, and it's still cheaper than 10-15k RPM drives.
[0]: Approximately average for enterprise drives: http://www.tomsitpro.com/articles/enterprise-hdd-testing,2-8...