News for hackers. Stuff that matters.
Re:Chia surpasses 1 exabyte of hard drive space by gruez on Wednesday April 28, 2021 @11:28PM (#26977098)
chia claims that its proof of work alternative is "eco-friendly"[1]. This is also reflected in their advertising material, eg. instead of having a whitepaper they have a "greenpaper", and rather than mining they have "farming. While it's true that proof space is less energy intensive to "farm", wouldn't economics dictate that the resource consumption is equal to proof of work's resource consumption? All you're doing is shifting opex (electricity consumption) to capex (hardware costs). We can see this in bitcoin mining hardware. They've gotten exponentially more efficient over the years, but electricity consumption hasn't gone down. Having lower opex only incentivizes miners to pour more money into hardware, which results in resources poured into manufacturing rather than providing electricity.

[1] https://www.chia.net/faq/

Re:Chia surpasses 1 exabyte of hard drive space by Glench on Wednesday April 28, 2021 @11:53PM (#26977258)
I think another difference that I've heard the Chia folks talk about is the fact that even with a shift to manufacturing (which is real and a potential ecological problem, but one that already exists to some extent in the 1+ zettabyte storage industry), it's a one-time deal — hard drives can keep farming forever after they're manufactured with minimal electricity consumption. And they can be used for other purposes besides just farming Chia. With bitcoin the cost is terrible because ASIC hardware only works for mining bitcoin and by definition has to waste huge amounts of electricity forever to keep mining.
Re:Chia surpasses 1 exabyte of hard drive space by gruez on Thursday April 29, 2021 @12:03AM (#26977319)
>it's a one-time deal — hard drives can keep farming forever after they're manufactured with minimal electricity consumption

Let's say your mining operation brings in $1000/day in revenue. If it's mining bitcoin you might be paying $500/day in electricity bills, leaving you with $500 as profit to reinvest in the business (ie. buy more hardware). If it's mining chia you might be paying $50/day in electricity. That's $450 in less resources wasted, sounds good right? Well no, because any savvy businesman is going to reinvest that $450 into buying more mining hardware, so you can make even more money. In the end any resource you save from lower electricity consumption just gets poured into manufacturing more hardware.

>And they can be used for other purposes besides just farming Chia

This is a mixed bag, because while it's true that the mining hardware can be repurposed, it also means that during boom times, regular consumers have to pay more for their hardware. See for instance, the GPU shortage.

Re:Chia surpasses 1 exabyte of hard drive space by Glench on Thursday April 29, 2021 @12:31AM (#26977485)
It all depends on the economics. It's pretty likely that at some point reinvesting in Chia by buying more drives just doesn't make sense.

You can also read more about the power consumption of Chia here: https://chiapower.org/

Re:Chia surpasses 1 exabyte of hard drive space by woah on Saturday May 01, 2021 @11:21AM (#27007001)
What do you mean? Chia miners will be forced to continually expand capacity, otherwise they will be left behind by difficulty adjustment as other miners expand capacity instead.

Chia does only one thing: replace $1000 spent on electricity with $1000 spent on SSD manufacturing. It’s unclear which one is worse for the environment, but I think it’s likely that SSD manufacturing is worse, given the (real) mining and toxic chemicals involved.

Re:Chia surpasses 1 exabyte of hard drive space by puranjay on Thursday April 29, 2021 @07:20AM (#26979711)
Do you know what’s a good place to start if I want to build a rig for Chia?
Re:Chia surpasses 1 exabyte of hard drive space by thinkmassive on Thursday April 29, 2021 @08:26AM (#26980261)
“We initially recommend that you try plotting with what you have around.”

https://www.chia.net/2021/02/22/plotting-basics.html

Re:Chia surpasses 1 exabyte of hard drive space by Glench on Thursday April 29, 2021 @08:21AM (#26980202)
You might check out https://chiaforum.com/ or there are some Youtube tutorials if you search.

You can also use any old extra disk space you have on your current computers.

Re:Chia surpasses 1 exabyte of hard drive space by duskwuff on Thursday April 29, 2021 @12:00AM (#26977298)
> hard drives can keep farming forever

SSDs have limited program/erase lifespan, and the proof-of-space algorithms used by Chia eat into that lifespan pretty fast.

Re:Chia surpasses 1 exabyte of hard drive space by Glench on Thursday April 29, 2021 @12:06AM (#26977334)
To be precise, the process of "plotting" (using disk space for Chia) causes a lot of writes to disks, but those writes are a one-time process. Once a plot is written it can be moved anywhere and farmed forever. The actual proof of space algorithm for farming only takes an initial 5 seeks and then 64 seeks for the full proof so farming is not a big stress on disks long-term.
Re:Chia surpasses 1 exabyte of hard drive space by wruza on Thursday April 29, 2021 @12:51AM (#26977589)
What numbers are we talking about here? Assuming 1tb ssd with say 1000 cycles of warranty, would it die instantly or would it not even feel it?
Re:Chia surpasses 1 exabyte of hard drive space by YarickR2 on Thursday April 29, 2021 @07:25AM (#26979756)
I stumbled upon an interview with the actual Chia <s>miner</s> farmer, he claims best SSDs will stay healthy for about a year, and having SSD is a must. Plotting should be done on an SSD (preferably as an NVMe), since this process involves creating 300Gb temp file on the same device that will be used to form a plot. Actual interview [0] is in Russian, but I guess you could get a decent Google Translate-processed English translation . [0] https://habr.com/ru/company/ruvds/blog/554046/
Re:Chia surpasses 1 exabyte of hard drive space by wruza on Thursday April 29, 2021 @11:55AM (#26982787)
This was really precious, spasibo! Especially for warnings on [not] using regular disks.

But from what I learned there, Chia is not a consumer’s tech, cause mainnet already requires huge TBW per dollar ratio, which ubiquitous Samsung EVO/Pro and alikes cannot do. It goes miners-are-special-hardware route again, sadly.

Re:Chia surpasses 1 exabyte of hard drive space by neurostimulant on Sunday May 02, 2021 @07:58AM (#27014476)
I wonder if it's feasible to use a ramdrive for the temp file. Or maybe the miners already run the number and decided it's cheaper to burn a stack of SSD every once in a while instead of investing in nodes with huge ram.
Re:Chia surpasses 1 exabyte of hard drive space by reelen on Monday May 03, 2021 @08:24AM (#27024152)
That would only be with enterprise class SSDs. I’ve been plotting on both consumer and enterprise and the former’s lifespan won’t be more than 3-4 months.
Re:Chia surpasses 1 exabyte of hard drive space by novok on Thursday April 29, 2021 @12:08AM (#26977348)
do you need to use ssds with chia?
Re:Chia surpasses 1 exabyte of hard drive space by Glench on Thursday April 29, 2021 @12:12AM (#26977370)
No, it's just useful to use SSDs for plotting since they're faster. For farming any storage (HDDs, for example) are fine.
Re:Chia surpasses 1 exabyte of hard drive space by jfoutz on Thursday April 29, 2021 @12:36AM (#26977508)
How about a RAM disk?
Re:Chia surpasses 1 exabyte of hard drive space by loloquwowndueo on Thursday April 29, 2021 @06:44AM (#26979501)
Sure but you need about 300GB RAM for the temporary files needed while creating plots.
Re:Chia surpasses 1 exabyte of hard drive space by MR4D on Thursday April 29, 2021 @11:57AM (#26982817)
Thinking about it, for someone who is looking to be seriously into chia, that might make sense. The cost of the RAM is only about $1,500. Might be a smart idea.

Has anyone tried this? Would be interesting to see the benefits.

Re:Chia surpasses 1 exabyte of hard drive space by 35mm on Thursday April 29, 2021 @04:05PM (#26986021)
Actually plotting in parallel across multiple SSDs is likely to have the highest TiB/day of plots created. And then you’d be better off using the ram to enable more parallelism.

It’s a matrix of processor cores, threads per core, temp drive bandwidth, memory, and temp drive speed. Oh and cost per TiB of plots per day.

Also plotting happens in several stages, and each has a different set of requirements. So timing the running of plots in parallel and staggering starts also comes into it.

Re:Chia surpasses 1 exabyte of hard drive space by FranchuFranchu on Thursday April 29, 2021 @02:33PM (#26984716)
Wouldn't the ram be idling most of the time while farming? Only storage space matters for farming, speed doesn't.
Re:Chia surpasses 1 exabyte of hard drive space by MR4D on Thursday April 29, 2021 @03:31PM (#26985534)
Honestly, this part I don't understand.

Somewhere over that couple days I read that you can farm on an HD, but plotting is faster on an SSD, so I'm making a huge presumption that plotting on a ramdisk would be even faster, without the wear on an SSD.

I'm still not clear on Chia. Sometimes I think I understand it, and other times I'm not so sure...

Re:Chia surpasses 1 exabyte of hard drive space by chade on Thursday April 29, 2021 @11:56PM (#26989698)
Plotting is the initial process of building the files that you farm with. Plotting is very CPU/Memory/Disk IO intensive and the total writes to a disk to build a ~100gb plot is over 1tb with ~260gb of temporary space used at any one time during the process. This means that the process of building plots (plotting) is best done with an ssd. The fact that the process writes over 1tb to the disk to generate a ~100gb plot means that you will be really consuming the life of a consumer grade SSD with a low TBW rating. It is possible to use RAMDisk and yes it is potentially faster for a single plot. But you would need ~260gb of ram to plot 1 plot at a time. Nvme SSD's are only marginally slower than ramdisk but they are much cheaper per GB and you can connect multiples of them meaning you can build many plots at once. ie. 1-2 plots per CPU core concurrently provided you have sufficient ram ~3400mb per plot and sufficient fast temporary storage SSD. Once plotted the plot file can be moved to a spinning disk HDD and farmed from there as very little reads are ever made in the farming process. Can you use Ramdisk? yes. Is it better? No. It's far cheaper and faster to use SSDs and use your ram for building multiple concurrent plots.
Re:Chia surpasses 1 exabyte of hard drive space by MR4D on Friday April 30, 2021 @12:04AM (#26989734)
Thank you very much. That’s the first explanation that makes complete sense.
Re:Chia surpasses 1 exabyte of hard drive space by noch on Thursday April 29, 2021 @06:40AM (#26979470)
> With bitcoin the cost is terrible because ASIC hardware only works for mining bitcoin and by definition has to waste huge amounts of electricity forever to keep mining.

Multipurpose mining hardware would compromise security of the network. An alternative use for the hardware would effectively be a subsidy on mining Bitcoin.

This would imply that the costs of securing Bitcoin are not being paid by Bitcoin hodlers, and are not fully internalised by Bitcoin.

This is similar to the reason that Proof of Work must not have economic uses external to the network.

If such a subsidy were more valuable than rewards intrinsic to the network, any variance in that subsidy would cause variance in the security of the network, with the likely case being reduced security, the network now being dependent on that external use case.

E.g. if the alternative use is valuable, it might incentivise me to acquire enough miners such that I control majority hashrate of the network subsidised by the alternative more profitable use of the hardware. Any attack on the network is then subsidised by the external use case for the hardware.

Re:Chia surpasses 1 exabyte of hard drive space by magila on Wednesday April 28, 2021 @11:39PM (#26977174)
The key difference is that there is a lot of overprovisioned storage out there currently sitting idle which could be used to farm Chia with only a marginal increase in energy usage. The theory is that as this overprovisioned storage comes online it will make stockpiling storage explicitly for farming unprofitable.
Re:Chia surpasses 1 exabyte of hard drive space by gruez on Wednesday April 28, 2021 @11:49PM (#26977235)
>The key difference is that there is a lot of overprovisioned storage out there currently sitting idle

From where? Individuals or enterprises? With the direction we're headed (SSDs and cloud storage), it's hard to imagine many people with a few terabytes of hard drive space. On the other hand you can get around cheap hard drives at around $15/TB if you buy external, then shuck them so you can put it in a backpane or something. At that price, it's hard to beat the price of a new drive, especially if you factor in the time it takes for the individual to set it up. Enterprises might have better economies of scale, but I'm skeptical that executives would sign off on running arbitrary code on production servers just to earn some cryptocoins.

Re:Chia surpasses 1 exabyte of hard drive space by selfhoster11 on Thursday April 29, 2021 @07:24AM (#26979749)
It's becoming more and more popular for hobbyists to have at least double-digits of TB of storage sitting around for various purposes. I'd gladly make some profit out of the part of my array that's not filled up yet.
Re:Chia surpasses 1 exabyte of hard drive space by christiansakai on Friday April 30, 2021 @04:27PM (#26998845)
Curious, what purposes here? What kind of hobbyst we are talking about?
Re:Chia surpasses 1 exabyte of hard drive space by selfhoster11 on Monday May 03, 2021 @05:38AM (#27023147)
The usual "Linux ISOs" storage, self-hosted cloud services, data hoarding of all kinds (https://www.reddit.com/r/DataHoarder/), probably original content creation for those who don't want to pay for/use cloud storage (photo/video/audio editing and creation). I'm sure that there must be more, but this is just the ones I know off the top of my head.
Re:Chia surpasses 1 exabyte of hard drive space by Glench on Thursday April 29, 2021 @12:00AM (#26977301)
Both enterprises and consumer drives have over-provisioned storage, yes. Enterprises obviously have a lot more and it will take a while for them to trust that Chia is a good way of using their unused storage until a more valuable use of their storage space comes along (like an Amazon customer requesting S3 space or something).

It also seems likely that flash storage will become cheaper than HDDs in the next ten years, which will start increasing SSD space on drives due to increased competition. Analysis here: https://wikibon.com/qlc-flash-hamrs-hdd/

Re:Chia surpasses 1 exabyte of hard drive space by marcan_42 on Thursday April 29, 2021 @12:49AM (#26977579)
The idea that enterprises have tons of "over-provisioned" storage is hilariously cute. Do the Chia guys really think engineers at FAANGs haven't found ways of using that storage for something useful? :-)

Storage workloads aren't uniform. Some need to have localized, reliable, consistently performing persistent storage with room to absorb sudden demand spikes (like customer data on cloud clusters). Others can be stored anywhere and moved with ease, with few requirements on latency, redundancy on a global scale, and read-mostly workloads, which means immediate loss of a single local copy is harmless (like YouTube videos). FAANGs have long since figured this out and how to optimize their storage utilization.

There is zero chance one of them is going to up and decide that Chia is a better use of their "spare" (not really) storage capacity if they have anything resembling competent engineering teams. I know Google does.

Source: Xoogler.

Re:Chia surpasses 1 exabyte of hard drive space by rbanffy on Thursday April 29, 2021 @07:14AM (#26979686)
Not all enterprises are FAANGs and the immense majority operates at a tiny fraction of that scale.

While I don’t think too many businesses will buy this idea of using spare storage for “cryptofarming”, unused resources are pretty common.

The price of a cryptocurrency will tend to roughly follow the cost of generating it. In storage, it’s safe to assume the cost will only go down for the same amount of space. And disk space has been growing faster than transistor density for some time now.

Re:Chia surpasses 1 exabyte of hard drive space by marcan_42 on Thursday April 29, 2021 @11:52AM (#26982753)
Unused resources are common, but this kind of thing is only valuable at the scale at which you already have engineering teams doing useful stuff with the storage. Smaller enterprises are not going to be deploying "cryptofarming", there is no way it would be approved in the vast majority of orgs.

So in the end this is going to be just like every other cryptocurrency: people largely deploying exclusive mining (sorry, "farming") capacity and consuming resources doing so.

Re:Chia surpasses 1 exabyte of hard drive space by skybrian on Wednesday April 28, 2021 @11:42PM (#26977197)
To speculate, it seems like the lowest-cost supplier will win and that’s likely to be used drives from data centers. Chia farming uses storage, but not necessarily reliable storage so maybe any drives that start looking flaky could be rented out to Chia farmers, to get a bit more use out of them?

At least some data centers destroy their old drives for privacy reasons, so they would need to figure out a way around that if they’re going to reuse them offsite.

Re:Chia surpasses 1 exabyte of hard drive space by gruez on Wednesday April 28, 2021 @11:56PM (#26977277)
>To speculate, it seems like the lowest-cost supplier will win and that’s likely to be used drives from data centers. Chia farming uses storage, but not necessarily reliable storage so maybe any drives that start looking flaky could be rented out to Chia farmers, to get a bit more use out of them?

AFAIK people already buy up used datacenter drives to use elsewhere, so you're just shifting demand around.

Re:Chia surpasses 1 exabyte of hard drive space by rbanffy on Thursday April 29, 2021 @07:16AM (#26979696)
If the data on the drive is encrypted, there’s no need to shred decommissioned drives.
Re:Chia surpasses 1 exabyte of hard drive space by skybrian on Friday April 30, 2021 @01:45AM (#26990160)
True, but some companies are extra careful. Or were anyway, back when I got a tour.
Re:Chia surpasses 1 exabyte of hard drive space by rbanffy on Friday April 30, 2021 @06:58AM (#26991893)
True. You can hold the drive for a couple decades and then decrypt it with your shiny new MacBook based on the newly released Q1 quantum processors. ;-)
Re:Chia surpasses 1 exabyte of hard drive space by tempestn on Monday May 03, 2021 @04:08AM (#27022689)
To me, this is why Proof of Stake is the only long-term sensible decentralized cryptocurrency system. ISTM PoW and PoST ultimately equate to the same thing, for the reason you've suggested. If it's profitable to invest more in mining, people will invest more in mining; it doesn't matter whether that investment takes the form of ASICs, GPUs, HDDs, or simply the opportunity cost of holding the currency itself. The only difference is, that last one doesn't burn a bunch of real world resources in the process.
Re:Chia surpasses 1 exabyte of hard drive space by maxerickson on Thursday April 29, 2021 @10:02AM (#26981281)
There's no expected level of resource consumption.

Bitcoin is a shitty public ledger, the resource consumption is due to the significant collective interest in it, not what it accomplishes.

Re:Chia surpasses 1 exabyte of hard drive space by RyEgswuCsn on Saturday May 01, 2021 @06:59PM (#27010681)
You mean the Jevons Paradox[1]?

[1]: https://en.wikipedia.org/wiki/Jevons_paradox