HNHacker News
TopNewBestAskShowJobs

Straw

897 karma · joined January 27, 2018

submissionscomments
Straw··on Xorshift Generators
Most modern RNGs should be faster than memory bandwidth (when optimized), so unless your list is small enough to fit in cache, its unclear if this is faster?
Straw··on AI Data Centers Are Driving Up Power Bills – This Map Shows Where
Market systems work especially well when supply or demand are constrained- they allocate the scarce resource more effectively!
Straw··on AI Data Centers Are Driving Up Power Bills – This Map Shows Where
The data center demands are known years in advance. Its not like they magically appear out of nowhere.

Perhaps we should eliminate the utilities guaranteed monopoly then! Monopolies are usually dysfunctional.

Straw··on AI Data Centers Are Driving Up Power Bills – This Map Shows Where
There isn't an externality here in the traditional sense. No one has a right to purchase anything at any particular price. Should people be disallowed from bidding in auctions because it increases the price of the item in question?

No, people who live in geography absolutely should not control the land surrounding them. That's effectively land hoarding, and incentivizes deeply counterproductive NIMBYism. People should primarily control the land they own.

Straw··on AI Data Centers Are Driving Up Power Bills – This Map Shows Where
Why should they? If demand for X goes up, and price goes up, the whole point of the price system is to incentivize all users of X to use less and producers of X to make more.

Here's an example where the benefit is obvious:

Say I set up a desalination plant for a city with water shortages. I use a lot of electricity; this drives up electricity prices. But I also sell the more scarce water, lowering the price of water. If I make more selling the water, then to first order I'm helping people overall- they value the water more than the electricity. Perhaps I put other, less efficient desalination plants out of use, or simply other uses of electricity that people value less than the water I provide.

Straw··on Explorative modeling: Train on the best of K guesses
Although this is a neat idea, the author appears to be confused about how generative modelling works.

They repeatedly claim that previous approaches rely on factorization to reduce things to guessable chunks to avoid the 'blur problem'. This is a misunderstanding. Previous approaches solve this problem by modelling a distribution as output rather than a point. Factorization is one way of representing the distribution, but the key point is that even for the small chunks we predict an output distribution, not a point estimate.

Factored models have no issue producing TV static as an image. Each individual guess is impossible, and yet they don't produce a constant grey averaged image.

Normalizing flows, though not considered particularly efficient, are not factored at all, do not proceed in small steps, and yet still have no issues with blur because they predict a distribution.

Their approach appears to be a hard version of a latent variable model. It may be a good idea, but it isn't a fundamental change in the way they suggest.

Straw··on Big Food vs. the People
Sure. The most straightforward example would be utilities in much of the US. Companies like PG&E are literally granted a monopoly in a region.

Another example would be epipens. There is a competitor, but unlike most drugs, if the doctor prescribes you an epipen, the pharmacy can't give you a generic substitute, it must be name brand.

Tesla is being heavily protected from Chinese competitors by US auto tariffs.

Credit Ratings agencies (in large part responsible for 2008 crash) have direct government granted status.

Taxi medallions, Jones act, sugar tariffs.

These are the ones that come to mind right away, but there's a whole slew of stuff- any regulation that's easier for a big business to comply with than a small competitor, for example. Even worse if the big business manages to influence the regulation to enhance this effect. Personally I'd guess Boeing is an example of this; yes, aviation does have high capital costs but I suspect that FAA regulation + Boeing cozy relationship makes it much harder for new entrants. Of course, this isn't to say the FAA regulation isn't helpful or doesn't improve air safety, just that it also has this effect.

Straw··on Big Food vs. the People
Grocery store profits aren't larger than any other industry. Nor are they larger than in the past. Large grocery store chains do not have high profit margins. Sure, the total profit may be large if you run 1000 grocery stores.

What do you mean by they are the wealthiest in the nation? None of the richest people in the world built their fortunes on groceries?

Price fixing is a phenomenon. Anti trust is a policy agenda. What entity would carry out the proposed agenda, when the parties supposedly fixing are in different countries?

How long did the fixing agreement last successfuly? DRAM has famously gone through booms and busts where supply outstripped demand and led to very cheap prices and no profits.

OPEC worked about as well as any cartel. Could you give an example of a cartel maintaining their position without heavy government help? Even the drug cartels in mexico, with extreme willingness to coerce, cannot maintain a monopoly and have competed drug prices in the US down heavily! If you consider memory a cartel, then it has only remained so by... drastically improving the quality and reducing the cost of its product? Hardly a problem.

Straw··on Big Food vs. the People
There are many other factors affecting the size of corporations. For example, a significant increase in the amount of regulation in other sectors of the economy.

More importantly, the raw number of corporations isn't how you measure a monopoly. Profit margins are the key sign of monopoly pricing- but in practice, corporate profit margins have been relatively stable in percentage terms over time. Prices for virtually all consumer goods are way down in real terms over the last 30 years.

In particular, trade might get you more competition with fewer corporations, but via competition with overseas producers. These might show up as a few importing corporations, representing a whole slew of competitors abroad.

Straw··on Big Food vs. the People
I'd say exactly the same about antitrust. Can you give an example of a lasting monopoly not backed by some government policy? At any point in the last 150 years?
Straw··on Big Food vs. the People
You claim that a law that prevents or hinders you from making transactions with certain parties, while privileging other parties by exempting them from these restrictions, doesn't make it easier for the privileged parties to form a monopoly?
Straw··on Big Food vs. the People
Groceries are an excellent example of competition. Profit margins on groceries are razor thin. The large chain leverage results in lower consumer prices. Large grocery chains don't have anomalously high profits, ROI, or really anything that would indicate harm to consumers. Groceries are cheaper than ever compared to median wages.

The memory market is international, its not clear what anti trust even means here. Even so, look at the price of memory over time, say the last 20-30 years. Adjust for inflation and its even more extreme. Sure, it is up recently with AI demand, but the general trend is drastically reducing cost and increasing quality. Memory technologies are evolving quickly and it's a capital-intensive business, so its not surprising that there are a few leaders. There's no guarantee of instant competition in free markets.

Cartels rarely last long without enforcement. There's such a strong incentive to defect and secretly sell more under the table. Even OPEC could not maintain one. Memory right now is expensive simply because demand outstrips supply and there is significant capital investment and lead time to increasing supply.

Straw··on Big Food vs. the People
If you wanted to do the most to improve competitiveness possible, by far the most effective strategy would be free trade. Trade barriers prevent competition from overseas, making monopolies much easier to maintain.
Straw··on Big Food vs. the People
No, governments tend to produce monopolies.

Can you find true monopolies in the free market, in the last 100 years, that have lasted for at least 20 years, without some kind of government backing/suppression of competitors? I only know of one.

Things only count as monopolies if they have monopoly pricing power; Google is not a monopoly, they cannot even charge 1 cent per search.

In practice, despite economies of scale, large companies age and become bloated, inflexible, etc. So there's typically plenty of room for new companies to compete.

If a monopolist buys all upstarts, then that creates an even stronger incentive to make competing businesses! You don't even have to succeed in the market, you just have to get bought up! The more they buy out, there stronger incentive there will be to enter the market. No one can do this indefinitely- except with some kind of government support- say a regulation that makes it difficult to enter the market.

Straw··on U.S. science is in chaos
Oh, I wouldn't say that. The summary for policymakers they produce is incredibly alarmist compared to what their actual reports predict.
Straw··on U.S. science is in chaos
Interestingly, the IPCC reports themselves (not the summaries for policymakers) are quite optimistic. IIRC something like, if we do nothing to abate emissions, climate damages in 2100 will cause damage equivalent to ~3% of GDP per year. (With GDP being many times higher than now per capita). Hardly a catastrophic prediction!
Straw··on Correlated randomness in Slay the Spire 2
MT is actually quite a poor (and slow) RNG! PCG32 suggested in the article has much better randomness, state size, and speed.
Straw··on AI uses less water than the public thinks
A state is an entity with a monopoly on coercion. The tribal nations do not have this- while they have some carve-outs, ultimately federal law trumps theirs. So its not a matter of recognition, they simply do not meet my definition of a state.

Nominally is exactly right! The treaties have been violated many times.

You're missing the 1959-61 famine in China! Sure, famines have happened for other causes. Typically 100+ years ago before technology advanced. Now, famines largely come from poor governance.

Thanks for the background info!

Yes, I agree it is a patchwork system- and its probably quite difficulty to analyze! I'm arguing that a private ownership model with trading would lead to better outcomes, and basically end for all practical purposes water shortages.

For example, the smaller mostly Hispanic farmers you described above wouldn't lose their water rights in a rights ownership system- they could hold them, rent them out, sell them etc. But they wouldn't lose them merely for being unable to farm. Of course, water rights are a resource rent and it might be desirable to tax them as well- effectively economically partially public ownership- but this doesn't change the core argument about the efficiency of tradable rights.

Straw··on AI uses less water than the public thinks
The land and any associated rights was taken from the Native Americans by coercive force. Not a market. Not that they have any particular claim to it; states own land, not ethnicities. The particular state that controls land sometimes changes. This has little to do with any discussion of water rights.

I am suggesting expanding their water right- instead of only the right to do X, Y, Z with the water, take whatever right to the water they do have, in terms of amount of water, and say "you can do whatever you want with this much water". How to allocate resource rents doesn't have much effect on the market structure itself.

A lot of vitriol against supply and demand without any evidence.

Food is life. Food is culture. Just as much as water. Which countries have had famine, those that allocate via some system of food rights, or those that had a free market in food? The largest examples of famine I am aware of, in the USSR and Maoist China, were driven by some central allocation of food rather than a market. Not a good record.

One of the great features of markets is that things don't need to be decided collectively. Perhaps 90% of people want to wear blue T shirts, but I want a red one. If we collectively decide, I get a blue T shirt. In the market, I buy a red T shirt- perhaps at a very slightly higher price due to less economy of scale.

We certainly know of areas where vanilla markets can fail- externalities etc, but these do not apply to the situation here. The existing system of water rights doesn't feel like a collective decision, but rather entrenched special interests and lobbyists.

Straw··on AI uses less water than the public thinks
These all seem fine in a normal market?

If the Native Americans have water rights, they can also sell them. They can choose to use it inefficiently on subsistence farming, or they could sell at the going rate. A normal market itself doesn't imply any particular allocation of water rights, just that they should be as fungible and transferable as possible.

Why are the laws that govern the infrastructure particularly important? It only matters now because its a tangle of regulation. Yes, big users can often get bulk discounts or other special arrangements by committing to use. This happens in many areas.

There's no law governing what products my grocery store must carry. Yet, I can still choose a store with many things I like, at affordable prices. My store may (and frequently does) exclude all products containing some chemical considered harmful even if it isn't banned. Of course, water has more of a natural monopoly problem, but that's more for last mile infrastructure and not broader supply.

I don't understand the details of the riparian vs prior appropriation doctrine. How does this create an issue? If the water rights are defined somehow, in a usage-independent way, only in terms of the net water removal, to account for runoff from local use, and the water from them can be traded, then a market can work regardless of the specific nature of the right.

Any association holding the rights could allocate its water internally as it sees fit. Just like any other asset? Or it could decide to sell it and distribute the money instead- perhaps even better for fairness to it's members!

Straw··on AI uses less water than the public thinks
Standard oil not only reduced consumer prices for gasoline, but was already losing its monopoly to competitors during the antitrust trial.
Straw··on AI uses less water than the public thinks
This causes major market distortions and worse outcomes than the econ 101 solution.

The problem is that water isn't traded on a normal market at all. Lots of people have historical water rights and pay nearly nothing for their water use. There's byzantine regulation and many have the right to use for some purpose on their land but not to resell, so the market cannot allocate to more efficient use.

If you just let the 101 level solution actually work, water prices will rise until inefficient uses like water-intensive agriculture (not even all crops!) are pushed out. Urban users easily outbid almost all agricultural use, even at what any person would consider dirt cheap prices. For example, desalinated water, which is considered expensive for agriculture, can be 40 cents per cubic meter of water. That's a lot of water! Usually the last mile of urban water delivery costs more than that.

The amount required to satisfy all urban use, including water hungry lawns etc, and datacenters, corresponds to a very minor reduction in agriculture. Perhaps even just changing which crop is grown or switching irrigation techniques.

Charging more to higher users, price discrimination, causes several problems. First, it creates an incentive to cheat. I'm not using all this water myself, its for this whole group of people who "live" here. Don't allow this kind of spreading (somehow...)? Now you actually screw any business or institution that serves a lot of people. A farm produces food for thousands- do they count as one user? A park uses much more water than a garden but serves many more people. Whatever framework you create will require another bureaucracy to run. Lobbyists will find or insert loopholes for their friends.

The heavy users actually improve the system robustness, in both electricity and water. Their higher demand pays for more supply infrastructure, which itself often benefits from economies of scale, and in a shortage they may even be more responsive to price increases due to their high use.

Straw··on Austin’s surge of new housing construction drove down rents
This is nonsense. In every material good, the buying power of nearly everyone has increased in real terms over time, regardless of inequality. It's only in housing, with constrained supply, that inequality can drive up prices; and even in that case, it doesn't actually change the housing supply- if prices are high, that just means a lot of people who want to live there! Inequality doesn't reduce the number of houses.

Building a little reduces prices a little. Building a lot reduces prices a lot. If the prices are very high, then it's very profitable to build, so unless stopped by regulation, you will get a lot of building. Even if building merely keeps the price from going up as density increases, the value provided by living in an area goes up from agglomeration effects as it grows.

Straw··on Understanding traffic
Navigation/maps providers like Google/Apple maps, etc, will incorporate price estimates as well as time estimates- they can even show multiple options if there are price-time tradeoffs available.
Straw··on Understanding traffic
In a very weak form, yes- and yet it still seems helpful and even popular after people saw the effects of implementation.
Straw··on Understanding traffic
The congestion fees would go to the government responsible for the roads. Of course, they could be captured by the rich, but most governments spend most of their money not on the rich.

You'd set the congestion charge, by law (at least on public roads), to the minimum required for efficient road use- not the revenue maximizing price, which would likely be much higher due to monopoly.

Straw··on Understanding traffic
At high demand times, you have to be very rich indeed to outbid a full bus without even thinking about it. There aren't enough people who can do that.

But say this does happen a lot-this means rich people pay enormous road use fees, which can then be used for road maintenance, construction, and improvement, as well as other transit infrastructure!

So, the rich willingly subsidize infrastructure for everyone? Seems like a win-win!

Straw··on Understanding traffic
This doesn't mention the most economically sound and complete solution to traffic: dynamic congestion pricing on roads.

Due to the effects described in the article, entering a road that's close to congested imposes negative externalities due to the delay on everyone behind you, even higher if you are pushing the road below optimal throughput. Push that externality into the price, and suddenly drivers will change their behavior in the desired fashion:

1. People will move their travel to less expensive times. Even if no other change occurs than people waiting for prices to fall, the roads operate at much higher throughput due to never getting into the region of diminishing throughput.

2. People will carpool/vanpool/mass transit- no need for any special treatment for transit, a bus with 50+ people can simply outbid most cars on the road for space, even accounting for the difference in road space taken by the bus. With the economic incentive in place, you'd even expect private buses/etc to pop up spontaneously. Right now, its rarely worth it to pool/bus- it adds extra time for you, but the benefit to the road you never see. With proper pricing, its still faster to take a car, but a lot more expensive- and the carpool/bus/etc is still probably faster than driving would be with congested roads.

3. Similarly, the high prices will incentivize alternatives such as biking, subways, etc, and give very good information on exactly what routes are in high demand when, estimates of how much an improvement would be worth, etc.

Straw··on The wall confronting large language models
This is utter nonsense.

There's a formal equivalence between Markov chains and literally any system. The entire world can be viewed as a Markov chain. This doesn't tell you anything of interest, just that if you expand state without bound you eventually get the Markov property.

Why can't an LLM do backtracking? Not only within its multiple layers but across token models as reasoning models already do.

You are a probabilistic generative model (If you object, all of quantum mechanics is). I guess that means you can't do any reasoning!

Straw··on The Theoretical Limitations of Embedding-Based Retrieval
Viewing our space as two complex points instead of four real:

Let H(z) = (z- exp(i theta)) (z - exp(i phi))

H(z) is zero only for our two points. We'll now take the norm^2, to get something that's minimized on only our two chosen points.

|H(exp(i x))|^2 = H(z) x conj(H(z)) = sum from -2 to 2 of c_j x exp(i j x)

For some c_j (just multiply it out). Note that this is just a Fourier series with highest harmonic 2 (or k in general), so in fact our c_j tell us the four coefficients to use.

For a simpler, but numerically nastier construction, instead use (t, t^2, t^3, ...), the real moment curve. Then given k points, take the degree k poly with those zeros. Square it, negate, and we get a degree 2k polynomial that's maximized only on our selected k points. The coefficients of this poly are the coefficients of our query vector, as once expanded onto the moment curve we can evaluate polynomials by dot product with the coefficients.

The complex version is exactly the same idea but with z^k and z ranging on the unit circle instead.

Page 1 of 6Next →