1,146 karma · joined August 11, 2011
The "free speech" of tech platforms also comes with colonial power structures in which the tech company makes these decisions and imposes them on countries.
[1] https://www.newyorker.com/magazine/2025/04/14/the-brazilian-...
Over 130 years ago, Dewey [1] criticized the model of psychology which looked at human behavior in terms of stimulus -> internal processing -> response. Stimuli don't just come to us; we seek them out and modify the world around us to cause them to occur. Dewey and other pragmatists proposed reframing stimulus/response in terms of "acts" or "habits," or changes to the unified agent+environment. Popper was getting at the same entanglement of agent and environment in "Three Worlds" and Simon in "The sciences of the artificial."
I see RL as an elaboration of the stimulus/response paradigm: the agent is discrete from the environment. Does RL work well in an environment like Minecraft, where the real game is modifying the relationship between actions and future states? What about in contexts like Twitter, where you're also modifying the value function (e.g. by cultivating audiences or by participating in a thread in a way which conditions the value function of future responses)?
[1] https://plato.stanford.edu/entries/dewey/#ReflArcDeweRecoPsy...
For example, if I have a set of words and I want to consider their relative location on an axis between two anchor words (e.g. "good" and "evil"), it makes sense to me to project all the words onto the vector from "good" to "evil." Would comparing each word's "good" and "evil" cosine similarity be equivalent, or even preferable? (I know there are questions about the interpretability of this kind of geometry.)
[1] https://khymos.org/2012/01/04/mineral-waters-a-la-carte/
[1] https://unfold.studio/stories/10782/
[2] Dijkstra, E. W. (1968). Letters to the editor: go to statement considered harmful. Communications of the ACM, 11(3), 147-148.
[1] Jurgens, D., Kumar, S., Hoover, R., McFarland, D., & Jurafsky, D. (2018). Measuring the evolution of a scientific field through citation frames. Transactions of the Association for Computational Linguistics, 6, 391-406.
I am far from being an electrical engineer, and found that these guides, plus a few YouTube videos, got me to the point where this feels routine. I now have over a dozen in my house, controlling all manner of things.
I've also had fun installing temperature and humidity sensors to Wemos D1 Minis ($2-$3, basically just an ESP8266 chip on a development board) to monitor climate around the house. During the winter, houseplants really like to have higher humidity... we bought a bunch of dumb humidifiers at goodwill, installed Sonos Basic relays inside them, and set rules for them to turn on when the humidity in the room drops too low.
We developed some software to optimize for least squared error and then plot points. Not a sophisticated algorithm, but it worked well! https://github.com/cproctor/triangulation