PROBLEM:
If time travelers from the future were to visit you, it would be difficult for them to quickly prove their authenticity.
SOLUTION:
Temporal passwords. At the start of each year, you devise a new password. You commit the password to memory, but you never write it down or divulge it to anyone until Dec. 31, when you submit it to the Temporal Password Registry, which publishes it and promotes its dissemination.
RESULT:
Prior to their visit, time travelers from the future can look up your temporal password in the registry for the year in which they plan to visit you. Their ability to communicate a password that you have not yet shared with anyone provides evidence that they are actually from the future.
PROMO:
> it would be difficult for them to quickly prove their authenticity
Yes, you could tell them something that happens tomorrow or the next day. But if time is of the essence and you can't wait until tomorrow, then the Temporal Password helps you _immediately_ demonstrate your authenticity.
maybe they have jump [1] from the past after doing a change that alter your present (their future) trying to fix the future (your present).
[1] https://visual.ly/community/Infographics/entertainment/back-...
Also lotteries.
This solution doesn't actually work. Maybe the people are mind readers rather than time travelers. Maybe they beat the password out of you and then wiped your memory. Maybe they are time travelers, but it's like Groundhog's Day rather than Back to the Future and they've guessed ten billion passwords until getting it right. Maybe they have an Infinite Improbability Drive and just got really lucky.
Your test can prove that something funky is going on. It can't prove that the something funky is time travel.
They just so happened to evolve the same scheme. How do you prove to them that you're from the future?
I mean if this happened to me, my first thought would "who is this person and how did I got hacked?" which seems way more likely than being visited by someone from the future. Would prefer to wait for a confirmation such as telling me about what would happen on the next day.
Can I please come up with my password and submit it to the Temporal Password Registry immediately -- and just have it "go public" on December 31 of that year? It'd also be a nice way for me to check back in throughout the year, logged in as me (the only person who should be able to see my password for this year), just to verify what I thought was the password was correct... in the event of needing it.
I would instead tap into blockchain technology. For instance, to generate blocks for each passing seconds/minutes which randomly ties your UID to a random user. A decryption will be provided to you in 1 years period, i.e. in 2021, you will receive a hash key that will help you decrypt your blocks in 2020. You will get the exact time now if you decrypt the block. That way, by the time you get the keys, the locks will already be deprecated, unless of course you time traveled.
https://vinepair.com/articles/stephen-hawking-time-travel-pa...
Didn't we conclude time travel is unlikely?
(also you could predict variations in the rotation rate of galactic pulsars. That would be pretty convincing for scientists. But who cares about those guys ?)
Schools are functionally no different from part-time prisons. You must attend daily under penalty of law.
Many teachers are plain awful.
They rely on students being additionally taught by their parents. That forces parents to go to school with their children, which perpetuates the vicious cycle. The teacher recalibrates the class to the students who either understood everything the first time or had supplemental education and the rest languish.
Schools assign homework that is not easy to do when the student hasn’t fully grasped the concept. That burns time they could use to get better.
So... I am implementing Math common core in software. The first part is an automatic homework solver for math. Once we solved the student’s homework, we can teach them how to do it with generate problems. Crucially, there will be multiple perspectives and an ontology of topics do the student can backtrack to where they got lost in class weeks ago.
After we are good with math, we’ll do the same with English. It will probably not go too deep, but it will let students obtain the missing foundation of knowledge.
The entire curriculum is extremely easy when properly explained at correct pace.
I totally agree that getting a high quality corpus of information is the hardest part.
I like the idea of explaining “themes/metaphors”, with version-controlled iterative improvements.
I did this for a child recently. He was in the special needs program. I looked at his homework and re-tested his math understanding. It turns out he had no solid understanding of place value and had difficulty with adding two digit numbers mentally. No wonder he was struggling. We fixed that by spending a week 30 minutes per day on just that concept, he caught up to the next roadblock, which was fractions, we fixed that, and so on.
That's expensive if you hire someone to do this, but enabling self-study through ability to backtrack would not require as much teaching skill and be more of a supervisory activity for parents.
There are entire books on how to interpret math word problems, which is really all about converting verbal expressions into mathematical symbols. If you haven't already, buy one or check one out at the library. I am building a parser that implements those books as if they were algorithms.
That's the approach I am working on. No NLP, no ML, nothing fancy like that. It will take a while, but I should be able to pull this off. This is a question about hard problems and I think it qualifies. ;)
That being said, surgery is hard and can be traumatizing if taken on haphazardly. One of the harder problems, in my experience, is if an adolescent has been behind for years, it takes a long time to get to “normal”, and that can be really depressing for both the tutor and the pupil.
Another huge compounding problem is literacy skills. There are people in high school who can barely read, and it dramatically impacts their ability to catch up in every other subject. You can write a perfect explanation, but it might be totally disorienting to these students.
Education is really hard. I wish you the best of luck, it’s inspirational to read your ideas here!
While reading S&W, I had to look up many terms that were assumed knowledge.
Full disclosure: i work at maths pathway.
> Schools are functionally no different from part-time prisons.
A prison by definition cannot be part-time ; ). Plus, it's a totally unfair comparison. Schools are intended for everyone. Prisons are intended for a specific subset of people deemed to have broken a law.
Schools are for children. Prisons are for adults.
And so on.
Sure it can. Check out "weekenders" and "work release" programs, for example.
“X is like prison”.
Work is like prison. Childhood is like prison. Society is like prison.
Is everything like prison?
If we live in The Matrix yes but we don’t?
> Schools are for children. [a specific subset of people]
Bills of attainder[0] may be illegal and unconstitutional, but they're still a thing that happens as long as noone who matters cares.
You are right though, many parents can’t teach. That’s the problem I am trying to solve - parents shouldn’t have to go to school with their children.
Just wondering as I haven't heard of this at all in my home country. Homework is usually quite clear, and the basics to get through it are made clear in the classroom. We had separate times for learning maths, and doing exercises.
Have you thought maybe your assumption is based on very very old anecdotal data?
Science homework should be able to be done in little more than it takes to copy it from an A student. It should not take hours, which it often does. I am looking through the lens of disadvantaged students.
The parents I know from my home country are telling me that their kids are often struggling and are overwhelmed by the homework assignments. While this is already recognised also by the board that created the curriculum the changes are slow and half-hearted.
In my opinion, however, that is not even the problem, nor is it the problem that they are trying to solve. We usually forget that teaching is not "transfer" of knowledge. Each person actually recreates the knowledge in their own head and tries to fit it in with the rest of the world they know.
I believe that the best solution to education is to be able to personalize the new content in a way that naturally extends the student's knowledge. As already stated this may mean backtracking a little to be able to put the new knowledge onto a good foundation.
Normally, teachers cannot do that for each student individually so getting a program that could do that customization would be a great win.
(no longer remember the series title, but do still remember the penny finally dropping on "x is an unknown")
My grandfather used to sit with me for an hour every morning and used to teach me maths.
He would focus on basics first. He would make sure I had the basics drilled in to me. Not just understood them, but mastered them. Then we would move on to the next topic.
It was a bit slow at first. But after a while, once the basics were done, I finished the whole year's math book in 2-3 months.
I have seen this in software engineering too. Once I am good at basics, or once they're drilled in enough, I am faster and quicker.
Drilling basics is basically like having the basics in O(1) look up with very reduced space complexity too. It reduces the amount of overhead your brain utilises. This makes your brain free to think about the actual problem you are solving. Also, I think this is what allows your brain to work in the background, even when you aren't actively thinking about the problem.
Lockdown has really shown up how my 7 year old struggles with his maths work set by school. I've gone back to basics with him and have been drilling him on simple numeracy until he can do it effortlessly using some flash cards I bought and some iPad apps (DoodleMaths, DoodleTables - can't recommend them enough).
Since then he has sailed through all of the new parts we're learning. I really expected it to be much harder than this, but it seems like not fully understanding some basic concepts and having confidence with basic numbers makes all the difference for really understanding the why of all the concepts that are build on top.
In about 6 weeks of me spending around 30 mins to an hour each weekday he has gone from refusing to look at a maths problem to being confident with it.
I taught a few classes last year on how to program in Scratch to grades 1-5. The 4th and 5th graders really loved it and they went off on their own to learn more. It was not a large sample, but I think presenting the right material in the right way to the right age makes a huge difference.
I have been thinking of ways to improve education. I think there is a huge potential in online video. If it is produced right in the sense of say "Hollywood" verse say Khan Academy, kids will enjoy it a lot more.
My theory is that most reasonable people stay off social media, so places like Twitter end up filled with unreasonable narcissists. At the same time, discussing politics on a semi-anonymous forum like Reddit is pointless, who cares if someone on the Internet is wrong. But maybe there’s a better way of communication, something new, that lets you talk with people you actually know.
Take what you will from that and good luck.
The "unreasonable" part is the the disproportionate and permanent effect of internet hatred in regards to comparatively non-permanent acts (that are still often harmful, but more often than not nowhere near to the same extent). The "narcissist" part is the need to do so for beneficial social points among those that do. Those that have the online support to keep the basic needs in life that they want to deprive others of. So yes, these people meet the definition on both counts.
It doesn't mean that those who are bombarded don't deserve to be reprimanded, just that they probably don't deserve to be bombarded with threats and harassment. You can express your opinion on Twitter without personal attacks and threats of harassment and violence. That part should not be a fringe opinion.
I can. I expect that most people can as well. I don't however agree that any opinion should be expressed without consequence. If someone says "we should kill the Jews and reinstate the 3rd Reich", or "The place of blacks is subjugated below whites". This reveals how they see others, and making sure that their employer is acting based on compete information seems perfectly reasonable.
> The "narcissist" part is the need to do so for beneficial social points among those that do
Why are you ascribing nefarious motives to actions? Why is it clear that these people are acting in bad faith?
The narcissism is real, if you're not closing your eyes to it. It's especially obvious when these people doing it have done what they're complaining about themselves. It gets back to the main idea, that you don't have to harass people to get your point across. Even the most egregious reaction, trying to take someone's employment (and most often the ability to support themselves and their dependents) can be done in a way that isn't public and permanent.
Can you give an example of incorrect permanent punishment? Sacco found a job almost immediately. The truck driver may have a more difficult time, but not because this event will follow him, but because the labor market at the moment is shitty. (And to be clear here I'm not saying what happened to him was right or just).
> The problem is that it isn't so cut and dry.
Sure but now we're in a very fuzzy area. We're no longer saying that public shaming is always wrong, but that there are situations where, in your judgement, the scope is misapplied. Those are two very different situations, especially if you're willing to acknowledge that your perception of the severity of some action may indeed be different than the actual effect of that action.
> The narcissism is real, if you're not closing your eyes to it.
I still don't buy this. People not being self aware is narcissism, but not in the way that you seem to be meaning, which is more like that the activism is performative and not genuine.
Not to say that there aren't people who are performative. Lots of social media activism is, but in many ways so is stuff like signing petitions, and that doesn't get a bad rap.
However even if we assume the worst outcome in that situation, the negative impacts of cancel culture are tame compared to a lot of other systems. If we're calling for an end to cancel culture due to the one case of permanent damage, why aren't we calling for an end of the US justice system which, on a daily basis, causes far more permanent and far more cases of damage?
And this is sort of whataboutism, but lots of the recent concern about cancel culture, at least that I've seen, is from mostly upper class, mostly non-black and latino, mostly well educated people. Their concern has been that they'll be cancelled if they don't support recent protests enough or in the right way.
So we have two systems of justice, one that unjustly kills innocent people on the daily, and one that might end up closing down a single restaurant whose owner was innocent. Why are we focusing our energy on dismantling the second system over the first?
Cancel culture is mob justice. There’s no mechanism to change it, and it’s totally irrational. In the example, blaming one person for the actions of a family member goes totally against the philosophies I believe in.
Finally, I don’t think we can trivialize the impact of tossing the idea of free speech out the window. Human history is full of particularly nasty examples of what can happen if everybody feels forced to obey a mob.
There are also mechanisms to address culture you disagree with (and you're exercising them!). The question was not why do you find cancel culture distasteful, nor was it even why do you personally find cancel culture potentially worse than unjust policing (which for now let's just agree to disagree on), but why it is that you are prioritizing the push back against cancellation over the pushback against unjust policing.
At this current moment, it is, I think, clear which unjust system causes more harm. It is the criminal justice institution. That cancel culture could grow worse is feasible, but it has not yet. People aren't routinely killed at the hands of twitter complaints.
> Finally, I don’t think we can trivialize the impact of tossing the idea of free speech out the window.
Here we disagree on premise: cancel culture is the result of people who previously did not feel empowered to speak freely taking advantage of a system that raises their voices more prominently. That it is extrajudicial is a failure of the institutional justice system, which continues to systemically fail underserved communities (women, minorities, poor people). Sharing controversial opinions has never been without risk, that's why they're "controversial". There have been privileged sects of society for whom the risk of holding controversial, and even outright despicable, opinions was low. I don't think more equality in that regard is a negative thing.
> In the example, blaming one person for the actions of a family member goes totally against the philosophies I believe in.
Do you believe the situation would be different if the employer had been unrelated to the girl who posted bad things? While the exact numbers might be different, I don't see the overall picture being that impacted by him being her father. And "punishing" an employer for the actions of an employee, while still perhaps fraught in some cases, is much less worrisome to me than targeting family.
I've never used it and had an account created from about a decade ago. The only people I had followed when I first created the account were a few random celebrities and public figures. I pretty much never logged in despite many emails from Twitter to remind me of my account. A few months ago I opened it up to look, and I was really shocked and appalled at what I saw. My reaction to it was quite visceral. The best way I can describe the content I saw is just "hate", not the general term hate-speech that people throw around, but rather just people tweeting hateful things and exhibiting what appeared to me to be their hatred over something or someone.
Sure in between all of that there were a few wholesome tweets of course. But for the most part, it was just hate. I didn't really stick around too much other than to maybe add some additional public personas I do follow (I guess in support of them). The whole experience left me with the impression that Twitter and perhaps social-media entirely, are really bad/toxic/divisive to our society, at least in their current form.
I don’t mean perspectives I disagree with are narcissistic, I was honestly making an observation based on my limited understand of psychology. Some personality types like to hear themselves talk more than others, and I honk it’s clear that they are more attracted to Twitter.
Look at the supportive and critical comments you received; it looks split down the line based on political leaning. It may be worth considering that if you want to avoid creating just another echo chamber.
The problem I’m interested in has nothing to do with winning arguments, more that so many people are quiet, not saying anything, because they aren’t interested in current discussion options, and the huge negative downsides.
I will reflect on all the feedback, especially the criticism. I don’t agree that I can divide it by political leaning though, and I certainly hope it’s not true. Definitely agree that the last thing the world needs is another echo chamber.
One of the downsides of anonymity that many people raise (fallaciously) as an argument against it is that too many of the anonymous people are just trolls, therefore it is a negative quality. Having it be people that are known to the person brings about an assumption of character that can solve this issue, so long as the user associates with people that they tolerate (which is a mostly fair assumption, considering how private groups and similar functions operate on the established platforms).
One problem that I could see is that someone could be found out simply by virtue of being the only person that would say something like them. I guess this could be alleviated by filtering in public posts from others, but this could cause other problems while not solving what it's supposed to.
The other issue for this is the Gab problem, which cannot be easily solved: that if you're using this service, you're a bad person who needs to be blocked/fired/etc. Unfortunately the mobs you're working against work to destroy with little rhyme and no reason, and they work for free (often literally unemployed). This problem is hard to get around, but I think could be mitigated with marketing it as a platform first and a solution second.
Nonetheless, I wish you the best. This is a very interesting concept and could really do a lot of good in the world.
The Gab problem is core. Reddit bans a bunch of assholes so they go off and find alternative platforms. Free speech is great as a principle, but in practice nobody else wants to hang out with these people.
My idea is that a new model of interaction could get around the problem. I’d want this to be a link people would feel comfortable sharing to their LinkedIn network. Using the site doesn’t mean you were banned from other platforms, just that you think this way of communication is better.
If you want to only surround yourself with people that are exactly like you that's up to you. If you want to be an intelligent thinker and surround yourself with believable truthful people who expand your worldview that's also possible.
It puts the power back in your hands instead of the site operator or group consensus.
But the system TimJRobinson describes is flexible: you don't have to simply filter out the less trustworthy posts. You could simply flag them somehow as low-trust.
Right now the major social sites are designed to amplify the voices of users that produce content that drives engagement, even though the most engaging content tends to be offensive or inaccurate. That's why the people I least trust on Facebook always show up on the top of my feed: I sometimes engage with them by telling them I think their posts are inaccurate.
So I can see your system being used not just as a filter for what the users sees in their feed, but as a feedback mechanism for people's posts.
I think a more responsible social site would optimize for positive outcomes, and not just engagement: employing algorithms and techniques to optimize for accuracy, quality, and civility. I think decentralized moderation could be one of those techniques.
The problem we seem to be seeing just now is lots of echo chambers have formed without input from "the other side of teh argument" on Facebook, Twitter, whatever social media you choose.
What you are suggesting is rather than group level echo chambers which will validate maybe 80% of your views and go against maybe 20%, you are now going to have a fully customized echo chamber that echos your views 100%. I think that will make things worse.
Personally I try to get views from both sides, but I think I am in a minority for doing this.
I have a different take on this: trolling becomes an optimal farming method when reward mechanisms isn’t working. When being a squeaky wheel is the best way to get the oil, people tries to be the worst shaped wheels. Fittest survive.
P.S. to parent:
> who cares if someone on the Internet is wrong.
( ಠ_ಠ)...
What we are learning is that making it trivially easy to amplify anyone’s message enables cancel culture and (I believe) leads to radicalization.
If this is correct, then increasing amplification friction on your platform will lead to less radicalization, at the cost of lowering engagement. My guess is that for this to be successful requires a careful balance of where you land on the higher/lower friction spectrum. Too much friction leads to low engagement which leads to failure. Too little friction leads to uncontrolled amplification which leads to radicalization. So a balance is needed.
Either that, or a totally new idea is needed that turns existing platforms on their head.
I agree with you about the danger of low friction amplification of messages. My hope is that if users can amplify messages but they get no social credit for it, it will dampen down this behavior.
Put amplification behind a trivial inconvenience that would make knee-jerk retweets less frequent and allow the whole chain reaction to cool down.
This leads to other problems like blocking someone, but still seeing their content because it gets reposted a lot.
[1]: https://www.vox.com/platform/amp/podcasts/2019/11/21/2097616...
The conversation starts at 13:00 and also realized he wrote an essay about it here: https://onezero.medium.com/amp/p/7dc3e68a7cb1
The podcast is amazing and worth listening to regardless.
> something new, that lets you talk with people you actually know.
Anonymous Facebook? The problem with that is this:
> so places like Twitter end up filled with unreasonable narcissists
That's also a problem among the people you know and have added on Facebook, many of them are unreasonable narcissists and they don't mind showing that with their name and picture on the web. I feel like giving them anonymity can only make things worse. Just think of your racist uncle, your Nazi grandparent, your homophobic friend, but now you won't know which of them is posting the bullshit.
You have chosen a very difficult problem to solve, I can only tell you why I think your current idea won't work and wish you luck.
Re:anonymous fb, I’m not going for exactly that but let’s imagine I was and consider the problem for a second of the homophobic/racist/etc Uncle. The simplest solution for not getting that content is to remove them from your list of contacts. But I also have a theory that this is where there could be a global improvement in communication. I believe some people are trolls not because they’re anonymous but because they’re not. Their identity is basically a troll - think the guy who wore a MAGA hat to a recent BLM protest. If that person was allowed to, maybe they would want to change their opinion.
People already have the chance of doing that on Facebook (not anonymous) or Twitter (relatively anonymous), there's a reason they don't do it. It's probably something to do with human nature or psychology, this is likely an area that requires more study (or for which I don't have enough knowledge about).
> I believe some people are trolls not because they’re anonymous but because they’re not. Their identity is basically a troll
I agree with this, but considering your example:
> think the guy who wore a MAGA hat to a recent BLM protest.
I wouldn't call those people "trolls," they are closer to the definition of a antagonist. They are against something beyond reason and logic because it's part of their identity. That's why they love their symbols (the swastika, the Confederate flag), symbols don't require logic or thinking, they only require faith. This brings us to the next issue:
> If that person was allowed to, maybe they would want to change their opinion.
They are unable to listen to opinions or try to change theirs. There's a quote that applies to them:
> You cannot reason people out of something they were not reasoned into.
Online discussions generally don't work because they are not about two people sharing opinions, they are usually about people trying to impose their opposing faiths.
So there's another weird problem (probably not so hard though): translating conversation within the same language in a way that doesn't lose meaning but obscures identifying patterns.
For the interested some paper keywords would be adversarial stylometry and authorship attribution.
I have a fully working Webapp, mobile app, dB and REST API from a project I worked on when lockdown started that I lost interest in scaling but I’ll make the repos public and edit this comment later with the links if they can help you out with this.
If you have a conversation in meatspace, sufficiently nearby third parties send signals, because they cannot help but hear you (setting aside headphones or the like). Without entering the conversation, they can communicate by means like a change in stance, a muffled laugh, a roll of the eyes. If those signals are noticed, they provide feedback on the words exchanged and moderate the conversation when it grows heated or extreme. Social media doesn't well allow for these signals: the input interface doesn't allow for them without conscious effort to translate.
In the absence of those signals, any outrageous speaker on the internet can mistake the silence of our lossy input interface for silent approval. If they were wrong, someone would say something, surely? But no, there's just too much effort required to tell every damned fool they're an idiot. Even when one person speaks up, there's no apparent audience to serve as jury, and the fool can go on believing themself in the right.
In short: I think "audience feedback" is a necessity.
In effect: I think the concept of a "timeline", as a presentation of user-generated content, is socially broken. Every posting must be weighed, none should be allowed silence.
Timelines are great tools for skimming content, but while we can aggregate content easily enough ("scan the room"), we have no tech solution for returning the social feedback that meatspace society relies on ("the room fell silent"). You could force that feedback by turning the timeline into merely a historical lookup, and delivering new posts to the user individually and not letting them return to the rest of the app without interacting with it in some way. Also, block unregistered users entirely, unless they can be locked into the same use pattern by some means that escapes me at the moment.
(If we split off into sci-fi dystopia land, measure the user's emotional state as they scan each post and accumulate those scores back to the author. This is terrible, please no one ever implement it.)
I have some ideas for this domain which you may find useful or at least worth discussing.
> Nobody else is going to want to post in or even look at such an environment, so it rapidly turns into a completely worthless bigoted echo chamber where everyone’s patting themselves on the back for having such enlightened alternative opinions.
Pure speculation on your part. How does it end up any more of an echo chamber than somewhere where certain opinions are removed?
Bigots of all stripes like to use the goodwill of others and their belief in freedom to say horrible, bigoted things and demand everyone listen to them. But we don’t have actually have to. That’s not what freedom of speech means.
Also I would change moderetion to slashdot style https://en.wikipedia.org/wiki/Slashdot#Peer_moderation so moderation would be basically comminity based.
The forum needs to strongly encourage every comment to have their opinions substantiated, and show rigorous reasoning and inference explicitly where it occurs (and where an opinion is not directly based on evidence but is a reasonable conclusion from evidence). It's not an impossible task, since we have a similar example of a forum with high standards in Stack Overflow and its network.
This means that the platform is primarily one for discussion and developing opinions grounded in evidence and reality, not one for free expression (which reddit primarily is).
The problem is that online people tend to polarize into factions during complex discussions. The more heated the discussion, the more polarized they become. Eventually it becomes impossible for either side to be self critical, or to cede a point to the other side no matter how true it may be.
"B" says "the sea is made of saltwater". A moderately reasonable "A" agrees. Mistake! The "A" group accuse them of being pro-B or anti-A. Suddenly, the idea that the sea is saltwater becomes an "B dogwhistle". A cunning trick! At this point, the "A" group adds 'saltwater sea' to their list of unacceptable opinions, and the policing of everyday language and opinion is in place. That's when the notion of defending free speech gets questioned. How can you police language if people defend free speech?! It won't do! So now free speech is a dogwhistle too. Add it to the list! There is no possibility for constructive dialogue, no matter how sensible, kind and cool-headed it tries to be. Disagreement with dogma or talking to the opposition are offences. New rules: "Don't follow an A on Twitter". Guilt by association. Next up: let's use the abuse/reporting system to ban individuals. Eventually, online systems that were supposedly designed for communication and conversation have become tools for suppression and virtue monitoring.
While anonymity itself will help people to own up to an opinion that they might be otherwise afraid to voice, unless there are no usernames at all it will be possible to track an individual across the system and figure out "which side they're on". Then you'll be able to figure out if their comments are acceptable or hatespeech without having to properly consider them.
Don't get me wrong, I'd love to see this happen, but I think it requires a lot of work. Deduplication of points made, automatic detection of logical fallacies via natural language processing, personal dictionaries with auto-translation of terms (eg: an acceptable word to you might be a slur to someone else - if the word has a genuine meaning, auto-translate to a non-slur). That would avoid having people point and scream and claim moral victory because of a word infraction, instead of hashing thing out properly.
> I don't get involved because these platforms simply encourage the worst in us.
In-person, I've found I can meet and talk with folks who believe and say most anything. In fact, I enjoy it. As long as we're trying to get along, we can have powerful and dynamic conversations. I can learn things and we can challenge one another.
Online, there's none of this "trying to get along". Some person types something wrong. Other people pile on. Pointless argument ensues.
People agree on most things! That's the crazy thing about it. But if we only interact online through text, we're raising an entire generation that doesn't grok that fact.
There's also the fact that you've known grandma your whole life, and you think that she's 90% adorable, 10% a product of her generation. So you're willing to change the subject, or maybe just roll your eyes, when it comes Napoleon.
I blame old social habits for work forcing us to continue to huddle into “flocks”, aka companies, to collectively funnel our output upward for validation.
Our biology as a literal thing has to then constantly contend with validation seeking. We minimize allowable results to narrow what is valid output. It’s economical they say, back in the day they would say this narrow lane of validity is most pious band likely to get you the reward of Heaven.
“They” of course are elected officials who we can watch flaunt they social rules they tell us to teach each other.
Given the literal mess we’re making it certainly does not appear to have “economy” in mind.
I love writing. I used to freelance and string. I wrote a lot of speculative sci-fi that didn't go anywhere. I was an early blogger. I was an early HN'er as well. So I'm creating content constantly no matter what the current tech.
I've been watching what works. Random thoughts: every conversation should have a moderator who is responsible for the subject and tone of the conversation. The start of every conversation should include what the goal is: analysis, venting, compassion, meme, etc. Conversation participants should be rated over time based on their ability to adjust their tone based on what the moderator requests. Each person votes up and down various moderators depending on the type of material they present and how well they manage their conversations. Over time the ranking system should match up moderators and participants, but not subject areas (important). There should be some escalating trust level based on this, the ability for people to make mistakes, be forgiven, delete/apologize for bad-day remarks, etc. I think with the right system this would happen organically, though. Not sure.
Note that a popular/well-used system will by necessity not be a hugely-successful commercial one. You might make it work for a bit, but these are separate and conflicting goals.
Personally, I'm dialing back FB and moving all of my content over to locals. I want to own whatever I write and I want the option of putting things I create behind a paywall easily. I also don't want to ever worry about having a bad day and getting my life destroyed by the mob.
However, it would be a good idea to not only approach this from an optimistic angle but keep a pessimistic one in mind by asking:
"How would a malevolent actor abuse my design to manipulate public and/or indiviual oppinion?"
Isn't Facebook's newsfeed populated with people you know? If so, why will this be any better?
I'm not saying its an exciting way to go about it, but it would likely work.
* Radicalism - from the Latin "radix" - means focusing on (what you consider to be) the root of an issue, striving for fundamental change of the way things are.
Also - I couldn't agree more about "who cares if someone on the Internet is wrong" - but I think the conclusion is that you care when it's in physical real life. On the other hand, talking to people you don't know is how you get to know new people, so that part might need some more nuance.
Anonymity is important but tricky. Many researchers believe that anonymity can be key to countering groupthink, where people say what they think is socially acceptable, and not what they actually believe, for fear of denunciation and retaliation (some great books on this subject: Elizabeth Noelle-Neumann "the Spiral of Silence" and Timur Kuran "Preference Falsification.") Anonymous polling, for example, is probably critical to the functioning of a democracy.
In social media I think anonymity is more tricky. One idea I have is that posts always have an author, but likes and other indicators of support and popularity are anonymous.
Serious thought involves more than just collections and associations: mastery requires repetition, creativity requires serendipitous discovery, and productive output requires flow states. It’s also a matter of acknowledging the fact that “units of knowledge” do not exist on their own: all knowledge is embedded in context (or “deeply intertwingled”, in the words of Ted Nelson), and without context, metaphor, and nuance, we cannot form meaningful connections. By baking these attributes into the medium itself, it’s possible to build an information space that’s simple to explore, can surface information when you need it, can augment the mind’s naturally ability to form connections, and can get out of the way the rest of the time.
What I envision is more of a knowledge space navigator that lives from connections and links (Wikipedia!) but allows a personal state of information and annotation/augmentation on top of it.
I want something that digitally represents my state of thought while augmenting it with a clean version of the world's knowledge and related information, if that makes sense.
Imagine writing a crypto algorithm - a browser with 30 tabs open and a note app plus my IDE feel like a clumsy and ineffective way to truly put my mind and thoughts into the context of work. It simply feels like doing digitally what people did in the 1960s with pen and paper, encyclopedias and books on their desk.
However, the internet and our hardware today feel like they allow to add at least one another dimension. For many, it's a hunch and a revolutionary product waiting to happen.
Is there a mailing list or some other place to track progress?
The idea is that the app "understands" the structure of the content. A bit like a combination of a notebook, Xcode, a calendar, and Wolfram Alpha :)
Bi-directional links and timestamps are working already so implementing a "Zettelkasten" should be possible with the current version.
If you're interested, there's a signup for the beta here:
I’m less excited about the connection to Zettelkasten because that smells of fad.
If there were an app that would make useful sense out of a few tens of gigabytes of stuff kept in a plain folder hierarchy, I’d be a potential customer. In a way Dropbox tries to do this, and it’s better than nothing (for me) but I still wish for some kind of magical portal into my messy attic.
I'm curious about your folder hierarchy. What kind of files do you keep there to get to tens of gigabytes and what type of knowledge would you like to extract/what type of connections to form?
I'm currently at about 100 MB for roughly 1,400 individual notes (text and images).
So for my use-case the Organizer App would have to be able to deal with lots and lots of data of various types, occasionally including multi-gig files like the rough cut of a film, and also know when I "mv this ~/Organizer/that/" -- a tall order, I know. But with storage so cheap these days, I still dream of that.
The app I'm working is more focused on capturing knowledge as structured notes. It sounds like a good full text search could already be of help in your case. That maybe combined with slowly categorizing your content with a system like Johhny.Decimal or something similar.
But in all seriousness, best of luck to you. I hope you create a truly revolutionary product.
My contact info is on my profile
Sorry for the negativity, but this post is the perfect example of the wishy-washy rhetoric that people interested in this domain always use.
For examples of what I'm talking about, browse this tedious litany [1] (roam-whitepaper), see if you manage to get pass the first paragraph [2]. BTW, the price for the "Believer" plan of roam [1] is $500 dollars. Roam itself is advertised with the hashtag "#roamcult". Pretty strong BS signals coming from this one.
To address the poetic waxing more directly, it's important to remember that we still don't have very good language to talk about the "primitives of knowledge work", which is why I phrased my statement the way I did. We know it almost certainly doesn't involve the concept of "notes" (at least in the way we think about right now) and calling them simply "ideas" is altogether too vague.
As far as the #roamcult is concerned, we are overwhelmingly in agreement :)
Many write-only "scratchpad" notes are useful because they helped the mind focus and organize information. They can often be safely archived or discarded.
I'm curious how is your solution different from the Zettelkasten-inspired note taking tools?
I kid you not. I left after 6 weeks. I snuck out the work with me (I wasn't "allowed" to bring it home.) If you're interested I'd be more than happy to share the code.
I think it was really revolutionary.
Essentially it used grammatical structures to arrange text in a navigable 2d space which he needed because he was a highly visual and spatial learner.
But what it allowed for is a nonlinear and a nonsequential arrangement of ideas using Wikipedia text, not just some simple mindmap stuff.
I used Wikipedia as an example in a prototype engine I made.
Articles Flowed Into each other through a continuous navigable space. You could interact and engage to go cognitively deeper and expand a new path, as opposed to a series of documents. Wikipedia became one continuous thing that you could endlessly navigate through a 2d space of.
The content wasn't large blocks of text but broken up using a separate visual language so that there'd only be a few words then a relation to another group and so on. This kept the concepts spatially relative and made the distinction of pages disappear.
It did it all automatically. Really amazing stuff. I also worked with Ted Nelson, this guy's methods were better. No question.
He developed the techniques over about 20 years manually and had transferred textbooks to rolls of butcher paper that he kept in cabinets. He totally didn't understand the value of his process as something as transformative as Vannevar Bush's As We May Think.
Instead he wanted to make it a proprietary format with proprietary content under a private publishing company for childhood education. He wanted a kludgy editor to make new content with and then a kludgy viewer for single topic things. He wanted to dictate the interface, keystrokes...
Because once again he's an authoritarian pedant. Bah, he didn't see what he made.
Ideas need to be controlled at the right level of abstraction and liberated at the others. That's what Linus knows that RMS doesn't. That's what TBL knows that Nelson doesn't. That's what Jobs knew but Apple doesn't.
I wanted to run with the idea but yeah, 7 years ago and I've done nothing. I got everything still.
I should stop everything and finish it. It's really something radically different. I think it will change at least the way I personally learn things.
The campaign to convince others, yeah well, no guarantees there.
You've described the problem really eloquently. You've obviously put a lot of thought into this. I don't see contact info for you. My email is in my profile. I'd love to chat if you're interested.
What I wish for is a useful melding of easy stuff like Notes.app, structured stuff like a custom database, and my reams of notes taken on physical paper. Oh and scrapbooks, web clippings, etc.
At the end of every brainstorm I throw up my hands, say this is too complicated to ever be worth doing, and resolve to change the way I gather and generate information.
Replacing HTML/JS/CSS with a language called ALFI. It is stupidly simple in its design but still very powerful. Similarly to HTML you use it to create widgets, place them, and define their behavior. It is humanly readable like HTML but line-based instead of markup-based. Instead of nesting it uses references. This allows it to be streamed.
A big difference is that the language itself doesn't allow styling (like CSS), the downside being you get less flexibility but the upside being it will render correctly on any display with any resolution.
For this I have also written a new type of web browser called NAVI which takes ALFI code and produces (somewhat) beautiful widgets and renders them using OpenGL.
Source for both ALFI and NAVI: https://github.com/jezze/alfi
My own ALFI website: http://www.blunder.se/
You need NAVI to actually browse blunder.se properly. otherwise you will just see ALFI code. Also this is still very early so all features are not done yet.
http://www.blunder.se/screenshots/s1.png http://www.blunder.se/screenshots/s2.png http://www.blunder.se/screenshots/s3.png
But these look great! You should definitely show them off. Adding them to the repo for others to see might generate the tinest bit more excitement for people stumbling on the project. :)
So, no
What js does is that it allows you to dynamically update the contents of your website like changing an image when you hover over it for example. This is something you can actually do with ALFI by itself without having to depend on a second language like js. I'm glad you asked this question.
HTML without styling will render correctly on any display with any resolution. The facts of the history of the web tell us that people want custom styling, though, and businesses want it even more, because marketing says so. Your widgets need styling for each device they're rendered on, in which case you're back to the exact original problem as HTML and CSS. All you've done is move the problem to someplace else.
Frankly, I don't see why this isn't a markdown extension, since that seems much better suited to solving your base problem and is WAY more readable than the mess you have currently (which only seems readable to someone versed in high-level programming, either functional or OO)
Wait, what? Are we on different webs? The facts of the history of the web tell us that some of the most popular services for publishing are Facebook, Twitter, LinkedIn, Medium, etc - places that allow for very limited custom styling.
I think you misunderstand what OP is trying to do, and are criticizing them for not instead making a thing you already know.
Since a “creator” is also a user of the web, I guess you mean “user” as in someone who only consumes content? I’m confused by that since nothing in the discussion seems to be about user stylesheets.
The project creator explicitly said that their creation cannot be styled, at all. It renders the exact same "standard" way on all devices. The retort was that the vast majority of people (with a clear callout to companies that would obviously like their own branding) do not want a web where every site looks the exact same, which is why CSS exists in the first place. You seem to have read/decided to turn this into a discussion about end-user customisation of sites (and, frankly, a thinly veiled rant about Facebook and Medium), when that first of all has nothing directly to do with what was being discussed and second of all would also be out of scope for this project because it had styling itself out of scope.
The original proposal seems to be this: You publish a document. The platform takes care of presenting it.
One criticism was: No, people want to control the styling of what they publish.
My counter argument is: There are many successful platforms that don’t allow people to style the content they publish, and people seem to be fine with that.
Again, assuming you’re talking about readers when you say “end-user”, I never even mentioned them.
And with a language that explicitly does not allow styling, how exactly is "the platform" that takes care of presenting it going to render anything but a single, default style for all content without...reinventing styling?
> One criticism was: No, people want to control the styling of what they publish.
No, one criticism was rather obviously that people don't want to go on the web and see the exact same thing everywhere they navigate to, which is what you get when styling is not possible. However, you seem to be looking at the entire conversation through some strange lens.
> Again, assuming you’re talking about readers when you say “end-user”, I never even mentioned them.
The creators of a web service/platform wanting to be able to brand their creation and the users of that service simply going with their chosen brand's aesthetics when publishing content are two concepts that can simultaneously exist - in fact, can even be linked.
I am not sure how it has to be explained that people being okay with publishing content on Facebook, LinkedIn or Medium without much custom styling is the furthest thing from an indicator that people want Facebook, LinkedIn, Medium and every other website to look exactly the same.
I think I understand that you are imagining a middleman to be “the platform” even in the context of NAVI/ALFI. I understood NAVI itself to be this platform; much like the Facebook app allows you to publish and browse Facebook content with very little variation in the styling of different content, so NAVI might allow you to browse and perhaps create ALFI content with little variation in styling. You are comparing all the content within Facebook and others to the content on the rest of the web, while I’m talking about how content within a platform doesn’t need to be visually distinct for the platform to be appealing to publishers and readers. You’re thinking of the web as the “platform”, Facebook etc as the “creators” on the platform, and you are grouping people who publish and read on Facebook as “end-users”. I’m thinking of Facebook as the platform, people who publish things on Facebook as creators, and people who read the things published as the end-users.
Sorry in advance if I’ve misrepresented what you’re saying, but this is the best I can do in explaining why we’re unable to understand one another.
Yes, you are.
It’s completely besides the point that these platforms have custom styling with regards to the web in general. The point is that people are publishing enormous amounts of content on these platforms despite not having the ability to control what that content styled like. Ergo, lack of styling is not a deal breaker for people to publish stuff on a platform.
The lack of styling I do understand can make it feel as if your site lacks personality when all sites look kinda the same so I see your point here. I might later allow some minor themeing, like say allowing you to select a color scheme, with the understanding that this might be ignored by the user. I will have to think about this more. What you will never get to decide are things lika margins and paddings and things like that.
I don't think you can compare Markdown with ALFI like that exactly. Markdown will generate HTML in the end and it is the resulting HTML that you need to compare with because that is what the browsers understands. Also, Markdown only solves the trivial cases and that is why it can be kept simple and readable but how do you for instance create a three column layout in Markdown with an image in the middle column? I don't know, maybe there are extensions for that these days too.
It would be interesting to have a Markdown to ALFI generator, but I suspect that when you are used to reading ALFI code you might find it to be a bit overkill because even though I am a bit biased of course I do think ALFI is pretty readable.
Also, there is no intentional OOP or funcional aspects, I did not quite understand what you wanted to convey there.
I guess that alternative or even non-graphical interfaces (like CLI or voice) are possible?
If someone else is interested in a less radical version of this topic, maybe you can share some insights here https://news.ycombinator.com/item?id=23737903
The first scientific experiment was conducted by 5th century BC Pythagoreans. They wanted to show that the basis for musical consonance was math. From that, they inferred that harmony in math accounted for the harmony of the cosmos. This integration of math+physics was very forward thinking.
But, if we fast forward to the present, we still don't have a complete scientific explanation for the basis of consonance and dissonance. Really! To make my own contribution, I've been running psychophysical experiments to investigate why consonant chords that are mathematically slightly dissonant actually sound much better than chords with perfect mathematical consonance. I've been gathering data with sounds but also with haptic vibrations and with visual flicker frequencies. This multisensory approach is fun because it produces visible rhythmic entrainment in the brain, as seen with EEG. My goal is to contribute to a general theory of neural resonance and harmony in human experience.
Why does this matter? Happiness is great, but I'd argue that what we really want is personal and global harmony. Note that harmony isn't sameness, it is unity in variety -- the resolution of conflict and dissonance into an integrated wholeness. We want inner harmony with our selves, harmony in our relationships with others, harmony in society, harmony with technology and harmony with nature. Happiness is individualistic but harmony involves the pleasure of virtue. I hypothesize that harmony can help set a better objective function for the future of humanity.
Harmony was also the objective function for the first deep learning neural network, Paul Smolensky's Harmonium.
Finally, harmony is also a central theme in classical philosophy. The concept had a massive influence in the Italian Renaissance and in the English Scientific Revolution.
I recently put together a reader for understanding Plato's views on Harmony. Comments are welcome:
https://docs.google.com/document/d/1lqXpXgWI5YMBCz1O0gCmrEwz...
Here is the 1986 work in Parallel Distributed Processing, along with G. Hinton and Rummelhart. Don Norman wrote a chapter, too!
With regards to musical harmony, is it possible that it's more or less random? I know multiple cultures have different definitions of musical harmony. I suspect the evolution of hearing also contains random elements. Similar to language, it's not so much about an inherent universality, just a universality we can all learn and agree on.
Thoughts?
Ok I'll bite. What does it reveal? There's nothing inherently meaningful here. We know that 'dissonant' sounds (those that create interference patterns) create wavelets that are smaller and with less contrast than the more 'coherent' patterns from ratios that are closer to whole numbers.
But in what way is this meaningful or useful?
When dealing with cosmology one often seeks to make a big deal out of a simple concept like a duality, a cycle, or a ratio. These are concepts recurring through the world, and looking for them in more places sometimes reveals knowledge.
http://mcdermottlab.mit.edu/papers/McDermott_etal_2016_conso...
http://mcdermottlab.mit.edu/papers/Jacoby_etal_2019_Bolivia_...
Preferences vary individually as well: modern music may feature or favor dissonance (e.g., some forms of metal, electronic)
It's not so different between cultures, in fact.
> From a musician's perspective, Plato's Republic embodies a treatise on equal temperament. Temperament is a fundamental musical problem arising from the incommensurability of musical thirds, fifths, and octaves. The marriage allegory dramatizes the discrepancy between musical fifths and thirds as a genetic problem between children fathered by 3 and those fathered by 5. The tyrant's allegory dramatizes the discrepancy between fifths and octaves as that between powers of 3 and powers of 2. The myth of Er closes the Republic with the description of how the celestial harmony sung by the Sirens is actually tempered by the Fates, Lachesis, Clotho and Atropos, who must interfere with planetary orbits defined by integers in order to keep them perfectly coordinated. In Plato's ideal city, which the planets model, justice does not mean giving each man (men being symbolized by integers) “exactly what he is owed,” but rather moderating such demands in the interests of “what is best for the city” (412e). By the 16th century A.D., the new triadic style and the concomitant development of fretted and keyboard instruments transformed Plato's theoretical problems into pressing practical ones for musicians and instrument makers. With the adoption of equal temperament about the time of Bach we made into fact what for Plato had been merely theory. Musically the Republic was exactly two thousand years ahead of time.
It would be easier to dismiss McClain's thesis as Bible Code crackpottery if he didn't have such interesting things to say about the seemingly arbitrary numbers[2] appearing in Plato's writing.
For example, on 5040
> “Our songs have turned into laws!” Plato exclaims in one of his relentless puns in the dialogue Laws, this time on nomoi meaning both laws and traditional melodies for the recitation of the epics (799d). [...] The absolute population limit of 5,040 “landholders” will be analyzed as the tonal “index” of a tuning system “fathered” by four primes, 2, 3, 5, and 7; the number 5040 = 2^4 x 3^2 × 5 × 7 defines a tuning system like that of Plato's friend Archytas, who is the earliest theorist credited with using 7 as a tone generator. Since 5,040 is also factorial seven (7! = 1 × 2 × 3 × 4 × 5 × 6 × 7)—i.e., just 7 times larger than factorial six (6! = 720) which defines the calendar octave, or Poseidon and his ten sons (cf. fig. 6) — we have a clue as to the identity of Plato's 37 guardians, 18 from the “parent city” and 19 “new arrivals,” for new arrivals among Plato's products are those generated by 7. [...]
Or, again, when McClain points out the relation between the number 729 - in Plato: the "distance" between the happiness of a king and that of a tyrant - and the simplest expression of the ratio of the Pythagorean comma: 531441::524288 (531441 is the square of 729)
Looked at this way, Plato's conclusion in the republic, that a society is just when each member of it deviates from their own interests just sufficiently to optimize for the interests of the society as a whole, is intended to map onto a truism of music theory - that an instrument, say a modern piano, is optimally in tune when each of its individual notes deviates from its own true value by the small amount required to keep the instrument as a whole sounding good.
This idea is the basis of various tuning systems including the predominant modern system known as "equal temperament."
1: https://ernestmcclain.files.wordpress.com/2017/05/plato_opti...
2: see, e.g. https://mathworld.wolfram.com/PlatosNumbers.html
Also, harmony itself is a distinctly western concept whose musical role expanded dramatically with the advent of polyphony. Many (most!) musical cultures around the world don't give harmony much, if any role, and place higher importance on melodic structure.
Also, music harmony and the other kinds of harmony you mention seem to me to be related only by the language used for this particular metaphor. There seems to me to be no likelihood of there being any interesting relationship between musical consonsance and "harmony with technology and harmony with nature".
However, I disagree that harmony is primarily a western phenomena. It is a central feature to Confucianism and Daoism. It also plays a major role in Native American philosophy.
"Small integer ratios" apply to huge numbers of natural phenomena, because "small integers" and "ratios" are properties of the world we live in. Pointing out that "harmony is another example of small-integer ratios" seems fairly devoid of content to me, especially when the primary user of musical harmony has long abandoned those pure integer ratios to allow modulation and other desired compositional techniques.
Octaves are not universal across cultures. Byzantine music has no octave equivalence, for example. There was even a paper cited here on HN recently showing lack of octave awareness in different cultures (the paper may have had some flaws, but was interesting).
The fact that integer relations are mathematical relations that bear so heavily on physical phenomena is precisely the point. That's what the ancients got so damned excited about. You may not find meaning in it, but it certainly drove the development of science and philosophy from Plato to Galileo to Kepler to Descartes to Newton, etc.
Now, in recognizing that integer relationships are, in fact, an imperfect description of a pervasive phenomena -- that's why the ongoing investigation is so interesting and challenging. Don't we expect what is pervasive in physics to apply to psychology, culture and economics? I'd argue that the mathematical "imperfections" of modern music point to better models of what universal harmony really is.
Overall, the point is that we haven't yet solved harmony. Not even remotely. And i'd love a reference on why you think Byzantine music doesn't have octaves when the Greek music it grew out of most certainly did.
2) No, I see absolutely no reason to "expect what is pervasive in physics to apply to psychology, culture and economics".
3) I don't have a citation for you on the Byzantine stuff, but have been discussing it a lot recently with a musician who grew up on it and continues to perform it, and he was explaining to me how they have no notion of octave equivalency and that because of their tuning and scale systems, when you go up or down the number of steps that "should" correspond to an octave, you end up somewhere other than 2*freq or freq/2. Remember, this is in part why equal tempered tuning was developed: if you stick to "pure" just intonation (precise integer ratios), you can't construct intervals that fit nicely into the octave (e.g. pick a note, go up some number of intervals. Pick the ending note, go down the same intervals, you don't end up back where you started). This stuff is all covered in basic music theory. My understanding from this Byzantine musician is that their musical tradition basically just said "we don't care", and went with a tuning/scale system where you don't just (as in our western system) go up or down N (12 in our case) and end up an octave from where you started.
* Your friend seems to be discussing the Pythagorean pure interval tuning system where, indeed, going up is different from going down --
* In my own empirical work, I've found that pure intervals are not preferred compared to slightly dissonant intervals (in 3 tone sawtooth chords). You can try it yourself -- perfect consonance sounds much worse! Understanding this conflict with mathematical intervals is part of trying to "solve" harmony
* I agree we should remain disinterested in our models, such that we are driven to improve them and not espouse them as reality.
* Yet, I think it is a mistake if we aren't inspired by simple models -- or at least take their hypotheses seriously enough to test empirically
* For instance, is cognitive dissonance involving actual dissonance of some kind? The brain is incredibly rhythmic and even has octaves in the coupling between brainwave bands. It would seem to be natural to test these theories that Plato laid out thousands of years ago -- for instance, that musical rhythm entrains neural rhythms through resonance effects. Maybe that sounds silly, but I'd argue that we are foolish to avoid gathering empirical evidence for these ideas!
* Similarly, harmony had a major effect on astronomy. It actually still does, at the level of the cosmic microwave background radiation, where the presence of perfect harmonic peaks in the signal were the conclusive proof that the universe is "flat"
* Using the concept of sympathetic resonance has been extremely generative in psychology (see Adam Smith's first book) as has harmony in economics. Expecting what is pervasive in physics to apply to these domains doesn't mean it should apply in exactly the same manner -- just that one should expect analogous effects -- at least to the extent that one is looking for explanatory theories to test! We are so far from understanding these domains that, if we don't at least consider these natural and ancient theories (because they seem silly), we are doing ourselves a disservice. Let us be inspired by the past and test, test, test!
Probably because we're used to hearing music in equal temperament, so we associate it with "correct" harmony, whereas something like just intonation sounds a little weird and off (but I ultimately find myself preferring it? Wtf?)
An under-appreciated aspect to our educational system is that school desks are shared between two children, so people grow up learning how to interact relatively harmoniously with at least one other small child.
Absent a vaccine, Covid may alter that to the one-child-per-desk model, so I may discover in another 20-30 years how important shared desks were or weren't.
There's a sample at https://random-character-generator.com/
There's an unreleased version, which focuses more on how to portray characters, rather than just what they are. For example, instead of saying "energetic", they'll be pacing about a bit.
I might just pivot it into a story/plot tracker for writers, and use it to fill out the blanks rather than generating full characters from scratch. Where the community can add in their own templates and tropes. An author can decide that they have a character who is stoic, cynical, and sarcastic, and the tool will generate a background story, how to portray the character, what conflicts they get into with other characters.
https://www.amazon.com/Into-Woods-Five-Act-Journey-Story/dp/...
It's more for screenwriters, but his theses on plot, pacing, characters, and world are good and easy to read. It's a very good book.
The ideas for the pivot are great. Read the book, it's seriously good.
Then there could be an idea of 'atom' of information that uses models to spreading via NPCs.
There is just so much I know that could be done with this, but I'm guessing hasn't been because it takes more computation than I realize. Or maybe there just hasn't been the effort put into it. I'm hoping it's the latter.
Video game graphics seem to be providing diminishing returns for the game experience compared to depth of storyline/world building. Gamers will not care as much about how a game looks when it is very engaging due to the other elements. But it seems like those other elements are constantly undervalued by game makers.
I think it's more that content is hard. My random generator linked above already pulls from all the top tropes from TV Tropes, but it still seems repetitive. There's an awfully high proportion of stories starring a deadpan snarker or a stubbornly optimistic heroine, but these roles and personalities in a vacuum are not enough to make them unique.
Latest experiments show that details help a lot. Quality went up a lot when I moved from "they" to "him/her". And it went up even more when I had several different types of text describing the same feature. So maybe the missing link isn't just generating better skeletons, but rather different ways of saying the same thing. After all, there are a million fantasy worlds out there. All romances are the same archetypes. But some stand out more than others.
I don't have a computer science background so encoding an compression are new to me, but Im a good hacker and I can quickly get things like open pose working. Im trying to complete this in the next 3 months. Wish me luck.
I like the idea, but I'm curious what sort of things you are hoping to accomplish.
For instance is human deformity important? Do you want to take into account mild to severe birth defects or dismemberment? How about things like severe burn scars or other medical conditions which can limit maneuverability?
Then a year later you could submit new footage of a flow. The software would upload all movements into the database and recognize that that angle had increased. You now have increased movement.
Now lets say someone is missing an arm for instance. When their body is in a pike position, the database should still recognize the pike and index it against other pikes (both that user and the global range of pikes). So the database is going for similarity, not exactness. Relating similar movements though making them distinct is what I believe will be one of the hardest parts of this challenge.
I believe a large part of health and fitness is understanding our own bodies and the movements we can perform. Whether its a total of 25 possible movements or 500 possible movements, exploring and training those movements is always cathartic.
I am building this for a yoga/bodyweight training workout tracking app that I have made, but was having trouble indexing all of the motions for. Though I think if it works properly, the applications could be greater than the app.
Human movement notation is also a hard problem for dance and choreography that needs solving. My partner has been talking about it for years, and there would definitely be interest from the dance world.
So I'm writing curricula that use computer programs as the primary teaching tool. One is for computer science, where the idea is that anyone who can read some python can pick up all the important ideas from a formal CS education without sitting through a year or more of preliminaries. Over time I'm planning to add smaller sections on more advanced topics.
The other curriculum is theoretical physics. There's already a good book that does classical mechanics [1] in scheme. I've hired some postdocs to learn scheme and code lessons in general relativity, statistical mechanics and so on. I do the lessons, solve the problems, and then we talk about what worked and what didn't. I work on this about ten hours a week. After a couple of years I should have knowledge roughly equivalent to an ABD physics grad student, plus teaching material that can take anyone else to the same level from modest beginnings.
I'm looking for collaborators on this project so don't be a stranger. Twitter/email is in my profile
[1] https://groups.csail.mit.edu/mac/users/gjs/6946/sicm-html/bo...
I like it.
I was just ranting on HN about the need for this two weeks ago. It seems like the inevitable end game for teaching of hard sciences (and possibly other fields). One inspiration (besides the book you referenced) is there first few posts of "An Intuitive Explanation of Quantum Mechanics".
Here is a great example[1] where he describes QM as essentially a computational process and does everything just shy of writing down the code. That specific page is from the series here [2].
And from reading this I realized how much easier many concepts would be to grasp if you could just read the objective source code of the description and not have to try to interpret messy English or imprecise notations.
1. https://www.lesswrong.com/posts/5vZD32EynD9n94dhr/configurat... 2. https://www.lesswrong.com/posts/apbcLXz5zB7PXfgg2/an-intuiti...
I'm building a "catalog" of architectures that you could use to create a complete cloud architecture on your AWS, GCP or Azure account in less than one minute.
So, for example, you could create a docker-based architecture with CI/CD, auto-scaling, zero downtime deployment, SSL, load-balancing, high availability and MongoDB in less than one minute in your own AWS account.
It's like Terraform with the user-friendliness of Heroku.
It's very hard because every providers have different APIs and concepts so you have to start from scratch for each.
I love working on it because cloud-computing may have so much impact in some organizations like biotech startups or NGOs.
I'm not very comfortable using a comment for promotional purpose so if you would like to try it out, drop me an email at jje.levy@gmail.com, I will send you the link.
I will try to make a Show HN post in the following weeks.
Love this idea, the ease of Heroku + the flexibility of Kubernetes would be amazing.
Yes! I used Terraform because it was the tool I know best but Pulumi seems very elegant.
I think it will depend on the people that will use it.
Some architecture require more maintenance than other.
For example, the first architecture that I've created is a serverless architecture based on Docker. Under the hood it only uses managed services like Fargate, CodePipeline, CodeBuild, Aurora...
Given that you'll have a catalog of different architectures, people that don't have any experience with AWS may need to choose architectures like that.
Also, each architecture contains a detailed Readme that explain the basic operations (updating ELB HealthCheck, increasing the amount of RAM that could be used by a Fargate task and so on...).
It's a complex subject, by the way, so I am entirely open to any comments, ideas or suggestions.
> It's very hard because every providers have different APIs and concepts so you have to start from scratch for each.
Why not build it as a layer on top of Terraform?
Let's take an example: You have an architecture with a CI/CD. Great. You add your CodePipeline and CodeBuild ressources to your plan. Perfect.
For the CI part, you want your build to start on every commit on every non-master branch. Bad news: CodePipeline doesn't have support for multi-branch. So you will need to find a way to clone the default pipeline for each new branch.
Repeat this for all the user-friendly features (GitHub check runs, env vars management, deployment monitoring/rollback...) for the three cloud providers for all the different architectures and you start to feel the difficulty (I can testify ;)).
Users wouldn’t need to know about Terraform (unless they wanted to. It might be nice to have a way to export the Terraform code)
I use Terraform “under the hood” for this project.
What I was trying to explain is that the "hard part" is not the creation of the architecture components but the user-friendly features.
Still when you succeed perhaps the next goal is to simply specify what sort of compute function, the scale and risk tolerances, and let the patterns be assembled accordingly.
Even if you can lock the API version of the SDKs, you will still need to update all the architectures with the new features and changes.
It's very challenging but I love working on it!
Service meshes like istio.io start to solve a portion of this.
Almost certainly there is endless complexity but I bet you can come up with something useful. Good luck!
> people who have been working on infrastructure long enough know that there's really only a handful of useful architectures that solve 90% of problems
I totally agree with you on that point.
Also, given that architectures are created on your own cloud provider account you could easily add the missing parts.
What do you think about it?
For the export feature, It's something I've been thinking about for a while.
Given that I use Terraform under the hood, I've been thinking about a feature to merge the base architecture plan with your custom plan.
So you could have a catalog of "base" architectures and another catalog of "custom" architectures that you could spin up in seconds.
What do you think about it?
One of the main reason the big players dominate the Web (in the marketing space) so much is because SaaS is easier to handle (for most people) than having to deploy and maintain your infra.
if you streamline the process so that your regular SMB can build their digital infrastructure and maintain their private data clouds, it would go a long way to help us all with privacy.
A suite of open-source / on premise license one stop shop.
I didn't know Juju, I'll try it out!
A fountain code is an almost magical algorithm that can split a file of size n up into a (practically) infinite stream of blocks of size b, such that collecting any n/b blocks out of the stream can reconstruct the file.
Applied to p2p file sharing it effectively can eliminate rare pieces as well as the need to communicate which pieces people have. Related topic here is homomorphic hashing.
Unless I find something better before September my master thesis will be on this topic.
The fountain codes I'm interested in are built from the perspective of inverting boolean matrices, and XOR'ing the right blocks together.
For fast Reed-Solomon I'm aware of this: https://github.com/Bulat-Ziganshin/FastECC. It's kind of amazing how far Reed-Solomon has come, thanks to the fast fourier transform. At the very large problem sizes it does slow down more and more though. If cleverly applied (e.g. layering erasure codes) you can make it go very far indeed. I don't like how hardware support is essentially necessary to make the larger field sizes necessary for bigger instances fast.
Wirehair is very interesting, and I hope to study it well and describe it more formally as part of my Master's thesis. I'm not aware of any academical analysis of it. I did look into it enough to diagnose it suffers from the same O(n sqrt n) issue that RaptorQ does, again for very large instances. The issue lies in having to do Gaussian Elimination for a submatrix (to solve the inactivated columns) near the end of decoding, and this submatrix can be on the order of O(sqrt n).
I'm interested in 'very large instances' because ideally I'd be able to create an efficient fountain code with block sizes on the order of the size of a UDP packet, disk page or QR code, which has some very interesting applications.
There's a EU directive instructing on how citizens should be able to identify online with eIDAS. In my country, you can use eIDAS to authenticate in basically any governmental agency portal, but you can't get any eIDAS enabled auth method as a citizen. The current way of authenticating is done via bank accounts or a paid extra mobile service that requires a non-prepaid mobile contract.
This is a relatively huge issue. First off, the Finnish government pays the banks for each auth any user does when they for example want to log into their medical records etc. It's a few million euros a year just for verifying the users.
There's also obviously issues with whom the banks serve, there has been some cases with them not taking foreigners or people with bad credit as customers, making it impossible for them to authenticate themselves.
The current EU directives also indirectly require that the banks should provide a bank customer the possibility to authenticate without needing to have a banking account (which costs money), but to my knowledge this still isn't possible. I pay around 20 euros a month just for the luxury of having an account, not everyone can afford that on top of other bills.
Auth services are not accessible for impaired users.
It's also basically impossible to manage who has essentially the power of attorney and over which matters, for how long etc. Either you have to give them your login info (good luck resetting your SSN) or try to use the services over the phone and somehow convince the other side that you have permission to manage things for another person.
There's no ways of authenticating who is using your accounts online and actually verify the users.
Basically, my idea is combining biometrics, PGP and having the government running the identity management themselves. This would have added benefits of basically enabling hashed throwaway addresses and info for use online while providing a free and accessible way of authenticating strongly online.
Unrelated but speaking of throwaway addresses, it would be cool to be able to create a throwaway postal address (which is then translated by the postal service), so online shops don't get your personal address information.
If PO boxes were free, it'd solve one part of which I take issue with, but it costs like 4 euros per pickup. If your income is low, the 4 euros on top of the some 20 euros for banking and another 20 for a cellular plan will quickly add up.
Several brick and mortar retailers here require your address and personal info even when buying and picking up physically at their store and several have had their databases hacked and leaked.
Why do I need to give those when they're not shipping anything to me and I pay in cash?
We have an agency called Maistraatti which is our nation wide registry office which will have all of my postal information, family relations etc.,basicslly anything related to me as part of our society. Why can't I just provide online and physical retailers some ID that the registry can then translate into my actual info when it's actually needed, for example for shipping or if they want to check my credit etc. They could just save that ID for that purchase and temporarily check the necessary info through an API.
Hashed info would be one solution, the retailers would only get the hashes I provide and the registry office could then match those hashes to my info. In essence, I could basically create single use throwaway information for each retailer if I'd wanted to and they would be none the wiser.
It occurred to me the USA might do something similar in the future and let the banks authenticate and verify identities. (The $1200 CARES Act stimulus payments were automatically wired to those who previously authorized the IRS to post their tax refunds to their banks.)
> actually verify the users
Maybe you can harness existing Public Notaries instead of using online banking? The USA has over four million Public Notaries who can "witness" and verify identities. For example, a user can pay for a Public Notary to come to his house. The Public Notary reviews the user's government provided identification and issue them an official E-ID and a encryption USB key like Google Titan Security key. The Public Notary can record this transaction in a government database so that there is a trail of who received the Titan key and who provided it.
I mean, I think it's some ten cents per auth through a bank, if you'd have to invite a notary or visit them every time you want to auth, it'd definitely cost more than that.
I was thinking of a combination of biometric ID, physical card with NFC or USB and a pin or a password. Biometric info is hard to spoof, but not entirely impossible which is why ust stealing the ID card or biometric info shouldn't be enough, you'd need some type of password. Once the user provides all three, you'll know that physically that person carries the aforementioned identifications and is like whom they claim. These would be used to encrypt and unencrypt hashes, meaning that other individuals can also use the hashes to make sure they're contacted by or contacting themselves the correct person they meant to.
We'd also need to implement a way to manage permissions for other users to manage our own data. If you're for example physically incapacitated and want your caretaker to be able to access some services, you could add their hashed identity as an allowed entity and decide over which services and features they can see and/or edit.
1. https://www.singpass.gov.sg/
2. As far as I know, people on migrant worker visas aren’t allowed to use SingPass.
The relationship is actually opposite: banks will let you login on their sites using the government's ID provider. It's not mandatory, though.
What we're basically doing is using thermal evaporation to lay down thin films of metal on top of each other in a high vacuum environment. We're then patterning the cell with a fiber laser to produce the cell traces and patterns needed to cell size.
Here's an example of system that does what i've just described in the context of creating CDTE cells. Note that it doesn't use a laser to create the cell divisions but rather uses a conductive ink and sand blasting.
https://avs.scitation.org/doi/abs/10.1116/1.4941071?journalC....
I thoroughly analyzed their design and I have copied some aspects of their design while avoiding many of the flaws that significantly limited it's practically and efficiency. Here's a quick summary of the design changes and flaws that I found.
For one, the design specified in the paper can barely reach high vacuum which is a requirement for producing cells of reasonable efficiency.
One major improvement I'm working on is a system that allows for automatic changing depostion powder inside that chamber instead having multiple chambers for each layer of depostion powder.
The advantage of this approach is that miniaturizes the chamber size significantly, making closer to the size of something that could fit in the back of your car then something that needs a dedicated room or floor for.
I've also looked carefully at how im going to achieve high and maybe even ultra high vacuum. And in that regard I think I've made some significant strides.
My design achieves high vacuum in three stages, the first is through a simple ventri pump and the second is a sorption pump which has been redesigned based on a old paper I found here(). The last stage uses something called a non-evaporable getter pump.
Experienced vacuum engineers might initially be baffled of choice of pumps I am using. As they are normally considered too slow for the type of operation that the chamber is being put through.
However, the downsides of the speed of these pumps can be mitigated by three measures. (1)Building a chamber that can go through bakeout(which removes contaminates and reduces pump down time) (2)Designing a chamber with metal-to metal seals and low leak rate. Lastly the obvious principal of making the chamber volume and surface as small as possible while making the size of the pumps large.
I've barely scratched the surface here but I think this should give you a rough idea of what I'm doing. I really dont think this stuff is hard as how it's made out to be.
Here some resources that really have really helped out so far.
-Building Scientific Apparatus a book that should give you a broad overview of things you need to know
-vacuum sealing techniques alexander roth Extremely exhaustive in the amount of information of about, valves, and just general construction of the chamber. The book is really old but everything still stands and it's honestly better than most of the stuff i've found online.
Blogs by this guy https://www.normandale.edu/departments/stem-and-education/va....
Really good introduction to basic stuff you need to know and decisions you need to make.
If anyone has any questions further I would be happy to answer them.
Two questions: (1) Could you get away with an inert atmosphere? I'm not familiar with the pros and cons with respect to PVD. (2) It sounds like your vacuum setup will have a long cycle time from vent to pumpdown to operation. A load lock with a (turbomolecular?) pump adds quite a bit of expense. What's your approach to achieving high throughput?
The cycle time is of course a highly dependent on the final design of chamber. There's no reason that Sorption and Getter Pumps combined with a ventri prestage can't preform to a degree that meets the design requirements.
However their performance is highly dependent on two things, the ability to reach bakeout quickly and the use of metal to metal seals instead of o-rings.
The actually difficult and expensive part of high vacuum engineering is figuring out how to engineer valves that can both withstand bakeout temperatures and make the tight leak free seals.
In this regard I plan to use what essential amounts to a plate valve with something called, a "powdered seal". This valve meets the requirements for the design in every aspect with it's only downside being that it is slow to change open to close. Though this downside will not reduce the overall throughput of the system as it is designed.
I've worked with other PVD systems yet I have not constructed my own. The main goal of this system is to make this sort of thing accessible to as many people as possible for the lowest amount of cost.
As it stands right now I'm learning machining to actually build most of this thing from scratch as I don't have the money to get this machined from from a job shop.
Specifically, I'm working with a local pro-refugee organization in a densely immigrant populated region in Spain. There's a complex chain of steps that you have to go through in order to acquire citizenship. Only people with access to good lawyers are able to deal with all the bureaucracy of the process, without mentioning other problems (missing obscure expiry dates that reset your process, language-related problems, local government workers not actually knowing/willing-fully ignoring migrants' rights...).
There's a good network of volunteer lawyers working on this issue, but its not scalable. I'm working on a platform that would allow migrants to solve their own situation, by crowdsourcing the knowledge of lawyers on a case-per-case basis and offering a simple interface in their language to track open processes & discovered the ones they need to go through and how.
As an abstraction for this, I've been thinking on how we could improve citizen/government communication. A small use case / example for this could be refugee camps. My previous experience here is that they are small, disconnected communities with a top-down type of organisation towards the camp organisers. It shouldn't be hard to provide real-time tools for connecting both, potentially leading to things like asking for their needs, managing their legal situation, or even allowing for voting & self-governing.
COVID has affected quite a lot. Most of the processes have stopped as the government shut down the in-person offices, and now they are slowly reopening... and the situation was already crowded before the pandemic. On the positive side, extradition orders have been temporarily paused.
Step one is survival, basics of hunting, first aid and farming sort of stuff. That volume would end around homesteading and self-sufficient living.
Volume two would be establishing society in larger groups than a family unit. Things like job specialization (N roles for N people instead of 1/N of each role for each person), establishing trade (currency, weights & measures, supply chain), government (mostly what not to do, what to protect, how to adjudicate disagreement), public works ("roads are a good idea") and their ilk. Also medicine beyond first aid and basic care.
Volume three would be advanced STEM topics, getting from a functioning society to... more. Not even the sky's the limit. It should include blueprints for things we take for granted like refrigeration, telecommunication and birth control. It will include all the basics of physics, chemistry and biology required for smart people to fill in the gaps and launch a human to the moon and back.
I want to super-nerd-out about this, and publish it on Tyvek or something exotic so it'll last through decades of wear and tear (and water-logging and more), and include a ruler on the spine and it's own weight documented for reference.
How to Invent Everything: A Survival Guide for the Stranded Time Traveller
I believe OP is trying to actually write the book that one is supposed to be.
Survival is sourcing primarily from stuff like the Boy Scout Handbook, the SAS Survival Guide, a few other online resources and a farmsteading book from the 60s-70s that I can't recall right now. That will be the v0.1 draft, and I'd like to practice some of the techniques as well to provide hands-on feedback on what's easier or harder.
Volume 2 is a vague outline, and probably needs to be combined with vol 3 and fleshed out before splitting in two (or more) pieces to research and write.
The first to volumes are very goal purpose driven and so fit will together. The third feels very grab bag and likely should be split up more.
You'll also likely want to cover on schools of thought, the scientific method and whatnot.
An alternate volume 3a might be on mass production of food (enabling greater human capital). Large scale agriculture and the chemistry and botany that enables it. Some amount of animal farming is likely required.
3b could cover the communication and transportation networks necessary to distribute that food. Both the engineering, infrastructure and tech behind it.
At some point you can shift to covering, manufacturing and mass production - which enables all the small products needed for so many fields. The handles, washers, lenses,...
Then final shift to digital and everything that rolls out from there.
[0]: https://en.wikipedia.org/wiki/Denis_Diderot [1]: https://en.wikipedia.org/wiki/Encyclop%C3%A9die
Machine learning: what happens when we replace Euclidean metrics with p-adic ones? Distance is fundamental to so many algorithms (least squares regression; nearest neighbours; anything involving gradient descent). How do those algorithms behave over completely foreign metric spaces?
There's a US company that has an ultrasonic "x-ray". Signal processing is used to find cracks and cavities. It's not well-known yet even to Bay Area specialists.
SOLUTION: The space doesn't lack for good research and policy recommendations, but it has historically lacked (on the right and left), non-screedy, nonpartisan voices that can be trusted when policymakers look for solutions. We're attempting to fill that space.
WHAT WE WANT: Ultimately? We want every major American city to work better for the people who live and work there. It'll look different from community to community and our job isn't about applying a cookie-cutter approach. Instead, we want to get a wider range of ready-to-implement tools in front of the decision makers, and educate engaged citizens that solutions exist.
(incidentally, I am just at the point in Simone Weil's reports from germany where, early 1930's, the communist unions and nazi unions are ganging up against the middle-of-the-road pragmatic-reform-not-ideological-revolution social democrat unions. Very depressing.)
Today's web is a collection of applications that largely provide a frontend for browsing data. The applications and data they contain are silos: there is no easy way to separate the data from functions and compute across datasets. Every application must (re)invent its own UI for querying and displaying data.
But if the web is actually a collection of datasets, why don't we have a web browser for consuming and interacting with arbitrary structured datasets?
We can model most popular sites (HN, Instagram, Twitter, Amazon etc) as a collection of hyperlinked JSON records. Let users adjust how these records are displayed. Provide a universal way to query and navigate any dataset and invoke associated functions (eg the upvote function for an HN post).
Full separation of data and functions instead of application silos is necessary to achieve general AI compute in the future.
Example: can you email Mark a summary of the top 5 most popular HN articles 3 days before our meeting?
I do think that if it were to be embraced as a more common standard on websites, building a more standard UI on top should be _relatively_ simple as each websites underlying data would _hopefully_ be structured the same.
The foundation is flowcharts, with support for individual layers distinguishing levels of abstraction, and scenarios for exploring use-cases. From there:
- Live data. We look at metrics on dashboards but it doesn't put into perspective how they relate to each other. Imagine seeing on your flowchart of servers, that one worker has an anomalous CPU reading, and you can click into that to see the individual readings of the running services on it. (rudimentary version: https://app.terrastruct.com/diagrams/1404897320)
- Automatic generation and sync of diagrams. Having access to sources like AWS account and version control to create and keep in sync diagrams of your infra, db schemas, UML classes, etc.
- Collaborative editing, seamless integrations with written documentation, linking directly to code where appropriate, version control, etc.
So much of software can be better understood visually. Still early on, if you're interested in learning more, https://terrastruct.com. And would love to chat (email in profile) with anyone with ideas.
Also I suggest to not only market to Software engineers but people who work with data like drop-shippers, digital marketing agency, etc.
I actually started this marketing it as "diagramming tool for systems". Talk about trying to be as generic as possible. I want to focus on one segment first, but totally, a side effect is that flowcharts enriched with data acting as a dashboard would be really beneficial to non-technical people to understand e.g. analytics funnel.
Thanks for the suggestion!
Interactive flow charts should be the main selling point, as for usage, it is up to the user.
Also the pricing model, restriction on frames and layers would chase free individual away but they are those who plays a main roles in making something mainstream. I would recommend removing the usage restriction but adding collaborative restriction. A good example for this is how Google Sheet works.
Good luck, hoping to see it being used everywhere someday.
It's still used in lab environments.
Thanks for sharing! I'll check it out.
(And just FYI, the pricing section isn't rendering properly on Firefox 77)
I've been journaling my dreams for years and I'm working on an app that makes it easier to (visually) map them out & find patterns: https://oneironotes.com/
I like the idea of accessing other (inner) dimensions during sleep, like an explorer (an "oneironaut"). The problems to overcome are related to capturing and recollecting experiences that only take place in the mind. You asked about the weird stuff...
Keep it going. If I had an iPad or something better to write on after waking up I'd definitely use it.
do a 10-day retreat or some other intensive period of learning with a teacher
and then from place of proficiency, continue the practice on your own.
you’re likely to begin having wild/intense/vivid dreams on days in which you meditate.
(1-2+ hours per day)
2. When you wake up, don’t move! Stay in bed for 5-10 minutes and try to remember. Once you remember one thing try to ask yourself what happened before or after.
3. Dream journal.
I practiced the above back i. High school. Went from occasionally remembering a dream to remembering about 4-5 a night. Some small snippets and others longer. Was really incredible and I plan to try it again.
Dedicate 30-40 days and see what happens!
- The #1 way to remember more dreams is to be interested in them! The only personality trait correlated with high dream recall is "openness to experience" (https://en.wikipedia.org/wiki/Openness_to_experience#Dream_r...). If you want to remember dreams, first consider WHY you want to remember them. Hone into that curiosity and strengthen it.
- Second best tip I can think of is: more sleep! REM periods get longer in the later cycles of your sleep, meaning a higher chance of dreams.
- Also, if you really really want to recall dreams (and perhaps induce lucid ones) and you don't mind being tired the day after, try interrupting your sleep at ~90 min intervals (the average length of a sleep cycle) with a (silent) alarm clock - or raise a baby :)
- Finally, quit smoking weed if applicable, as it suppresses REM sleep ;-)
"A Suggestion for a New Interpretation of Dreams: Dreaming Is the Inverse of Anxious Mind-Wandering."
Also your project is awesome!
Do you think that besides as a framework for anxiety diagnosis, this could suggest lucid dreaming as part of the therapeutic treatment? Consciously inducing lucidity and choosing confrontation of the dream scenario rather than defaulting to avoidant behavior?
Which is why I started making Cleave: An application that lets users persist OS state as a "context" - saving and loading open applications, their windows, tabs, open files/documents and so on.
Started because of frequent multitasking heavy work with limited resources.
Made it because I wanted to switch between studying, working, reading, looking for an apartment, etc. without manually managing all states or consuming all resources.
Open Beta (macOS) as soon as I finish license verification and delta updates, but I keep getting sidetracked...
Could combine this with site/app blocking tools to ensure when you load the studying state you don't get distracted too.
Blocking sites was done with squid time-based ACLs. Now I’m wondering how productive I could be combining the two
Only half joking here.
Person { country => name }
And it will output the following SQL: -- target: postgres
SELECT country, array_agg(name) AS name FROM Person GROUP BY countrySo you might have a GQL type like:
type User {
name: String
age: Int
}
But you need to implement a query with business logic for fetching this data, and that can be anything (but generally, a DB call).Projects like Hasura kind of blur this line, as it's essentially one big GQL -> SQL JIT compiler in Haskell though.
My project is here: https://docs.racket-lang.org/plisqin/index.html I'm days away from a Show HN at this point. If I can pick only one idea that everyone should copy, it's that joins are values, not language constructs.
Which is to say, what is the relation between a sub-Peano logical system that can prove itself consistent, and is complete, thus bypassing the 2nd Incompleteness Theorems, and self-referential decision problems posed in the programming language that corresponds to that logical system?
My suspicion is that such a language could provide very strong guarantees on the auditability of self-modifying code.
[0] https://en.m.wikipedia.org/wiki/Self-verifying_theories
[1] https://www.semanticscholar.org/paper/Breaking-through-the-n...
It is known that Q takes the form Q=a(x,y)b(y,z)c(z,x) for some functions a,b,c to be determined by solving the system of equations:
P(x,y) = sum_z Q(x,y,z)
P(y,z) = sum_x Q(x,y,z)
P(z,x) = sum_y Q(x,y,z)
It's not clear there exists a general closed-form solution. Iterative algorithms are known. This type of problem comes up in a number of interesting contexts. For instance, testing for non-trivial multi-variable interactions in dynamical systems such as neural networks or spin networks, performing joins on probabilistic databases, constructing reduced models of probability distributions, and in some cooperative game theory problems.
Examples: https://www.princeton.edu/~wbialek/our_papers/schneidman+al_...
http://vldb.org/conf/1987/P071.PDF
https://doi.org/10.6028/jres.072b.019
https://www.mdpi.com/1099-4300/16/4/2161 Edit: formatting
Middle Manager Syndrome would be great for machine learning to cure. I hope you come out with your nerves intact
> to appear as if they understand and control their shops [emphasis added]
Ideally, the manager would provide coordination and clerical support, and insulation from the rest of the bureaucracy (ie actually managing) without necessarily needing to understand or control the details. But if that's how they appear, upper management will classify them as overpaid secretaries, and gut their authority (and, on a selfish note, salaries). So it's important that they appear to understand and control their nominal subordinates, even if they're actually following sound advice of the form
> It doesn't make sense to hire smart people and tell them what to do; we hire smart people so they can tell us what to do.
(It may still be a impossible task, but it's a different task from having them actually understand and control things; even technical managers rarely accomplish that.)
And I'd like to say I'm surprised and encouraged by the number of people empathizing with this problem; at work it is a lonely predicament. It somewhat dashes my hopes of escaping it by jumping to another firm, but at least I know I'm not the only one.
My current side project is https://feedsub.com. Right now, - it's not great - I started by building an simple tool for getting regular updates from RSS feeds, but longer-term I want to turn this into a system which can absorb all the data streams you're interested in (news, stocks, weather, social, communities) and give you dials (filters, curation, signals, etc..) to surface a healthy amount wherever you want (SMS, email, web, RSS, chatbots, etc..).
The crux of the problem is endless scrolling feeds we're sucked into 24/7, which is why I based my MVP on email.
My current solution is trivial on a technical level. Honestly, my biggest problem is thinking about the problem on a non-technical level, balancing this with working life and branding, since my software and vision are very far apart right now.
(TBH, this isn't nearly as hard a problem as some of the others here - but I enjoy the ideas/feedback I get from communities like HN)
https://web.archive.org/web/20120810005232/http://masanjin.n...
Unfortunately, I don't think he even finished splitting Sup into the server+client (called Heliotrope and Turnsole), let alone get them to handle other stuff beyond email. Felt like a lost opportunity.
--
For your project, seems like the direct competition is IFTTT and similar. What do you think differentiates your project from those? Could be useful to push more in that direction.
The regular iterator protocol, as today in rust, make hard to do stuff like JOINS, GROUP BY and other fancy stuff (because you need to decompose the computation in a partial state machine. This is hard even for a developer, impossible to ask for a regular data user). Also, you need to duplicate all that for async (with streams) and other abstractions...
I'm now trying to understand transducers (https://www.reddit.com/r/rust/comments/gqiyej/potentials_adv...) and stumble upon effects:
http://mikeinnes.github.io/2020/06/12/transducers.html
that look to my the clean way I wish to use.
But what look easy in python/f#/etc in rust is HARD to do. So I'm in a kind of limbo :)
Problem: Public schools in India don't do justice to students. Private schools in India charge a bomb but most of the money ends up in the hands of the "owners" and not enough to teachers (For reference, an average primary school teacher earns lesser than what an Uber driver earns) .
The solution : A network of "not-for-profit" schools where the fee structure is reasonable ( can't be free ), but the profits are shared amongst the people who make the schools run. Think "community banks" but for schools. I can't solve the problem for everyone but hope to set a good example by attracting the cream of teachers. It's time the teachers got their due.
but there are some real problems to solve. like, 1. how to get such school started ? who will provide initial capital ? 2. even if such a school is started, how to stop it from becoming for-profit again ? 3. is there a healthy balance between 'for-owers' and 'for-teachers' model ?
- Many a times, kids school has nothing to do with quality of education in that school but the stature of the school. Parents in India use this to flex among their peers.
- Non-involvement of parents.In India, the parents who actively take part in their kids schooling are a minority. For most, its more like "paid school fees" and just make sure that the kid is doing homework, that's all.
- Regulation. Once you try to open a school, you will come to know that there is no way you can get your school registered without paying hefty bribes to the education department if you dont have bureaucrats(IAS or IPS) or politicians in the family.
Education is a problem not only in India, But across the world. In Africa, in remote villages, Possibly on Mars,if we setup a Mars colony. It is not only about financial resources, but also simply non-availability of teaching resource.
The second part, Why is education only relevant for children. Why not adults.
This is where Edtech comes in play. Online Learning and other things. However it is only a small component in the entire solution. Other components are personalization, social interaction, assessment, credibility of these online Learning.
Also it is very easy to monetize online attention. How to build financial model with the true goal of Education is also going to be very critical.
Good news, all the components are technically available or can be built. Bad news. It requires culture change.
Best is a mix of
- the ones I enjoy most
- but not one that I just visited last weekend
- where there has been recent snowfall / is predicted to snow
- that I have may have a season pass for
- where costs of highway tolls, petrol, hotels can be optimised
- driving time
- whether I’m going alone or with friends
- don’t have anything important at work on Monday
Eventually, I’d like to turn it into a kind of friend finder / social network thingy but for snowboarding.
Stay safe in those woods! I nearly perished, by getting lost.
an eco-recovery robot
Inspired by
https://interestingengineering.com/jadav-payeng-the-man-who-...
https://relieved.co/couple-plants-2-million-trees-in-20-year...
EDIT: i am trying to find a similar story about a professor who worked in similar techniques in African farms - increasing plants/animal/water-retention using tradition techniques
This is a report by the NIC from 2013 which outlines exactly how we expect these shortages to occur, on what timeframes, in which geographical locations, and what consequences are expected.
Thought you might find it useful when planning how and where to be most efficient and to stay ahead of the clock.
I'm happy to discuss these issues more over email if you'd like to swap ideas.
- podcasts
- self-authored internet comments (Reddit, Hackernews)
- books
- articles
- code
- music
- lectures
Started it at http://rememex.org
More specifically, whenever you give a designer a design spec, it is always worth asking, how good is the best possible design for this spec? And, of course, can the designer actually achieve it, or something close to it? This is the question here.
In this scenario, the design spec is the optimization problem (what you want to optimize), the designer then gets to choose how to best approach this problem. In this case, you want to give a number that states, independent of how this problem is solved, what is the best any designer (no matter how smart or sophisticated, how much computational power they have, etc) can hope to do. In many cases giving such a number is actually possible! (See below references.)
-----
[0] https://pubs.acs.org/doi/10.1021/acsphotonics.9b00154 (PDF: http://web.stanford.edu/~boyd/papers/pdf/comp_imposs_res.pdf)
[1] https://arxiv.org/abs/2002.00521
[2] https://arxiv.org/abs/2003.00374
The mapping between the two is monotonic, non-linear, and can be stationary. If the tempo map is allowed to contain ramps (accelerando and ritardando in music speak), there are implicitly exponential sections in the function that maps between them.
Using floating point arithmetic leads to errors that have immediate effects. A musical time that should be considered to be at sample N is instead considered to be at sample N-1 or N+1.
It's surprisingly hard to do it correctly.
Despite this tight weight budget, I intend to build something rather interesting, but it is causing me to spend a lot of time in Fusion designing the parts along with slicing and reslicing 3D printed parts to shave partial grams of components to save a bit of weight.
I am partly obsessed with and researching / writing about how you could make carbon-free heating cheaper than fossil fuel based heating. If you can make geothermal systems cheaper than a natural gas furnace, then homeowners would have the same economic incentives as drivers, where operating an EVs is far cheaper and cleaner than ICEVs.
cryo file mangager is an attempt to get rid of the hassle: https://cryonet.io
Technically bittorrent + any file encryption format works fine, although it's not something a nontechnical user would ever figure out without either step-by-step instructions or said miracle.
This is a well-solved problem.
No IPs, no forwarding ports or files. It was a magical experience and Just Worked.
Maybe the real hard problem is getting people to pay attention to what is happening in their world and to forecast what the impact of their actions will be in the next few decades.
But it's politically hard.
What we need is an economically pragmatic green political movement, who will not keep shooting itself in the foot with left-wing ideological purity competitions.
Profit seeking motive is only a problem when you let it of it leesh (because you somehow convinced yourself that the state of perfect market competition is the stable state of a market, when in fact all natural forces point toward domination - monopolies).
So, green parties... Drop the bullshit feel good stories and let's just make saving the earth profitable.
Besides that's only half of the solution. The other is pragmatic policy. If the green movement was pragmatic they would have championed "EU builds 200 nuclear plants in <10 years". All the problems with nuclear right now (who will build it? it's expansive, takes too long etc.) go out the window when someone like the EU decides to build 200 of them. Wind and solar are nice and all, but they can't do in 10 years what a few dozen, let alone a few hundred, nuclear plants can. Solutions are there. But solutions are not the point. Getting elected is the point. And that's where ideology and election-efficiency (it's much easier and cheaper to campaign on emotional social issues and virtue signaling that it's on suboptimal, ideologically-unpure, hard, painfull, expansive solutions) reign supreme.
And regarding the pandemic thing - the question you should ask: "wrong choice for whom?". The general population? Or the people in power? The biggest problem in our society is that we've fallen for the lie "in a democracy the general population rule and the system inherently works in their best interests". Democracy has nothing to do with taking care of the people. It can be used for that ... WHEN the general population realizes that it first has to BECOME a power player in the game of politics.
I used to run match.com's research division. I left to pursue this project.
Unfortunately, many countries don't have useful e-IDs and the ones that do are limited to that one country. I want to create a single digital identity which works for everyone, for all applications, across borders. The basic features are:
- App based with no special hardware necessary.
- Privacy friendly with the user always fully aware of what data they are revealing.
- Simple to integrate for developers. It's a standard SSO flow over OAuth/OIDC.
I'm currently calling it Pass: https://getpass.app. If anyone wants to have a chat about digital identities you can reach me at fabian (at) flapplabs.se
Does this mean that a user can use their identity on two separate sites, and those two sites can't collude to build a shared profile of the user, without the user's permission?
Does the user have to choose a specific server to be involved in all their identity interactions? If the server stops working, does the user lose their identity?
Also, is it possible to create an account without a phone (or rather without a SIM, since those are often tied to real identities)? Does your proposed system assume that people can't register multiple identities (using multiple phones) if they wanted to?
That's precisely what it means. User IDs will be unique for each site and I'm hoping to anonymize email addresses as well, similar to what Apple has done for "Sign in with Apple". Some companies might be required by law to collect some PII but in that case their needs will be vetted before.
> Does the user have to choose a specific server to be involved in all their identity interactions? If the server stops working, does the user lose their identity?
I'm currently building this as a centralized product so no, there is only a single server maintained by us. I'm mostly concerned with building a great product but the prospect of decentralized, verified identities is also very interesting. I'd love to see what that could look like!
> Also, is it possible to create an account without a phone (or rather without a SIM, since those are often tied to real identities)? Does your proposed system assume that people can't register multiple identities (using multiple phones) if they wanted to?
The current product is in the form of an app so you will need a phone but you won't need a phone number (or SIM). An email address is currently required though.
My current system assumes one identity per person but it's fully possible to have multiple devices which acts as that identity. This might change depending on regulation though and is not set in stone.
If you have any more questions I'd be happy to answer them!
> [companies'] needs will be vetted before.
Is the plan that a single entity offering this centralized product will control not just which users are allowed to have identities, but which companies are allowed to access users' IDs? Presumably there is a somewhat costly process to vetting companies and their requirements, so would companies pay a fixed amount to cover this vetting process, or pay more based on the level of personal information they hoped to receive from users?
> the prospect of decentralized, verified identities is also very interesting.
What type of verification do you imagine being necessary or available for user identities?
> The current product is in the form of an app so you will need a phone but you won't need a phone number (or SIM).
Are there any technologies specific to phones that mean this couldn't run as a web app instead?
> My current system assumes one identity per person but it's fully possible to have multiple devices which acts as that identity.
So if you can install multiple copies of the app on your (Android) phone, you could have multiple identities on the same device?
That's the plan, yes. The current pricing structure is to let companies pay a monthly price per active user. They would not be able to pay more to get access to more data. As this is early stages, I'm not sure what the vetting process will look like yet. It's mostly there to ensure that the the data the companies request are actually needed for their core business and will not be used for tracking. For example, a company can only request the legal name of a user if the law requires them to know it. This might be true for a bank but not for a dating app.
> What type of verification do you imagine being necessary or available for user identities?
The verification we will be performing is at the level required by some laws, for example Know Your Customer (KYC) and Anti-Money Laundering (AML) laws. Our goal is to make Pass suitable for fintech companies which have quite stringent requirements. I can also see lighter forms of verification being good enough for other applications, like the Web of Trust model used by PGP.
> Are there any technologies specific to phones that mean this couldn't run as a web app instead?
Yes. Many modern phones have a built-in Hardware Security Module (HSM) which can be used to store and use asymmetric keys securely. Browser storage can't offer the same level of security currently but there have been some interesting developments which might change this, for example WebAuthn.
> So if you can install multiple copies of the app on your (Android) phone, you could have multiple identities on the same device?
I can't really answer this right now as I'm not sure which way we'll go. It will depend on what regulations require and what we can achieve in terms of verification.
Moreover it requires a smart card for the highest level of authentication.
Smart cards don’t work very well today where the average person uses most services through their phone. With the HSMs in modern phones, security in a e-ID app will get very close to that of a smart card though which is really exciting!
(I don't mean to single you out specifically; this is something that any digital identity system needs to deal with. And most of them enthusiastically don't.)
It sounds like you're trying to say something about the danger of such systems being abused by the state in holocaust-like situations, but the wording is so odd that it's unclear what your real intent is.
I am legitimately confused by this question, since it does not appear trollish to me.
I chose to express it that way to emphasize that (some) abuses of a digital identity system would present as lawful actions by authorized law enforcement personnel, and (apparently too tacitly) that "holocaust-like situations" are not a qualitatively different operating regime that system can assume it is not in during 'normal' operation.
I was a bit worried that it would be percieved as overly confrontational (hence the second paragraph attempting to disclaim that), but I assume that's not what you mean by "trollish".
My understanding of the comment was expressing a concern that some kind of universal identity system would undoubtedly become an agent of the state, which is fine most of the time but in various situations (including holocaust-like ones) means that it could be used as an instrument of oppression, since it would likely be unable to be used by those who wanted to hide some aspect of their identity for safety reasons.
This seems like a legitimate concern for something that has a goal of becoming a global universal identity system. I would hope that something like that would look more like cash - usable by anyone, whether the state likes it or not, with fundamental privacy aspects - rather than like VISA with some privacy bolted on.
It's hard to give a reader a example of someone who they actually believe is a Evil Mutant(TM) who clearly (to that same reader) is a innocent victim, and I didn't bother to try in favor of "well obviouly a non-negligible portion of 1930s Germans agreed with the Nazis".
Idea: A web browser for self-automation that learns semantics and sentiment of content on the web, whilst trying to respect references or articles’ sources to recorrect the ground truth.
Solution: Still far away from it, but am implementing a peer to peer Web Browser that can share its information (or states) with trusted peers. Trying to implement a recordable, editable and repeatable GUI for everything, which is a lot harder than it sounds.
[1] https://github.com/cookiengineer/stealth
All kind of feedback appreciated!
Another similar idea is a very simple rest protocol so that you can save to server and then make it easy to self host it.
I like the idea of people building apps as web pages without needing to worry about the server and the user owning their data but having the convenience of a cloud like solution where you just visit the site, log in and work.
I want to think of an approach that is really easy to use so it becomes popular for that reason.
Namely I don’t want to pay Dropbox a markup over S3 and develop a dependency on them. What I prefer is to purchase the software from Dropbox and self host/store it wherever I want. Same goes for email, office suite, photos, etc.
The storage can be shared through bittorrent with applications and data(files and key-value database) already layed out on top of a userspace filesystem layer (the key-value goes through a sqlite btree).
All the data blocks can be shared thought bit-torrent, and everything, including the ui apps and the service application are also shared the same way.
When the dev application is launched, there's a middle-man that works like a server instance (the developers have total control into what is handled via RPC and the RPC api layout), and will launch rpc services, where the embedded application will consume by opening a url served/routed through the central host process (that centrally manages applications, processes, ipc, rpc, data, etc)
I've made this starting from a Chrome codebase, so its multi-process, with a web engine embedded (that will only be used by the ui application) but that you can control much better through your application api, aka the UI process.
The first language that have access to this is swift.. so the devs will deploy in their shared storages code/binaries for the rpc handlers (the app instance or service process) and the ui applications that happen to have full access through an api to the web layer/renderer.
It was hard to get where i am right now, but im almost finished, and even now, it looks pretty cool already.
I think that with a little more work, it can even serve to create not just p2p applications, but also distributed with pools of servers working through RPC with a help from the p2p layer.
How do you store this information in a database, in a geographically meaningful way? How do you represent it on a map?
Working on building a self-hosted app that would alow you to save, organise and search your knowledge in one center.
It would contain information like notes, bookmarks (it would download the links contents) and in general provide a programmable, opensource interface to preserve the info you'll find useful and even sync with external apis to save your online presence locally (think reddit posts, hn links, etc...)
Maybe we should start a subreddit for people building this stuff.
1. Payloads are in domesticated strains, which are less efficient than wild strains, which are already global
2. Exotic growth media requirements make the cells only for wealthy organizations, which is status quo and aren’t target audience
Of course, if good reason comes to change that, I would.
I’m working from the bottom up and am almost ready to start working on collections— I started with newtypes to represent columns and then tried to get them to combine together properly.
As of today, I’ve got what looks like a good scheme to treat arbitrary objects as records, and can do joins, projections, and column renames with the type system keeping track of which objects have which columns.
The plan for tables/collections is to implement a sequential-scan interface backed by something simple, and then add wrapper write-through index objects to speed up particular query types.
I have experimented with varied stuff, including columnar, so I think we can help each other!
You’re doing everything at runtime (at least in Rust), which is a more flexible approach but can’t do things like trigger a compile error when attempting to access a field that isn’t present in a record.
Surely! but learning that is pretty interesting and could help, also, I think that combining ideas/crates is what give more power to the rust ecosystem...
More to the point, I'm still thinking how/which data-structures to use, and how deal with the ability to provide SELECT/WHERE/etc across them (like a file)
> nothing really to do with databases proper
This is a big misunderstanding with the relational model: That is only for (r)dbms and storage.
I'm looking to apply it to regular programming. Is similar to apply OO or Array or Functional paradigm as your base for a lang.
I'm working on approximating the electron density using just the nuclei positions and some neural networks. The throughput is tens of thousands of times higher than for DFT. But since the model itself contains little or no physics, the training data has to be very clean and complete.
The Julia community seems to be doing some really cool at the intersection of the 2 fields and it seems like it could be useful if you've already got some kind of pre-existing model/structure to hang the ML part off:
* https://julialang.org/blog/2019/01/fluxdiffeq/
* https://mitmath.github.io/18337/lecture15/diffeq_machine_lea...
Are you computing the labels using DFT, or with a more exact method?
Currently I am using hybrid DFT (wB97X-D) with plans to move up to wB97M-V and possibly Quantum Monte Carlo. The TorchANI group likes wB97X and up-training with DLPNO-CCSD(T).
Like a vim-like editor that translates your spec into generated code while you also see it on the go to fix any issues. Think yeoman on generics and steroids.
Anyone old enough to be in IT in the late 80's/early 90's will remember the "4th GL" phase that swept through Fortune 100 companies.
I was in banking at the time, and 'Focus 4GL' was brought in to replace programmers. Of course, in the end, it turned out to be a fools-errand.
My prediction though is that in less than a decade, ML/AI will be decent enough at developing solutions via client specs for many applications.
I originally got there by making a complex magic data structure that held relations to everything in multiple dimensions so I could generate a huge amount of stuff, but that turns out to be just like 4GL - a load of slow confusion. The reason I am doing it is exactly because of ML/AI hope - with enough data and proper structures, I can generate a lot.
Unfortunately there seems to be a lot of infantilizing in and around the ADHD sphere. Either we're treated like helpless children or we are encouraged to lower our expectations/goals.
It's hard to explain unless you've been open about having ADHD, or have been part of the community. The zeitgeist revolves around accepting and maintaining a status quo. The problem I'm trying to solve is how to build a growth/thriving lifestyle despite an ADHD diagnosis.
- Circus clown/performer
- Microsoft senior engineer (or whatever they call them these days)
- ADHD coach
- A few CEOs
- Product designer
- Habits coach
There are a few more who wanted to stay anonymous, but you get the idea. The most interesting part was how similar all of the success stories were. I think ADHDers have a lot more in common than we think.
I don't expect atomically precise manufacturing (at least in the form of molecular nanotechnology) to show up for at least a decade or two.
But the software to design things that can be built using nanotech can be written before the technology to synthesize them exists.
[0] https://apps.ankiweb.net/ [1] https://en.wikipedia.org/wiki/Spaced_repetition
Anyway, good luck with your project it is very interesting and I'm sure you'll learn a lot!
There is no such official documentation.
Python package: https://github.com/kotartemiy/pygooglenews
Blog post: https://codarium.substack.com/p/reverse-engineering-google-n...
One thing I'm thinking of is that it might be possible to brute-force the semantics of short snippets of code using genetic algorithms. A similar technique has been demonstrated a few times by author of [1].
I want to use this to eventually rapidly search a large number of binaries for insecure behavior. But to do that I need to be able to formulate questions like:
"Find me a function where attacker controlled data is marshaled to a size type and then used to allocate memory, to which a different attacker controlled amount of attacker controlled data is written".
Basically this: https://github.com/Battelle/PaperMachete
I wrote a new programming language, Eek, because it was impossible for me to handle the complexity of doing all with current languages (that lack built-in support for asynchronous database access and parsing). So far the first generation of the programming language is working, but as an interpreter written in TypeScript, and I wrote an English language parser with it, and a simple database. Now I am working on a better, LLVM-based implementation of Eek. I started this thing about 3 years ago, and it will take some more years before this will be even demoable...
The idea is to assign a random 8 or 16 byte number (DdosID) to each connection. The DdosID is unrelated to any other identifier; like the HTTP3 connection id. The client puts the DdosID at the beginning of every UDP packets data section (raw; no encryption or compression.) Packets that have a valid DdosID are processed. Packets with an invalid DdosID are dropped. New connections use zero as the DdosID. Any client can use zero to re-establish a connection or if something goes wrong.
If attackers make random DdosIDs it will result in packets that are dropped before decryption. If a valid DdosID (or hundreds of valid DdosIDs) are used, the volume of packets with that DdosID will make the attack obvious, and the DdosID can be invalidated and the packets dropped.
Attackers will need to spam new connection attempts (DdosID zero) to deny service. New connection attempts could be dropped, or a small percentage allowed when the application can handle them. The rate of allowed new connection attempts could be adjusted very easily and quickly, but a high rate of bad packets would still deny new connections. Existing connections to continue to work.
The challenges are mostly creating functional thresholds: what packet volume is too high? how long is a DdosID valid? Should a load balancer record the IP and Port and to force a new DdosID if it changes?
I would also like to see a way that applications and load balancers can use a DdosID system without it being dependent on the specific application; DdosID should not depend on the protocol it's protecting.
Half of the Indian farmers do not have access to institutional/formal credit. They end of borrowing from local loan sharks at extremely high interest rates. The vicious cycle continues as they do have access to markets favoring their produce's selling price, and end up being exploited.
Most banks, despite their mandated percentage of loan for agriculture, are not too keen (and unable) to work closely with farmers.
## Solution
By leveraging technology, and international connections, we help farmers by giving them access to credit at a favorable interest rate. We work with international community, such as the Japanese, to lend their capital on our platform, thus helping the underserved farmers. In turn, the Japanese investors get returns much higher their national savings interest rates.
Banks too can benefit from our ability to deploy their cash.
## Why Us, Why Now
I have struggled to articulate the philosophy/motto on how to help the farmers, as they are the most exploited populace. I'm zeroing in on -- "BE KIND".
If you want to hear more, contact me and I will send you our Executive Summary and/or Pitch Deck. We are fund-raising.
What more, my history efforts ENDS around 1937; it's the BC part of computing that set the stage. The build up to computing.
Episode 0 lays it all out (http://comphistpod.com/introducing-the-computer-history-podc...)
I'm doing it in podcast form because it's 2020. This is going to be multiple years and I'm totally fine with that.
I divide the history up into multiple facets each with separate timelines.
Currently I'm going all the way through "electric communications" from the electric spark up through relay networks talking about switching, encoding, error correcting, signalling, all the important developments along the way.
In 2021 I'll close that out and do the same for storage (music boxes, looms, etc) and computation, starting with clocks, pascal's mechanical calculator and going forward from there, mechanical registers, overflow, adders, etc...
Each one is going to take at least a year or so.
I'm already about 2 months in to recording, about 6 months into the project. This week will be du fay, boze, desaguliers, watson, and the electric wire. Next week will be leyden jars, this is a long, slow project, and AFAIK it has never been done before.
I'm doing the odd episodes as a timeline and the even episodes as diversions and discussions to keep things entertaining and light.
This is the first time I'm talking about it publicly. It's at http://comphistpod.com
Check out my play from last week for an example of what I mean, http://comphistpod.com/1-4-the-stolen-stars-a-dramatization-... ... this is one of the diversion episodes (which are thematically aligned to the timeline topic in the odd episodes but slightly off the path)
It probably should be paced slowly due to the scope and complexity of material. I think a slower pace should also help "smooth" the exponential change rate of technological progress into a narrative listeners can follow, without sacrificing too much detail for the sake of listenability.*
I'm going to sub right now.
*I listen to a lot of podcasts, and this happens more than it should, IMO.
Edit: I haven't seen a podcast with its own git repo before, but it makes a lot of sense, and I imagine it is immensely helpful as a creator. I took a quick glance to satisfy my curiosity, and the notes I looked at (show notes) were comprehensive and really well done. This is inspiring, no joke; I have renewed enthusiasm for my own podcast-to-be. Thank you for that!
There's also a couple torrents of 17th-19th c. journal articles. I've made my own sqlite databases from the meta information and ran ocr over them to make things searchable.
I'll be putting more of these tools in the repo and eventually put the search systems online for the general public. Google's navigation of annualised volumes is a joke so I'm going to do better.
My dream of dreams is to be able to automatically hyperlink the footnotes in the old texts. I think it's possible, long term project though. (Example: https://play.google.com/books/reader?id=c3QgKCXX4nIC&hl=en&p...)
I've also cleared out a closet and installed acoustic foam. I tested a number of microphones... I'm sure acting like it's a real thing. Hopefully I'll keep at it.
The hardest part has been trying to get it done on a weekly schedule. I don't have this week's done for instance. There's two parts I really want to fit in and I need to find a place for them. I'm going to try to take a nap and get up in an hour or two and work a bit more.
I don't know if I'll be able to pull the weekly schedule off honestly. I'm going to try to sweat it out a bit longer and hopefully I'll get faster as I accumulate more notes, references and materials.
I mentioned that I listen to a lot of podcasts; have been, in fact since ~2006. I've watched the evolution of the medium over the years, have seen many pods come and go, and have witnessed many content creators experiment with different methods of attaining/maintaining/interacting with listeners.
Later on, as the form started to mature and gain more of an audience, the issue of monetization became more and more important and necessary; I've seen many experiments focused on that facet as well. This was still before "podcast" had entered the vernacular for most people I would classify as tech-adjacent--the general public was still not really aware of podcasting. Those who were didn't exactly advertise their listening habits yet, and podcasts were almost like an embarrassing thing one did in private.
You've done so much correctly, at least from my observations over the years, from the get-go.
If some of your ideas come to fruition, it would be a boon to those who'd like to make a podcast of their own, especially if technical or academic in nature. I love the work you've done, appreciate the open distribution of your expanding toolkit, and also want that auto-hyperlinked footnotes a whole lot.
I am doing what I can to encourage you for two reasons. One, I am personally interested in the subject(s) being covered, and I think projects like this are needed if we aren't going to lose a lot to the mists of history in the face of accelerating acceleration, to borrow a phrase. Two, I want the tools for my project and do not possess the requisite skills to make them myself, although I'm working on it.
So, selfish but genuine encouragement...
Do you use any off-browser tools to navigate archive.org / google books? if so which? or the web sites always sufficed?
>There's also a couple torrents of 17th-19th c. journal articles.
Could you expand a bit on this? This sounds very interesting for a project of mine! Where did you find torrents of 17th-19th c. journal articles? It sounds like the copyrights on these would have expired, did you find human curated database of this era journal articles? how comprehensive is it, all journals of this time span?
(one of the things I would like to do is map out the transition from alchemy to chemistry, for example WP states Lavoisier convinced the scientific community that sulphur was an element and not a compound, which sounds utterly bizarre for essentially all of us who were exposed to chemistry as a deductive system without the abductive reasoning that led to it)
>I've made my own sqlite databases from the meta information and ran ocr over them to make things searchable.
That is pretty amazing work!
> I'll be putting more of these tools in the repo and eventually put the search systems online for the general public. Google's navigation of annualised volumes is a joke so I'm going to do better.
Where is this repo you mention?
I’m looking for a good framework to simulate the physics and visualizations.
https://github.com/jaxcore/bumblebee
Although the first release is not officially out yet, the NodeJS code is working and you can install the development version of the app server and try out the hello world app locally.
The solution involves running Mozilla DeepSpeech inside an Electron desktop application with a websocket server and client API that NodeJS scripts can interact with, to receive speech recognition results, utilize "alexa" style hotword commands, and text-to-speech. The electron app handles all the heavy stuff, and you just use a simple API.
A web browser extension can also make use of this API to bring these capabilities to web sites, but that part isn't finished yet.
Web Page <-> Bumblebee JS API <-> Bumblebee Extension <-> Bumblebee Electron App (DeepSpeech)
DeepSpeech with the pretrained english model is enormous (1.4GB) it's not feasible to load it into a web worker. It can run in a server, but then every website would have to run its own server side speech recognition servers which is difficult and expensive to scale.
UX description language for forms that respects high level constraints. Compiles to desktop browser, phone browser, and Alexa layouts.
Solving the complexity of matrix matrix multiplication by brute forcing the lower bound with semigroup combinatorics.
DSL for linear logic.
Ending Iowa’s criminalization of “annoying” speech. (Iowa Code 708.7)
Exposing Polk County Iowa Sheriff Kevin Schneider torturing inmates with denial of basic medical care.
Exposing pure nepotism corruption between Iowa Attorney General Chief of Staff Eric Tabor and his sister Iowa Court of Appeals Judge Mary Tabor (mom of @ollie).
Exposing that the prosecutor on Tracy Richter’s murder trial had relations and ended up marrying the daughter of his star witness Mary Higgins - and that the blood spatter expert Englert is a known fraud who wrongfully convicted David Camm and Julie Ray Harper.
But rather than get into the political/economic/philosophical argument, there might be an individual solution: people don't pay for what takes the most work, they pay for what is in the most demand. These are often not the same thing, and you can leverage that.
The technical aspect is mostly fun in my case :-)
Holiday started on Friday afternoon and this morning I woke up 20 or so minutes ago, around 0230, but I will probably sleep some more around 06-08 to be able to do anything meaningful afte4 my kids get up.
(And that is probably a good tip: If late nights doesn't work for you,try very early in the morning.)
After the twitter account of DDOSecrets got shut down (due Blueleaks), this got me thinking: How would you leak / provide data but are not directly attributable. (At least like a retweet - not your tweet, just amplified.).
And how to add some resilience and protection to the distribution, since there were indicators that the torrent and download of leaked data was being attacked.
So far, I have come up with an encryption matryoshka: you distribute leaks without telling whats in and enable gradually a few to look inside until they are public.
All thats missing is a better document describing it and a command line tool to help to walk through the multi level encryption ... so there is 90% still to do ¯\_(ツ)_/¯.
If it's something that's not of interest to many but you want to put out there for some reason then what's stopping you from uploading it to some random one click hoster and posting the link in random places on the internet?
It’s not that simple.
Keep tables balanced, move players from high numbered tables to lowest numbered tables, try to move players to similar positions, Mark players waiting if they drop in small blind and skip the button next hand.
If you repeatedly flip a coin to either add 2 or divide by 2, what distribution do you approach?
If you have a distribution, what random processes are identities for that distribution? Which are stable? Which will reproduce the distribution from any starting distribution?
It’s related to matrix kernels, but it’s hard to generalize to continuous numbers. I spent a while looking into it years ago and couldn’t find much.
My goal was to eventually take it a step farther and create simple stochastic functions for certain behaviors, such as bistable switches, memory registers, etc.
Indeed, the distribution looks highly discontinuous and fractal. It's a very intriguing question. I suspect thinking in terms of rings (abstract algebra) would be helpful.
[0] "somewhat higher" - I think this is because the sequence "add two then divide by two" gives you back your input when you start with 2, while "divide by two then add two" does when you start with 4; the distribution should peak between these two "stable" points. Exactly where the distribution peaks probably depends on your histogram bin width.
I've programmed in python for much longer than R, and really want to be able to move at the same speed when using python for data analysis :o.
It's a weird problem though because the two languages have basically opposite approaches to DataFrames. pandas has a very fat DataFrame implementation, R an extremely minimal one. (Pros and cons to both approaches).
This is a hard problem. It may not even be perfectly solvable at any time in the future.
When you increase the size of any kind of raster image, you're creating new information from the old.
There's been some pretty good approaches out there, like this [1][2]. It uses a GAN topology for some impressive results, but is incredibly memory intensive and can take a very long time to run.
I've been working on something [0] for a good long while which is a less expensive approach. Instead of attempting to replicate everything 1:1, it intentionally allows some detail loss, whilst attempting to preserve everything important.
It's not ready for the public, and video still needs some significant improvements to remove some of the artifacts. But I've released one TV series upscaled with it [4], thus far.
But as it stands, at x2 and x2.5 scales, it does pretty well, with the average person preferring it to most other resizing methods. It doesn't reach the GAN-approaches quality, but you're looking at an average 12 seconds for upscaling, versus 80 seconds for the GAN approach for the same size upscaling and what people perceive as the same quality.
It already beats most of the traditional resizing algorithms pretty soundly. [3]
[0] https://git.sr.ht/~shakna/upscaler_analysis
[1] https://developer.ibm.com/technologies/artificial-intelligen...
[2] https://arxiv.org/pdf/1609.04802.pdf
[3] https://git.sr.ht/~shakna/upscaler_analysis/blob/master/crus...
[4] https://sixteenmm.org/blog/20200626-Gunsmith%20Hits%20HD
The strace option should be doable. Terminal & timer a bit more work.
So long as the print statements come between other blocks of code, though, I'd look at strace (or dtrace, gdb, etc.).
Assuming Linux/Unix OS.
Let me know what OS / processes you're working with.
I'm much more a shell hacker than systems programmer but this smells doable.
https://www.producthunt.com/posts/cozyroom
And figuring out how to make it easier to write and develop ideas through blogs:
These suits allow to survive for weeks out in the deep desert, by catching and recycling all of the body's lost water. Making sure no perspiration can escape is doable. Filtering the sweat to produce clean, salt-free water should be possible as well - membranes for water desalination do already exist today. To have all the required pumping action provided through walking and breathing is a mechanical problem that should be theoretically solvable. The big, unsolved problem I see, is heat.
The book says that the suit's layers closest to the skin allow the sweat to evaporate and thus provide cooling to the body. But the water then has to condensate again somewhere. From my (limited) understanding of the laws of thermodynamics, the amount of extra heat created through condensation, should be exactly equal to the amount of cooling the evaporation provides making the whole cycle a zero-sum affair. But for this cycle to work in the first place, the skin would have to be of higher temperature then the layer where the condensation occurs. If the desert heat is above body temperature, we'd need some sort of heat pump like in a fridge. Using changes in pressure and density (through a compressor) you could cool the suits' inside below body temperature, while heating the outside above ambient temperature - which is necessary to actually give off heat to the outside.
Those compressors are heavy and powerhungry though, and you'd need additional high pressure water lines through the suit - increasing the bulk of the whole thing considerably. Future technology might be more miniaturized and more energy efficient, but still... Maybe piezoelectric/thermoelectric cooling (exploiting the Peltier effect) would be a better choice for a suit like this. Then you'd have a light inner layer that allows for air circulation - so that the sweat can evaporate on the skin, and condensate again at the thermoelectrically cooled middle layer - where it's collected and pumped away to the membrane filters and catchpockets.
The outer layer of the suits would have to be made of flexible solar cells, in order to provide the electricy required for the cooling of the middle layer. Not sure if that could work though. Those solar cells produce a lot of heat on their own, and they sit right on top of the heat-producing side of the thermoelectric cooling. And the sun burning down on it as well - that's a lot of heat right there at the outer layer. I don't think thermoelectric cooling can overcome that high a temperature difference. It works best, when the temperature difference between the cool side and warm side is pretty small.
How much heat a material can store is called thermal mass or heat capacity. One of materials that can store the most heat per kilogram happens to be regular old water.
I wonder if anyone here could do the math of how many kilograms of water would be needed to absorb the day/night temperature changes of a desert and keep a human body inside at an acceptably stable temperature.
I'm kinda afraid the weight would be more than enough to crush any human into a bloody pulp?
Along the lines of your idea, we've looked at using the CCD array out of desktop scanners with a spiral pattern printed on the crank. But bike bottom brackets are a hostile environment, plus (ideally) we'd actually be measuring the angle against local vertical (i.e. the direction in which gravity sucks).
Our test bike currently runs 4 Pi zeros, 4 Cortex M0s (nRF52), a fistful of 24-bit ADCS, 2 high precision gyros, air pressure/air speed sensors and a 2.4GHz network, all in order to measure realtime CdA. Still unable to crack the angle problem though.
Maybe get it laser engraved into aluminium and mount it... somewhere? Grey code is essentially a more robust spiral pattern, so that's the same idea.
What if you put a roll sensor on the chain instead and infer crank angle from that? Chain slip is rare enough not to worry about it, right? You'd also have more space and could use off the shelf components.
I don't think measuring against gravity will be precise enough to be one in 7200 parts. So you'd need a second sensor for that in any case (and likely already have, don't you?).
We have considered the chain, trouble is both chains and chainrings wear and often cranks/rings aren't terribly-well centred (as fixed gear bike riders know, from variations in chain slack).
For the gravity part we've tested a range of accelerometers; vibration is quite an issue though.
Thanks for the interest!
We've burnt through a pile of MEMS devices, currently working with CRM100 gyro's. As far as I've got is we definitely need a non-contact solution, either optical or MEMS with a once-per-rev index pulse (which obv. needs to be within the same 0.05 degree requirement).
I’m not sure what issues you ran into with the MEMS but my instinct (if I were forced to use them, as they are still rather nascent tech) would be to use multiple physically spread out on a plane and then clean up the signal in software. I’m not sure what price point or “genericness” you’re looking for, my assumption is that you need something that a customer can install or have installed on any bike and you don’t have the luxury of making your own bike parts because otherwise you could basically make it a stepper motor in reverse if you have access to the very axis rather than your device being off-center.
If you can mount something on the shaft itself (externally coupled at the end or by replacing it or other parts) your options become a lot more reliable as you’re in “tried and tested” territory.
Other options (warning: brain dump not thought through) would be an LVDT (see earlier piston suggestion) as they’re basically infinite life, contactless, and can give you micrometer accuracy; if you can somehow determine the distance between two points and have a sensor at a fixed position on each pedal so you can get the distance between them; coating the crank with a reflective substance and using IR sensors to get the distance at arbitrary angles (I’m pretty sure IR raw output can give you the accuracy you seek, though PIR definitely won’t); and a crazy idea based off a tilt switch of using a conductive liquid in a sealed non-conductive cylinder with two strips of differing conductivity on either (long) side, calculating the resistance with a high precision ADC could easily give you what you are looking for but I can’t find any off the shelf parts that do this (which is weird since it seems to be very obvious and is free of moving parts).
Edit: I found a similar thing, but measuring capacitance with a dielectric liquid rather than measuring resistance with a conductive liquid: https://en.m.wikipedia.org/wiki/Liquid_capacitive_inclinomet...
We're been using liquid-level inclinometers for calibration and lab testing, unfortunately they are too slow for use on the road.
LVDT's and similar would be great, however the engineering cost (at bicycle scale) puts them out of reach, which is the same for precision optics for IR solutions. Plenty of $1k+ encoders out there but way over budget for us!
Thanks for the ideas and feedback!
[0] https://www.siliconsensing.com/products/gyroscopes/crm-pinpo...
Simple example, an encoder is capable of 60 degree resolution. I'll mount 5 of these which will all have some variation in phase, and I'd average out to having 12 degree resolution, with variation that could be modeled statistically.
Conceptually I would have a shaft with n different key slots, one per encoder. This would ensure there will be variation as opposed to having the phase be super similar, such as +/-1 degree in the above low resolution example.
You can use Hall effect sensors to sense chainwheel teeth. Two sensors and you can get quadrature and direction. I've done that on a mobile robot. With analog-output Hall effect sensors and some processing, you can get sub-degree precision, although 0.05 degree is asking a lot.
And I created a reverse image search to look up pill data: https://play.google.com/store/apps/details?id=be.harmreducti...
2: developing easy-to-use tools for parametric generative design to enable hyper-personalisation: https://hyperobjects.design
We've implemented recycling maximally and created programs for reuse, repair, toxic waste, general waste reduction, battery disposal, returnables, etc. But it isn't really making a significant impact.
People still spend most of their disposable income buying things they don't need that can't be easily repaired, or that they can't bother repairing, or that they discard due to fashion, or because they are mostly packaging, etc.
We can't get them to stop buying useless stuff that they don't need. We can't stop them from buying new cars every few years.
We can't get them to spend money on quality infrastructure, like insulation, that would reduce their energy needs by about 80%.
We can't get them to stop going to restaurants or getting food delivery or take-out, which expends a multiple of the energy and greenhouse gases of cooking your own locally-sourced food.
We can't get them to understand that we're all going to die in fairly short order unless we bring the environmental disaster under control.
Problem is that much of the problem is systemic and gobal, and w/o addressing that, even good local solutions are ultimately self-defeating.
Jevons paradox, Gresham's law, race-to-the-bottom, etc.
Existing attempts to solve this problem are hackish and difficult to customize: they typically treat each glyph as a set of features and handle diacritics and digraphs by naive composition and awkward special-casing. They also aren't written with an eye to customization in either alphabet or featural model: they typically map an ad-hoc extension of IPA to an ad-hoc featural model.
I think a natural improvement would be to develop a specification language in which each individual glyph (base character or diacritic) is a function from a feature set to a feature set, with Haskell-style pattern-matching to allow graceful handling of digraphs and context-sensitive diacritics - although syntactic sugar for digraphs would in practice be required for usability. Ideally it would also be possible to map feature sets to feature sets, in order to preserve a human-readable intermediate form (e.g. "unvoiced dental plosive") which is later mapped to the more customary binary features.
In addition to the utility for phonological databases and the like, this would also enable more rigorous testing of crosslinguistic feature sets: every feature set is implicitly a set of proposed linguistic universals and existence claims. If two segments have the same featuralization, they should never contrast in a given language; if they do, the featuralization is unsound. And if a featuralization proposes the existence of many contrasts that aren't attested anywhere, it could probably stand to be optimized.
But most of my interest in this comes from my work on a phonological database. The database needs some method of handling featuralization to facilitate feature-based search, and I just haven't seen a good way to do that yet.
Think more in terms or ipfs/ipld.
Politicians/companies spew words and we tend to accept them bc they're "authorities." I believe the best way to increase "skin in the game", accountability, and humble expertise is to predict and have your predictive performance be visible.
There's prediction markets to trade real money with but none that I've seen that ranks your performance against others.
I'm building a platform where it's free to enter/submit predictions in categories of interest. Top ranked players will receive prizes.
I think once players can measure themselves against "authorities" (whose public predictions will be scraped), both will become more accountable.
After predictions, I aim to work on "promises" since they both increase future skin in the game.
If you've read this far, you should consider joining :) - https://oraclerank.com
It's essentially a problem of distributed timers and distributed transactions.
(If anyone has any resources on how similar problems have been solved in the past, I'd appreciate it.)
https://en.wikipedia.org/wiki/Lamport_timestamp
Most also allow for specifying minimum system resources and/or required configurations (for nonuniform clusters).
My live goal is to bring back more programming and design techniques that we as a society used to make the best ps1 and gameboy games and old school animations to the way we are currently developing games. (Any tips and advice how i could help improve the game development industry is welcome. Next year I will be doing my masters so i'm also still looking for a subject for that. The last couple of months I have been experimenting with water color effects in openGL, so I'm looking for something like that)
Though a good Otletian content metadata store would likely be useful.
I’m about 12 years into it and expect I have a couple/few more to go. Hopefully people still use HTML by then.
Just about every company these days has their data spread out all over the cloud: marketing data on Facebook and Google, social media data on Twitter and Snapchat, customer data on Salesforce, sales data on Shopify and Amazon, and so on. Most companies will either (a) hire a team of data engineers to collect and exploit this data or; (b) hire an expensive consulting firm to build an ETL pipeline, or; (c) let this data rot in the cloud. For the past 6 years, I've worked as a data engineer (where I became intimately familiar with Facebook and Salesforce APIs), and I'm confident that I can automate around 80% of my job.
It's clear that the value prop is astronomical: just one data engineer will run you at least 150k/yr and most of the work will involve maintaining API data pipelines. Having a "one-click" solution where one simply provides an API key and what data they'd like to warehouse (e.g. marketing data, social media data, customer data) and where (FTP, S3, Redshift, DynamoDB) would be invaluable to companies that want to make sure they exploit this treasure trove.
Some hard/interesting problems:
- API specs constantly change (Facebook, for example, has a quarterly update schedule)
- Inferring JSON schemas is hard
- Data integrity is hard (data types sometimes change willy-nilly)
- API rate limiting is tricky
- Resilience is hard
- Recovering old data (especially for certain services) might be impossible
Everyone is starting to become keenly aware that letting the data rot is starting to have a higher and higher opportunity cost. Not warehousing your own data is simply not a tenable option any more: the world’s most valuable resource is no longer oil, but data[1].
[1] https://www.economist.com/leaders/2017/05/06/the-worlds-most...
Would you be interested in talking with me about how you're building your system? Email in my profile.
Good Luck!!
We are trying to develop a unified service-building experience wherein the user will be able to punch in their requirements and get a product tailor-made for them, along with the estimated price (which comes with ~10% tolerance). It's tough, but we're getting there.
Problem: Currently, users (or attackers) can easily manipulate the location provided to an app on a phone.
Solution: Use raw measurements from positioning sattellites to check if the location reported by a user actually lines up with the measurements of their phone.
Why is it hard? - Lack of documentation, standardization and support on collecting raw measurements on phones. - Processing raw measurements is tricky - Finding anomalies in this raw data is even harder
Some of it is working - yay! - and there's also a public API, such that others can use it too: https://claimr.tools
This is respecting users privacy and its a feature.
Most importantly, this always requires the user's concent. On Android you still need the same location permissions as for normal GPS location positioning. Hence, as a user you're always free to reject location permissions same as before.
I have to admit, this tech can also be used for evil purposes. For now, not all phones support collecting raw measurements - either hardware or software support is lacking, but in the future if some entity could force you to have your location verified, then having you cannot lie about it anymore.
Right now the tools we have for programmatically reading through code are: 1. Code search, which is fast, but inaccurate/heuristic. 2. Static analysis, which is slow to run and difficult to write, but very accurate.
I'm building a tool that is as fast and easy to use as code search, and is as accurate and expressive as static analysis.
Still just a landing page [0]. Looking to get a public playground people can mess around with this week.
The same principle can also be used to create a real-time software harmonizer [1] for live performances, but this problem already has a reliable solution through hardware.
Also check out Dan Tepfer [1] who is doing amazing work with an algorithmic approach to reactive live performances, with great call and response tactics.
I myself am slowly prototyping a fully artificial AI band which can be orchestrated using very high-level musical ideas and a big helping of intelligent randomization and algorithms based on music theory.
I've been prototyping in Andrew Sorensen's Extempore [2] and have laid much of the groundwork like melody/harmony/rhythm generation as well as basic modulation of these elements to create longer musical structures which utilize motifs in multiple ways
Currently it is a matter of shedding pre-computed tables of "nice" sounding progressions or purely random progressions, and creating a more fundamental approach which can derive the appropriate progressions from the given user parameters. I am also expanding the program's ability to generate aesthetically pleasing and unique singular motifs which drive these algorithmic compositions.
I have a band leader / conductor module which provides cues and other synchronized data, which even without advanced motif generation and modulation still allows for things not currently possible in any non-code musical production software such as global dyamics, timing changes, progression sharing, (eventually) directing impromptu solos, etc.
Reach out via email if you'd like to discuss more!
[0] https://magenta.tensorflow.org/ [1] https://www.youtube.com/watch?v=SaadsrHBygc [2] https://extemporelang.github.io/
What I was planning was something simpler - much like generating sounds from a written score, but like live classical performances, the generated sound reacts to the cues of the player.
I'm not exactly familiar with Magenta, but the thing I'm currently trying to implement (at a very early stage) is Deepmind's Wave2Midi2Wave which is part of the dataset released with Magenta [1]. I'm not aware if they'd released any code as well.
Currently, I am trying to hook them together and come up with basic APIs to control them. Next is printing a 3D model.
On that same concept I was recently thinking pvc pipes might be a cheap way to build robots. It’s cheap, somewhat light, and seems strong enough for many tasks.
Any thoughts on how to connect pvc pipes up to servos?
Also will your robot need feet?
Yes, it will have torso and limbs.
My plan is to do something similar to this. https://i.imgur.com/8QDENyu.png
I have a bunch of tasks I have to complete by a certain deadline — these include things like engineering sprint tasks, drafting a design document, completing an assignment, etc. I have to get these tasks done in between my regular schedule of meetings, lunch breaks, and rests. I want to get a program to tell me when I should work on what depending on a task's due date and priority. If something comes up, I want my schedule readjust to accommodate the interruption.
A positive streak can easily turn into a negative streak.
At the moment I’m brainstorming with a google sheet and a few manual tweaks. I believe there’s a way to help people/myself build a better life by removing the nasty things (like smoking) and grow the nicer things like healthy eating or exercise. But our desire for instant gratification and our lofty goals get in the way.
My proposal is to take out classified ads in newspapers, couching it as a code or puzzle to be solved, and put in dates of major future events you know about. D-day, Kennedy assassination, Challenger explosion, 9/11. Top it off with Murder Hornets and they'll know about when you came from.
I am working on this at the moment, and no, I don't expect that what I write here will convince anyone. And I don't have any summaries of the work at the moment.
As is well known, information theory doesn't deal with the meaning of the messages. As far as information goes, I am primarily concerned with information in the sense of such "messages", and their meaning.
Computation is considered by many to not involve semantics, because it processes information in a "blind, pattern matching" fashion, without regard to its potential meaning. But the sense in which it is semantic does not have to do with its intrinsic characteristics. It it a matter of its "extrinsic" details - how the information states in it relate to details that are (typically) outside of the computation. Seeing the computation as a physical process, processing information "about" details in its environment, highlights this.
The key to all this is appreciating that, once you see semantics and information processing as a matter of physical processes, you can see that the correct semantics can be necessary for producing a physical outcome. So you can analyse how that physical outcome was produced, in order to understand the semantics.
> Seeing the computation as a physical process, processing information "about" details in its environment, highlights this.
Are you familiar with Karl Friston's work on the Free Energy Principle? [0] He touches on how the nature of a living being (computational agent) is to model its external environment and act upon that model. That making decisions based on internal logic requires external stimulus and semantics being analyzed and augmented in sort of a feedback loop.
> The key to all this is appreciating that, once you see semantics and information processing as a matter of physical processes, you can see that the correct semantics can be necessary for producing a physical outcome.
I think I understand what you're saying and it touches on some of my own inquiries. A more concrete example, if you have one, might better help align me with where your thoughts are at regarding this.
I'm working on explaining the fundamental nature of information, and arguing that it is fundamentally semantic. I think there's a lot of confusion about what information theory actually tells us. I don't think it actually tells us about the fundamental nature of information. This isn't to detract from its importance, or to say the theory itself is wrong -- I'm saying that the usual interpretation of what it means, regarding information, is flawed.
> Are you familiar with Karl Friston's work on the Free Energy Principle?
Not terribly familiar with it. I watched the video.
I don't think it gets down to the a precise understanding of the fundamentals. I don't think there is a good understanding of the concepts like information and modelling, that it uses. It doesn't seem to provide specific mechanistic explanations of how the phenomena work and how they have their apparent properties.
As a couple of examples, what explanation does it have of how a system may have an understanding of the character of some entity? Where that entity might be something apparently "abstract" or "imaginary"? If the semantics are about mathematical details, what exactly are they about? What are those mathematical details?
But I don't think I can really hope to explain my position here. It requires a lot of explanation, and I'm still working on the explanation.
>> The key to all this is appreciating that, once you see semantics and information processing as a matter of physical processes, you can see that the correct semantics can be necessary for producing a physical outcome.
> I think I understand what you're saying and it touches on some of my own inquiries. A more concrete example, if you have one, might better help align me with where your thoughts are at regarding this.
Imagine a robotic arm that, when a electrical current is sent to it, reaches out and grabs at an area in front of it. If that current happens when there's an object in that position, then the robotic arm will end up picking up the object. If the current happens when there isn't an object in that position, the robotic arm will have picked up nothing. Thus, the semantics of the electrical current has a necessary causal role in the arm picking up the object. And thus we can analyse the causal details to get a concrete understanding of the semantics and its role.
It's clear that there is a relationship between computation and information via Landauer's principle. It's also clear that it's got to do with nonlinearity of dynamical systems: "The essence of computation is nonlinear logical operations." J. Hopfield, PNAS 79, 2554 (1982).
Semantics: in short, 'meaning' is just a mapping (ie, mutual information) between language and the physical world. https://heteroskedasticblog.wordpress.com/2018/01/13/informa...
Could you elaborate? It's not clear to me what you mean by that.
> It's clear that there is a relationship between computation and information via Landauer's principle.
Information, in the sense I'm concerned with, is an inherent part of computation. You can't have the latter without the former.
> Semantics: in short, 'meaning' is just a mapping (ie, mutual information) between language and the physical world.
That doesn't explain meaning in the case of imaginary or abstract details, or the system's conception of the meaning.
.
BTW, would I be able to get a copy of that Hopfield paper? I wasn't able to find a copy of it.
OTOH, the algorithmic complexity theory (a la Kolmogorov) doesn't really have the same generality as Shannon's theory. Flops is not a well-defined measure of information processing rate for the brain, for instance.
I got inspired by the "integrated information theory" folks -- they have this notion that combining information streams in a nontrivial* way is necessary and sufficient for consciousness. I disagree that it's sufficient for consciousness, but it might be sufficient for a definition of information processing or generalized computation.
> You can't have the latter without the former.
Agreed.
>That doesn't explain meaning in the case of imaginary or abstract details, or the system's conception of the meaning.
The mapping is in our heads. I don't know what you mean by "the system's conception of meaning" -- which system, and what is a conception of meaning?
Here's a link to the paper: https://www.pnas.org/content/pnas/79/8/2554.full.pdf
edit: *how to define 'nontrivial' is very much up for debate. edit2: formatting
In my view, it is more than a change of representation. The computation is using information that might true of something, to produce new information that might be true of something else. I don't see how anything like Shannon's theory could explain how it is able to do this.
> I got inspired by the "integrated information theory" folks -- they have this notion that combining information streams in a nontrivial way is necessary and sufficient for consciousness. I disagree that it's sufficient for consciousness, but it might be sufficient for a definition of information processing or generalized computation.
Ok. I share the same view, that it isn't sufficient for consciousness.
> I don't know what you mean by "the system's conception of meaning" -- which system, and what is a conception of meaning?
The computational system. Consider the case of the human brain, which may be computational. People can understand that some information is about X (say, a particular tree, or the notion of Justice). But it's not just that they know what the information is about, but they understand something of the character of that thing -- of the tree, or of what Justice is like. If the brain is computational, then that would mean that such an understanding was computational (or computational plus bodily interactions with the environment, etc). But that doesn't tell us how it is that computation is able to "embody" an understanding of the character of something. That needs to be explained.
> Here's a link to the paper
Thank you.
Is that the same paper? I notice it has a different title to the one you mentioned above.
So far, I have full baseline feature support for everything back to Mosaic, including Lynx, IE3, Netscape3, Opera3, and many others.
At the same time, still including advanced features like client-side PGP for browsers which will support it.
Every browser presents its own challenges, and it is not always the oldest ones which have the dumbest behaviors.
My intent is to promote interoperability and offer something as an alternative to today's near-monoculture.
It's not the most secure solution, but it's just one of the options.
There are browser add-ons that do integrate PGP.
It's inspired by the CellSol network in the "Left Behind" novels.
Schems and code are at https://www.aaronswartzday.org/lora/ and we could use help.
Getting discussions about these issues to include financial incentives is a weird and hard problem. People are too sure the players (on their team) are alturistic.
It will have all features that WooCommerce have but much stable and easily customisable.
Harder: People
Impossibly hard: Help people get faster at building tech
And yet it's all I want to do.
https://medium.com/@patriarch_39868/donald-trump-detector-ec...
And if you are envisioning an open-source platform, who will run it? Who will vet workers on it, even to the basic level that Uber does (e.g. Make sure they are real people, have a driver's license, and a functioning car)?
Unfortunately that's not an answer he pursues in the book, though others do, apparently.
Currently researching if it's needed and if people would pay for this. Note it's only useful for gaming/cloud gaming, not for other applications.
http://geocalc.clas.asu.edu/html/GAinQM.html
I can't make heads or tails of it myself, but it's definitely off the wall. In particular, his geometric interpretation of the unit imaginary is interesting.
Humans have 1 copy of p53 from each parent and have extended their lifespan so many ways that their one copy of p53 is no longer enough. Lifelong accumulation of genetic entropy is inevitable. The game is to catch the offending cells and kill them.
For now, my team and I are focusing on video-conferences, but the end goal is much larger :)
Now that I think of it, this problem is a lot easier than what others post here.
It turns out semi-supervised document recommender systems aren't easy to bootstrap with zero user data.
Hard problem:
How do we evolve design tools? Can Sketch/Figma be evolved to create full featured software? [1]
Something with no limits, and the freedom to create any feature developers create today with React/Angular/Vue.
Is it possible or a pipe dream?
Building on top of NextCloud was an option I had considered, but understanding their abstractions was painful, and I did not want to tie myself down to their ecosystem.
More importantly, the lack of a mobile-first experience was a deal breaker for me and my family.
The hard problem is multifaceted:
I would argue that open source as we know fails to balance the market. We now have monopolistic tech incumbents in the “GAFAM“ companies, that thrive on open source while paying little tax and outcompeting actual tax paying businesses. I see maintainers either burning out or selling out to venture capitalists.
I want to believe in free and open source, but I also see that it fully enables surveillance capitalism, casino capitalism and tax avoiding monoliths.
So, I realize that I need to move past classic licensing and consider ethical licensing that try to remedy society’s inequalities and injustices.
Call me a cyber hippie, but if I want to build cool stuff in my spare time to share I want to maximize its chances of doing something good in the world. To that end I’m evaluating some ethical licenses.
There are many ethical licenses out there which are evolving. Presently, I’m evaluating this one: The (Cooperative) Non-Violent Public License: https://thufie.lain.haus/NPL.html
After the weekend I’ll try to get in touch with a Lawyer to review the license implications. It’s arguably not open source in definition, but maybe more so in spirit.
Solution : Abstract the problems and automatically generate framework code.
Demo project : https://github.com/imvetri/ui-editor
I'm working on setting up a webserver such that it will:
A) Stay up
B) Stay up to date
C) Stay uncompromised
For the entire time I am gone with no interaction.
Or rather, that's what I want to be working on. Instead, I'm working on making myself not be a lazy [blank].
My email is Shared404 (at) protonmail.com, I'd love to hear your ideas.
This is just one part of one of the sillier things I'm working on/thinking about. How can I make a real-time interactive soil simulation work, essentially a big realistic virtual sandbox.
Since this is a side project, it'll go as far as all side projects go. =)
I don’t know about other parents here, but cracking the code to my 3.5 year old is a really hard problem for me.
Just when you think you've figured something out, spotted a pattern... it changes. Back to square one.
Basically google spreadsheets but not google and not spreadsheets in a webapp.
Haven't done any coding on it, but have been mulling the design for several months now.
And failing to do so.
THE PROBLEM
How do you automate and aggregate context across business departments for various forms of activity, and then map that to marketing analytics in a way that gives relevant and sufficient insights beyond just channel or user data? How do you more fully answer the question of "what happened when [$thing happened]?"
THE VALUE OPPORTUNITY
Countless people hours and marketing dollars are wasted going down fruitless rabbit holes looking for what caused some change, or thinking they found the cause in a change in performance and pursuing that when it reality it was something else. In many of these cases, this could have been easily avoided if only there were sufficient data on the business activities (internal and external) logged and aggregated with marketing data in a way that was then automatically surfaced in an appropriate manner. As the scale of the company increases, so does the impact of this.
WHY IT IS WEIRD/HARD
It's weird in the sense that only a small subset of people are immersed in analytics enough are aware they should care about it, and probably fewer geek out enough about marketing analytics and process to care about trying to solve it. It is hard because it is just as much a people challenge as a technical one. The technical side is somewhat straightforward in terms of aggregating as many data inputs as you can--it's basically a ton of data plumbing and monitoring for changes with that. Whether that's bid management platforms and DSPs or SSPs, email platforms, site analytics, etc. But then also project management tools and properly categorizing the meta data for relevant updates to be surfaced. You have challenges around walled data gardens and comparing apples to oranges around things like attribution measurement, but that is something that can be handled. Surfacing it in timely and sufficiently useful ways is an interesting design and UX challenge though, from annotations and "pull" data, to modals and callouts that are more "push" in how they inform people of context before it bites them.
The people side however, is constantly in flux in a way that the data side is not. Some aspects of this absolutely rely on consistent adherence to process to capture key data that is hard to slurp up through an API. Some of it is quite ephemeral. I've encountered team situations where people object (or struggle to due to limited training) to filling out a couple fields in a Google Sheet, or need to be hounded to fill out a given form, etc. Some companies can enforce this to levels others cannot. Things also get really interesting at large companies (think FAANG). You're dealing with many teams, many overlapping or conflicting processes such a solution would need to be embedded into, localization, internal/external vendors of varying levels of visibility needs, and also personalities who may want more control over their orgs' processes and need persuading.
At the end, this all needs to be balanced against how much utility you get out of the insights because it is easy to over-index on investing in building this tech and process out only to not get insights out of it. Unfortunately you often only learn that after the fact when you've been bitten by it.
If there's any companies trying to solve for this, please do reach out (see profile). I love chatting about it and want to help build the tools and processes that solve for this at scale and have ~15yrs experience in the space, a good chunk of which have been spent trying to solve for variations of this.
They do need worthy competitors, so go for it!
- Of the countries in the world, none are really free, and generally have quite burdensome taxes relative to their benefits.
- Representative democracy has not improved a whole lot from the v1.0 created a few hundred years ago. For example, voting is largely between "person I don't really like" and "person I hate," and you're just 1 vote in millions, meaning voting is irrational (https://en.wikipedia.org/wiki/Paradox_of_voting)
- In referendums, people vote without really knowing much about what they're voting on.
- There's a lot of people who want to move to a better country, but immigration policies are very restrictive.
Solution:
- To create a new country, Sordelia, based on liberty, sortition, and deliberative democracy.
- Laws are voted on based on a small, randomly selected citizen's assembly. The random selection keeps the assembly small, so every vote counts, yet is statistically significant so that, if a law passes, we're highly confident it would've passed before all the voters. This assembly will learn and debate the pros and cons of the proposal before voting.
- Laws that would violate fundamental principles (like freedom of speech) are disallowed.
- We aim to purchase land from a developing country. There are plenty of good reasons they'd sell to us, beyond the immediate payment. The developing population and infrastructure will bring an increase in trade and jobs for their country. There have been many historical examples of special economic zones (SEZs) having positive influence on their neighbors, and Sordelia's effect on nearby countries will be similar.
- We'll have pro-growth and pro-immigrant policies to attract people to our country.
- The rise of remote work makes this even more attractive for moving to Sordelia.
If this interests you, join us at:
1.) How likely is this to actually happen? Are there any talks with nations for purchasing land? How many members would actually uproot their entire lives to go live in this experimental nation?
2.) I'm absolutely a libertarian, but even if I have to admit that some of those that care so deeply as to self-select for something like this are likely to have some... oddities.
3.) Libertarian principles have never been very popular with women, so I imagine most of the interested parties are men. If this were to last for a long period of time, I would imagine that most of the unmarried men would compensate for that by finding wives from the neighboring developing nations. I don't have anything against that, but I feel like this new nation would quickly get the reputation of being Thailand 2.0.
The capital to do it is certainly there.
how can we streamline the transfer of knowledge from the oldest, wisest, individuals on the cutting edge of their field to the youngest, most ambitious sponge-like individuals just starting out their careers?
I built an MVP to solve this at a hackathon: https://devpost.com/software/oravise
anyone interested in collaborating?
Avesnetsec.com
I work for a research hospital.
Why? Because it is cool and I want to learn more about compilers.
As always, abs are made in the kitchen. See: skinny folk
Eating smaller, filling meals helps more. I actually don't know of anyone who's lost weight from salads. Usually they're just left feeling hungry and usually add dressing to compensate (which just gives you completely unfilling calories).
Understanding some basic concepts in nutrition/wellness, such as macros and micros, calories, how Energy Expenditure (keeping you alive, walks, lifting weights, etc) and Energy Storage (Fat, Muscle, etc) all ties in with your unique genetics, body composition and lifestyle goes a long way.
Quick and dirty trick: be at a low Body Fat Percentage and have abdominal muscles (which we all do ha).
I've got a problem that's driving me crazy: find a way to present a huge amount of written (and some visual) content, through a website[1], in an interesting and accessible way.
One of my hobbies is constructing worlds. One world. I've been working on it for over 40 years now. 20 years ago I decided to share my work with the world, and built a website for it. The approach I took them was to divide the site into a homepage, with links to more-or-less self-contained subsections. The solution works, but I want something better. I just don't know how to achieve it.
A wiki-based approach[2] would seem to be the obvious choice. But my experience of wikis is that they feel too, well, fragmented. There's ways of overcoming this (portals, wikibooks, etc) but I tried building a wiki ... it didn't work for what I wanted to achieve.
Another approach could be to give up on building my own site and instead rely on a cloud provider to do all the hard work for me[3]. But I dislike this idea on every level I can think of. For a start, what happens to all my work when the host company collapses, or pivots to a more profitable idea? What happens when I want to introduce a feature - "teach yourself language X" lessons that the site architecture doesn't support?
Of course, if I had all the money in the world then I could employ many very clever people to design, build and develop content for a truly wonderful user experience[4][5][6] ... yeah. That's not gonna happen. So the solution needs to be "doable".
Any ideas on how to solve the my problem will be very gratefully received!
[1] - http://www.rikweb.co.uk/kalieda/index.php - My constructed world's current website. I used to be very proud of the site's structure and design. But I know in my hearth it can be much better!
[2] - Encyclopaedia Ardenica - https://www.otherworldproject.com/wiki/index.php/Main_Page - is a really nice example of what can be achieved with a well-thought-through wiki.
[3] - WorldAnvil - https://www.worldanvil.com - seem to be the leading example of this approach.
[4] - The Potterverse - now at https://www.wizardingworld.com/ - seemed for a while to be a Gold Standard for wonderful fantasy world websites. The Pandoran Research Foundation [5] (https://www.avatar.com/) is another excellent example. But even here, their Pandorapedia [6] (https://www.pandorapedia.com/pandora_url/dictionary.html) ... it feels like it could be so much better - but how?
And even if you do manage to see them, sorting out how to intervene effectively --- where and when and in a manner that actually helps --- is still a Hard Problem.
I've lost a few friends this way. One I managed to intercede with. The first time....
Thank you for trying.
I'm learning a lot about audio engineering and wave mechanics.
( I also co-wrote a story about what happens if I fail, which you can read at https://emlia.org/pmwiki/pub/web/LeftBeyond.TalesFromTheBeyo... )
I'd prefer coherent light, of course, but if audio engineering does the job, I'll take it.