HNHacker News
TopNewBestAskShowJobs

j0e1

703 karma · joined July 2, 2014

Extremely low-resource NLP. mail at joelmath dot io
submissionscomments
j0e1··on Southern California just saw its longest streak of bad air in decades
Looking outside of my window, I've seen the haze/fog/smog, but can't make out if it's because of polluted air or if it's just condensation- the kind you'd expect to see in high altitudes.
j0e1··on Progress update from the Librem 5 hardware department
>* I don't know how much Apple and Google spend annually on outside security research for their flagship phones, but it's a lot. Who has Purism engaged to evaluate their designs and spot flaws?

At its inception you could make the same argument for most open-source projects which usually don't start decked out with cash. But most trusted and respected projects of today (especially in comp sec) are open-source as a prerequisite.

j0e1··on Progress update from the Librem 5 hardware department
Would PureOS support Android APKs? I think that is something I'd need to consider before making a leap.
j0e1··on Radical open-access plan could spell end to journal subscriptions
These are great! Thanks for pointing them out!
j0e1··on Radical open-access plan could spell end to journal subscriptions
Does anyone know of any open-source arXiv like frameworks that can be self-hosted?
j0e1··on Modi’s Cash Crackdown Failed, Indian Bank Data Shows
Please don't make claims that are backed by your anecdotal experience of noticing people attending churches. I find this ridiculous. Though I don't deny there have been such cases reported in the past, to say some groups attend church because of money is unfounded and adds fuel to the fire by worsening the already tense religious atmosphere [1] the Modi govt. has created and based its campaign on.

I really wish the govt would show more interest in the plight of the 'lower' caste rather than just seeing them as a vote bank.

[1] https://www.theguardian.com/world/2015/feb/24/india-modi-rel...

j0e1··on Modi’s Cash Crackdown Failed, Indian Bank Data Shows
> To some degree, the banking sector did benefit. In the wake of demonetization, millions of Indians opened their first bank accounts.

> But not all of that is attributable to Mr. Modi’s efforts.

I think you give him too much credit in saying that.

j0e1··on Where Vim Came From
That's a great idea! As of now there are already 460 responses :)
j0e1··on Where Vim Came From
> While Emacs certainly still has a following, some people think that the Editor Wars are over and that Vim won.16 The 2018 Stack Overflow Developer Survey suggests that this is true; only 4.1% of respondents used Emacs.

I'm an Emacs user for years now and love the editor. But I'm curious about this claim of its poor popularity. The article refers to a piece from http://www.linux-magazine.com/Online/Blogs/Off-the-Beat-Bruc... which bases its arguments on two surveys from 2013 and 2014.

Does anyone know of a credible way to measure the popularity of Emacs and what the usage trends are in 2018 other than SO?

j0e1··on Spectrum internet is getting kicked out of New York
AT&T fiber doesn't offer services in my area. Calls with them is another story.. After booking my connection with them twice and them not doing anything about it, they finally tell me that they can only provide a satellite connection which doesn't meet my speed requirements.
j0e1··on Spectrum internet is getting kicked out of New York
> I hope NYS can work something out or I'm going to have to move.

I share your sentiments.. In my mind decent internet access is more of a right than an accessory today. Those without it are disproportionately disadvantaged in numerous ways. I can imagine doing something drastic, in protest, if I'm pushed.

j0e1··on Spectrum internet is getting kicked out of New York
My spectrum bill rocketed after the 1st year and after numerous unpleasant long calls with their representatives, I haven't been given any viable option. They keep forcing me to take their cable connection which would 'lower' my rates for the internet connection but I would end up paying them more than for just an internet connection.

The saddest revelation through all this is that I couldn't find any other provider in my area (DTLA) which can promise me 100Mbps. I'm stuck with them and I'm not a happy customer! I so wish there were other competing ISPs in this area..

j0e1··on Learn just a little Awk (2010)
Sure. I'll explain the code and hopefully you'd find enough clues to adapt it for your use-case which, from what you've described, is a subset.

Intent: Given a folder with multiple text files of academic papers from PubMed, remove the contents after the '====Refs' header. Then in each file find occurrences of any term in a keywords file and extract it along with 400 chars before and after it. Print this output as a tsv.

input: $1) A text file containing keywords of interest that need to be searched in the files separated by `|`.

$2) File containing paragraphs of lots of text with headers starting with '===='. There isn't a formatting requirement really. Just that, in my case the files happened to be so.

    # Note: Awk string commands have indexes that start with 1 (not 0).
    # The first Awk command just removes the newlines in file $2 and replaces them 
    # with space. `pat` contains the contents of the file $1: 'keyword1|kewword2|...'.
    # --re-interval allows use of, well, regex intervals.
    awk 'BEGIN { ORS=" "} { print $0 }' $2 | awk --re-interval -v pat="$1" '
	{
            # both variables are initialized with full-content of text file 
            # with the part after '==== Refs' removed.
            cut_content = substr($0, 1, match($0, "==== Refs"))
            orig_content = substr($0, 1, match($0, "==== Refs"))
            
            # index (could be better named as offset, but life is too short to refactor).
            idx = 0
            
            # match the keywords, even if it appears between non-alphabet chars.
            # e.g -keyword1. is a match.
            regex = "(^|[^a-zA-Z]{1})" pat "([^a-zA-Z]{1}|$)"
            
            # loop until matches are found.
            while (match(cut_content, regex)) {
              
              # RLENGTH is the length of the matched keyword.
              if (RLENGTH > 0) {
                 
                 # set the matched keyword to the variable `prot`. 
                 # RSTART is the character position of the matched keyword in the file. 
                 # This is the first occurrence of it in the file when read from the start.
                 prot = substr(cut_content, RSTART-1, RLENGTH+1)

                 # clean-up punctuation and/or space from the beginning and end of `prot`.
                 gsub(/[:punct: ]$/, "", prot)
                 gsub(/^[:punct: ]/, "", prot)

                 # print the `prot` and 400 chars before and after it using idx
                 # as an offset. Separate the results by tab char.
                 print prot, "\t", substr(orig_content, idx+RSTART-400, RLENGTH+800)

                 # update offset to character position right after the current matched keyword
                 idx += (RSTART + RLENGTH -1)

                 # cut-out all the text up until the position of the 
                 # last matched keyword (including it) and on the remaining text
                 # repeat the above steps in the loop. This is so that the search
                 # continues throughout the file and doesn't keep finding the same
                 # keyword over and over again. See `while` condition.
                 cut_content = substr(cut_content, RSTART+RLENGTH)
              }
	    }
        }'

Edit: Formatting. HN doesn't wrap text in code-block.
j0e1··on Learn just a little Awk (2010)
Here is an Awk program (not a one-liner) that extracted select snippets of text from lots of docs and worked almost 10x faster than a grep equivalent:

   awk 'BEGIN { ORS=" "} { print $0 }' $2 | awk --re-interval -v pat="$1" '
	{
            cut_content = substr($0, 1, match($0, "==== Refs"))
            orig_content = substr($0, 1, match($0, "==== Refs"))
            idx = 0
            regex = "(^|[^a-zA-Z]{1})" pat "([^a-zA-Z]{1}|$)"
            while (match(cut_content, regex)) {
              if (RLENGTH > 0) {
                 prot = substr(cut_content, RSTART-1, RLENGTH+1)
                 gsub(/[:punct: ]$/, "", prot)
                 gsub(/^[:punct: ]/, "", prot)

                 print prot, "\t", substr(orig_content, idx+RSTART-400, RLENGTH+800)
                 idx += (RSTART + RLENGTH -1)
                 cut_content = substr(cut_content, RSTART+RLENGTH)
              }
	    }
        }'
j0e1··on How to Pose for a Photograph
Is it just me or are the HN comments link increasingly returning an nginx error page?
j0e1··on Andy Rubin Puts Essential Up for Sale, Cancels Next Phone
I was really looking forward to the PH-2. For me their USP was that the phone had no logo and that they sold them as being non-affiliated with any big corp software-though that may not be entirely true, it did raise my hopes of replacing the software with something more 'open' and just benefit from good hardware (easier said than done).

I think this a sign I move to a dumb phone.

j0e1··on In India, high-pressure exams are creating a student suicide crisis
Having gone through the system, my two cents:

The exploding population of India has put a huge pressure on the public infrastructure. Any credible university/college (because of numerous swindling orgs) which usually means govt. run has a flood of candidates, the IITs being the archetypal example. Add this to the social pressure put by the definition of success according to the culture and you've got yourself in an Indian pressure cooker[1] which shapes you to perfectly fit the mold of the educational system- effectively quenching creativity.

I wouldn't generalize though. The smart still are able to wiggle through and come out the other end without selling their soul. But the opportunity cost for the others who would have excelled given better instruction and infrastructure is unfathomable.

[1] https://en.wikipedia.org/wiki/Pressure_cooking

j0e1··on Lessons Learned Reproducing a Deep Reinforcement Learning Paper
I've been facing similar issues recently and have been slowly drifting towards similar ideas mentioned in the article. Though, coming from a more traditional software dev background, I'm still in the process of internalizing how the popular start-up mantra-'build fast and fail fast' doesn't really work in ML.

Also, logging every experiment is another discipline I'm teaching myself. And I fell in love with org-mode in the process.

j0e1··on China Bans Online Bible Sales as It Tightens Religious Controls
A bad comparison indeed.
j0e1··on The oddness of Isaac Newton
> .. worthy insights ..

I'm curious how you would define that. As far as I understand, Newton's life was definitely colored and shaped by his theological pursuits-questioning their 'worthy'ness is raising the more fundamental argument of faith.

j0e1··on The special data device SpaceX’s Falcon Heavy sent to orbit is just the start
I was intrigued recently reading a relevant blog post by Stephen Wolfram that made me think a lot more about this topic. Here is the link for those interested:

http://blog.stephenwolfram.com/2018/01/showing-off-to-the-un...

And its discussion on HN: https://news.ycombinator.com/item?id=16269500

j0e1··on Mary Lee Berners-Lee has died
While not meaning to take away from the focus of the article and not in any way intending to disrespect Ms. Berners-Lee, I just wanted to point out this solicitation at the end of the article by the Guardian:

>Since you’re here …

>… we have a small favour to ask. More people are reading the Guardian than ever but advertising revenues across the media are falling fast. And unlike many news organisations, we haven’t put up a paywall – we want to keep our journalism as open as we can..

I'm a bit heartbroken to read this mainly because I feel this isn't really sustainable in the long run. While, at the same time, I don't have a silver bullet to offer. (I did make a donation though)

j0e1··on A CEO's Guide to Emacs (2015)
Just curious.. How do you type-in whitespace?
j0e1··on GNU nano 2.9.0
'xyzzy' was also what enabled cheat-mode in Road Rash[1]. Ah.. good 'ol days..

1: https://en.wikipedia.org/wiki/Road_Rash

j0e1··on Hacker News News Feed for the Mac Touch Bar
I did the same and now it has revolutionized the way I accidentally put my laptop to sleep every 30 minutes.
j0e1··on Bank of America is looking for Ethereum developers
I can't in any way see how this ad means they are looking for 'Ethereum developers' other than it being a desired skill. Please refrain from posting misleading titles to articles.
j0e1··on ECMAScript 2017 Language Specification
> Kindly note that the normative copy is the HTML version;

Am I the only one who finds this ironic..

j0e1··on What is so ‘scientific’ about Sanskrit?
Reason and truth are so refreshing to the ear! I commend you for being objective on this topic.
j0e1··on Ask HN: Do you still use browser bookmarks?
Oh yes! I use them in FF and have organized them in folders with tags for hassle-free retrieval across devices.

I find them extremely useful for tutorials/learning new stuff which I know I need/want to learn but just don't have the time at the moment. Whether or not I end up coming back to them is a discussion for another day ;)

Most of my bookmarks are via HN.

j0e1··on Ask HN: Which non-technology book has influenced you the most and why?
Epistle to the Romans.

Helped me wrestle and come to rest with many conflicting thoughts and ideas that were ultimately attributed to my lack of knowledge in those. I highly recommend reading in a modern translation like ESV.

← PreviousPage 3 of 4Next →