HNHacker News
TopNewBestAskShowJobs

convivialdingo

608 karma · joined May 16, 2014

$ openssl aes-256-cbc -d -a -k convivialdingo U2FsdGVkX1/RqrjOPvbJ7AJ5er1IZwLqgTyW49oBRrhozxRbI6rMoH3lkyO27zy7 7QswjRxCFcs4lti81teb99LgS1UK3UVUoJOoTJ+YMcTi07GJLvZGSNfGtTzEYNK5 UVMICrU+h2uDFaHbCq62SVV5iAusqnD/vFDtzWPEJDnB1+77NTL275cw9OxTDJ9b HTuSeMFPEi6k8vC7i39b5KEpIdhxLSLzpPqENY2O30I=
submissionscomments
convivialdingo··on Demystifying Text Data with the Unstructured Python Library
Hey, that's fantastic. I'll definitely check that out.
convivialdingo··on Demystifying Text Data with the Unstructured Python Library
I've had good luck with python-docx for reading word documents (typically specifications). Tables are supported - but it's not obvious where the table comes from in the document and I had to come up with a hack way to read image captions.

PDF has been hit or miss, but pypdf has improved in the last couple of years. Depending on the document you'll sometimes get random spaces or nospacesatall.

convivialdingo··on Demystifying Text Data with the Unstructured Python Library
I second this suggestion. I tested numerous Python tools to extract text - nothing matches Tika for general extraction of just about any data format.

However - if you can expect a certain format beforehand - then Python is better since you can extract higher-quality data (tables, lists) with the appropriate tool.

convivialdingo··on Jim Keller on AI, RISC-V, Tenstorrent’s Move to Edge IP
We're having great luck running Yolo 8 models on cheap intel n5105 boxes. 8gb ram, 256gb SSD, USB3 for ~$150... Ubuntu running ONNX gets us 600ms per frame. Not great, but good enough for now.
convivialdingo··on Ask HN: What are some good resources for learning about low level disk/file IO?
Read the Unix books, LWN, the kernel mailing list - It's definitely a good way to start out to get the fundamentals.

A good start on device drivers (old 2.6.10 kernel but still good): https://lwn.net/Kernel/LDD3/

Operating Systems: Three Easy Pieces - Files and directories: https://pages.cs.wisc.edu/~remzi/OSTEP/file-intro.pdf (Another great book from an OS perspective with some userspace interactions)

A thorough Linux internal engineering book is: https://mirrors.edge.kernel.org/pub/linux/kernel/people/paul... (The bibliography has tons of links on topics you might be interested in, Chapter 7 on locks is great)

I recommend implementing a basic key/value single table "database" in C/C++ and then add threading/multi-process interfaces so you can mentally figure out all the pros/cons. It's not technically "hard" and you'll learn a lot.

convivialdingo··on Digital Audio Workstation Front End Development Struggles
Yes, another immediate mode / retained hybrid GUI toolkit is NanoGUI. It uses NanoVG under the hood (which is used by a few DAWs already).
convivialdingo··on Amazon packages burn in India, final stop in broken recycling system
Waste-to-energy plants have been utilized for a couple of decades in Sweden. There's several new plants in the USA.

I think it's more likely that regulated and aggregated pollution management will be at least somewhat successful. These plants will buy up vast sums of waste that would otherwise often get into the environment and oceans. Honestly with good air scrubbing it could replace many of our coal plants with better air quality outcomes.

convivialdingo··on Managing and using ONVIF IP cameras with Linux
Hanwha makes a ton of different makes and models, I highly recommend them. I tested several cameras to use them in a campus-wide AI project and Hanwha was always rock solid. We originally looked at Chinese cameras, but with security and international trade disruptions we needed better assurances that orders would get filled.
convivialdingo··on New documents reveal scale of US Government’s cell phone location data tracking
Agreed...

Pure conjecture on my part, and I haven’t worked in this area but I had lots of friends in gov security and mobile standards groups.

Nobody I’ve talked to thinks it’s possible to stay anonymous on any commercial cellular network.

You might be able to push a few anonymous phone calls or surf a few hours but soon your typical browsing habits, app usage and contacts will match you up with similar existing profiles based purely on the metadata.

Honestly just narrowing it down to a few dozen people is good enough to get unmasked.

convivialdingo··on Show HN: I wrote a local-first notes app for Mac, with data longevity in mind
Congrats, looks great! I'm a huge fan of notes in general and I use a few different apps. I love the idea of quick linking and tags. Layout is polished.

I'll definitely have to try it out.

convivialdingo··on The Big Escape: How the Ultra-Wealthy Avoid Paying Taxes and How to Fix It [pdf]
Perhaps it could be a form of distributism? Basically we could rather promote legal entitlements to workers in the share of wealth generated by companies and labor.

There's an interesting google talk on this from long ago. https://www.youtube.com/watch?v=X1PtStipIsc

convivialdingo··on Rqlite 6.0: the evolution of a distributed database design
Very interesting... Does it support full text search? I scanned a little bit but didn’t find any info either way.
convivialdingo··on Powerful AI Can Now Be Trained on a Single Computer
You aren't wrong - we've vacillated between personal and cloud(mainframe, shared, or centralized) for many years now and it seems that we'll probably continue on this hybrid approach for a while.

Personally I prefer to own my own compute, my own storage and my own hardware. Cloud isn't any cheaper in the aggregate long-term, but it does spread risk and costs across a longer term.

Considering everything I'd rather own the risk and up-front costs just for my own privacy and self-determination.

convivialdingo··on Apple, ARM, and Intel
A French friend of mine was recently denied a visa to Canada. His wife got a job there working in public policy, and he was going to work there in software (film industry). I figured it would be easy for him, but it's a mess!
convivialdingo··on Apple, ARM, and Intel
I don't disagree with this sentiment - we do tend to overly fund existing industry such as air, space, energy.

As far as new investments though, China arguably picks their winners and has learned valuable lessons in boosting manufacturing from garage to factory. Their lead in solar manufacturing was astronomical.

The US have also done this, look at how Boeing, HP, Intel, the Auto industry and others had their start. Lots and lots of loans and grants.

If anything our policies are overly conservative and careful with new investment, investing heavily in the "idea factory" models surrounding higher education and subsidiaries. Fortunately that's also led to a large and mostly competent investment community that is willing to bet the farm on new companies.

Comparing the industrial & investment growth to industry in Europe and the ME has informed my view that we do a pretty decent job. Corruption is there, but it isn't the norm that I've see in other parts of the world.

convivialdingo··on UtahFS: Encrypted File Storage
Awesome job! I prototyped a very similar FS for IBM Research a few years back, but I like your design better! They used it for Hadoop.

Love the crypto fs work you're doing at Cloudflare.

convivialdingo··on The missing Samsung EVO 840 – 250 GB SSD Repair Manual [pdf]
This was far more in-depth than I expected. Interesting read if only for the hardware/software interfaces.
convivialdingo··on Ask HN: Sci-Fi with advanced morals and ethics, not just technology?
I don’t really know, hopefully someone has a few more suggestions! Tossing these in as interesting SciFi with morality.

Michael D. O'Brien, Voyage to Alpha Centauri: A Novel

Oxanna Hope, Lebenstunnel: Allégeance (French language)

convivialdingo··on Speeding up Linux disk encryption
Did this commercially for 15 years. Always the same problems.

We ended up with several solutions- but all of them generally work the same conceptually.

First off, separation of I/O layers. System calls into the FS stack should be reading and writing only to memory cache.

Middle layer to schedule, synchronize and prioritize process IO. This layer fills the file system caché with cleartext and schedules writes back to disk using queues or journals.

You also need a way to convert data without downtime. A simple block or file kernel thread to lock, encrypt, mark and writeback works well.

Another beneficial technique is to increase blocksizes on disk. User Processes usually work in 4K blocks, but writing back blocks at small sizes is expensive. Better to schedule those writebacks later at 64k blocks so that hopefully the application is done with that particular stretch of data.

Anyway, my 2 pennies.

convivialdingo··on MIT to no longer consider SAT subject tests in admissions decisions
I don’t think that gap is huge in terms of internet access - there’s certainly a gap but it’s mostly a function of parents limiting access in my experience.

84% of teens have smartphones in the US. A large percentage of that remaining 16% have access to internet at school, as 98% of schools have broadband internet.

convivialdingo··on An Open Data Clinical Trial for Covid-19 Prevention
>>> Background A recent well controlled clinical study conducted by Didier Raoult M.D/Ph.D, et. al in France has shown that 100% of patients that received a combination of HCQ and Azithromycin tested negative and were virologically cured within 6 days of treatment.

In addition, recent guidelines from South Korea and China report that hydroxychloroquine and chloroquine are effective antiviral therapeutic treatments for novel coronavirus.

convivialdingo··on Italy and South Korea virus outbreaks reveal disparity in deaths and tactics
Now you’re just being intriguing... I have to know now.
convivialdingo··on How to Build a Thrust Vectored Model Rocket [video]
Agreed! Also just a fun topic.
convivialdingo··on AvastSvc.exe contains a full, unsandboxed JavaScript/DOM implementation
Thanks for bringing some facts to the discussion.
convivialdingo··on The iPhone 11 Pro’s Location Data Puzzler
Two reasons that come to mind.

1. Emergency services

2. Road Traffic analytics for mapping.

Emergency services aren’t supposed to ever be disabled, if I remember the specs.

convivialdingo··on Show HN: 8086/8088 assembler that runs over 8088 hardware with modern syntax
Very, very cool! I love the fact that you used an 8086 C compiler to make the whole toolchain work.
convivialdingo··on Smart TVs sending sensitive user data to Netflix and Facebook
I think a significant percentage of flyers don’t bother with flight mode anymore.

Was on a full plane from CA to TX a while back. During the final landing approach I heard dozens of alerts as the plane got nearer to the ground.

Nobody cared one bit.

convivialdingo··on Algorithm No One Knows About (2016)
I know this, as I work in crypto.

But I’d have never considered using it for this - it doesn’t register in the brain as anything other then crypto.

Awesome solution, thanks for hacking my brain.

convivialdingo··on Goodreads Is Broken
I just want to be able to find books with keywords. I often forget the title of books, but I can rattle off a summary.

Google books has gotten worse also - to the point of useless unless you have a quote or are looking for common titles.

convivialdingo··on A Gambler Who Cracked the Horse-Racing Code (2018)
Ante is how I learned it. Latin for “before”
← PreviousPage 3 of 8Next →