HNHacker News
TopNewBestAskShowJobs

cmollis

419 karma · joined September 21, 2012

submissionscomments
cmollis··on Ask HN: Books that compelled you to go down a rabbit hole study of the topic?
Unix Network Programming - Stevens. (this is kind of a classic book on the subject.. but at the time, I had never heard of it).
cmollis··on Two Weeks at the Front in Ukraine
agreed. excellent read.
cmollis··on Was there a tech-hiring bubble? Job postings data suggest so
"..so many of the programs you depend on are written by dicks and idiots." Man, I've written a lot of programs..
cmollis··on Big data is dead
we regularly run audits on over 12 years of customer order histories. This requires scanning of about 40TB of data and growing. They used to jump through hoops on the Oracle cluster just to get data out for one customer. We pushed all of the order history into s3 parquet using Spark and I can query this in about 20 seconds using Spark or Presto. It's now streamed through kafka and Spark structured streaming so it's up to date in about 3 minutes. The click-bait-y title notwithstanding, I get that not all data is 'big' and duckdb (and datafusion, polars, etc) is probably great for certain use-cases but what I work on every day can't be done on a single machine.
cmollis··on Ask HN: You're an “experienced” developer. What's your story?
I went to school in 80's and graduated with a BS in CompSci/Math minor in 1990. I was originally a 'Business' major but quickly realized that the only class that didn't completely bore me was Calculus. I don't know why, I was never considered 'good' at Math, but I realized that I actually understood it and enjoyed the fact that I could get the little 'algorithms' working. I switched to Comp Sci because I thought I could probably get a decent job at some point with it, but had no idea if I could handle it. I also found that I enjoyed my Math and hardware classes more, but wasn't sure what I could do with a Math degree (remember: no internet, no 'data science'.. ). I really kind of dreaded my pure programming classes, tbh. I took a couple of electives in AI (expert systems in Prolog, and a Lisp class) which actually got me a job with an oil company who was doing pricing with Expert Systems (you probably don't know this, but 'AI' back then was (also) a relatively big business.. there were a few companies doing expert systems, and neural networks ). Anyway, after about 6 months, they canned the initiative and no one heard of AI again for another 20 years ;). I moved on to doing C/C++ development.. then windows client/server development for another 5 years. The Web/Internet was becoming a thing at that point, so I started working in that.. I was a consulting technical project manager on a large consumer e-commerce app for selling CD's online. That led to many engagements building similar apps using a new language (Java) and 'application servers', for other media companies. Then digital distribution was becoming a reality in the late 90s'.. I worked on the secure initiative of Napster for about a year.. building low level C servers, cryptography, etc. Fantastic experience. That led to development of an open-source rights management project for mpeg4 a/v.. now defunct. Anyway, got married, kids, divorced.. Now I work with a large Media company managing big data initiatives. I'm not sure if the decisions that I made were right for everyone.. I closely followed industry trends (languages, frameworks, etc), and tried to get engagements that allowed me to work on them but always at a lower level..I felt I wasn't smart enough to understand impact unless I knew all of the details.. consequently, I've always been employed, but always on the execution. I rarely got a chance to articulate strategy.. not sure if that was the best choice. IT is a difficult business.. always on, always moving ahead.. lots of energy/time spent trying to stay relevant, given how fast the industry changes. Tougher in your 50's, because it's perceived as a young man's game. The rates of change are also a good thing.. the pace of innovation is frankly unequaled in other industries.. and I get bored easily if I'm not challenged. I have such a breadth of experience that I can easily solve problems that are multi-faceted because I've seen so much. Younger developers, although extremely bright, simply don't have the experience to understand all of the idiosyncrasies of each toolset/framework used at a typical company. That comes with time, of course. Being the 'OG', they come to me.. which I guess is good. I don't know if I have any 'triumphs' per se.. no billion dollar paydays.. I have a series of smaller triumphs.. ones that were important to me. Each new system deployed, each new technique, or language learned, generally any challenge achieved, is a triumph for me.. but they're all personal though. I did have a chance at a buyout from a larger company once that I didn't take.. that is something I think about. Things would have probably been very different for me today, if I took that. I regret not focusing more sometimes on my personal life, since the job was all encompassing (at least that's how I naively perceived it).. but looking back it didn't have to be. I was so afraid of failing in one area, that I didn't focus on other important areas that eventually took a serious toll.
cmollis··on Ormlite: An ORM in Rust for developers that love SQL
very nice.. was about to start integrating sqlx from mysql_async.. but maybe I'll try this instead.
cmollis··on Java is Dead – 5 Misconceptions of developers that still think Java is relevant
written by a self-proclaimed 'productivity guru'.. jesus.
cmollis··on I deleted all my social media 3 yrs ago and I hardcore regret it everyday
I didn't delete my Facebook account, I just don't ever look at it. I find a certain subversive delight in knowing that people might be sending things to me that I just ignore. Deleting your social media presence is a strident, overt act.. signaling a type of desperation, IMO. If you really want exert an level of control (or perhaps a more humble 'f you'), stop looking their dumb, time-wasting pictures and posts. Like having booze in your house that you don't drink. I never spoke to most of 'my friends' anyway.. it's clearly more fraudulent to keep up the facade of interest. Social media has some utility (and I also realize I'm probably the minority here_, but it's gone way beyond that now is mostly mindless chatter, reduced to either bragging or complaining (two things I abhor). I'm not 17 anymore, and I really don't care what 'my friends are up to'. I already know.. nothing really.
cmollis··on Demystifying Apache Arrow (2020)
completely agree with this. Rust and arrow will be part of the next set of toolsets for data engineering. Spark is great and I use it every day but it's big and cumbersome to use. There are use-cases today that are being addressed by datafusion, duckdb, (to a certain extent, pandas).. that will continue to evolve.. hopefully ballista can mature to a point where it's a real spark alternative for distributed computations. Spark isn't standing still of course and we're already seeing a lot of different drop in C++ SQL engines.. but moving entirely away from the JVM would be a watershed, IMO
cmollis··on Ask HN: Did learning a specific programming language make your thinking better?
I think the mindset shift is when you stop dealing with single instances of anything and begin to think about their groups, relationships, constructions, data flows.. functional programming (and immutability) allows you to (eventually) write things faster.. you have to play around a lot with lists of things before it starts to click in.
cmollis··on Ask HN: Did learning a specific programming language make your thinking better?
I got into functional programming by programming in Scala.. this allowed me to begin to decompose problems that I would have normally used a bunch of hacky loops using the type system and transformations like flatmap, fold, map, etc. This really becomes useful when dealing with async compositions.. which Scala has excellent support for. I'm not an 'expert' at Scala (or anything for that matter), but this also helped me greatly when moving into Rust (which also has excellent functional capabilities and is similar to Scala in that way, IMO).
cmollis··on Ask HN: Why did AWS suddenly restart our Aurora database?
and they will do this any time.. for us, it was because they detected a HW failure and their automated management replaced it and rebooted the cluster. Our obvious complaint was that we wanted a heads-up before this happened.. they indicated that in certain situations, this wasn't possible (BS). So after a lot of back and forth, they relented and agreed to address proper escalation.
cmollis··on Ask HN: What is the thing you've built that you regret the most?
openIPMP (https://sourceforge.net/projects/openipmp/). At the time (2002), we were trying to jump start legal content consumption foolishly thinking that providing a POC DRM system might generate either real services/debate. We thought providing an infrastructure that demonstrates rights management within (the great MPEG4IP project) would facilitate this. We tried to implement some 'standards' MPEG-21, ISMA, MPEG4.. but at the end of the day I think it was just a dumb idea. We got some free press, even some consulting work out of it.. but it wasn't very good and we weren't going to move any needles with it. I learned a lot about mpeg4 a/v and built a cool rights store in PKCS12.. but we spent over a year on it and it ultimately went nowhere...
cmollis··on The Unison language – a new approach to Distributed programming
spark is great for distributed computation.. also has about a million config switches and is generally kind of 'bulky'. EMR makes management a lot easier, but you still have to fiddle with num executors, memory, etc. But it has been 'through the wars' and is generally pretty solid on some pretty large data sets. Once you get it conf'd it's pretty good. The best part is just writing the scala code to run the job.. admittedly, it would be great to use something a bit lighter for certain workloads.
cmollis··on Ask HN: Did studying CS make you appreciate programming less?
yes.. for me anyway.. for CS you also have to study a lot of math. I enjoyed my math classes a lot more than my CS classes. I really didn't enjoy my programming classes.. the thought of spending all night hacking in the lab never thrilled me actually. Only when I started programming professionally did I enjoy it. I realized later that it was actually the problem solving that I enjoyed.. the dopamine rush of implementing a solution. I wasn't solving equations anymore at that point (like in my math or physics classes), but I did really enjoy designing and implementing a solution to whatever the problem was.. and that's pretty much what professional programming is.
cmollis··on Ask HN: How did early streaming services populate their music databases?
each music company supplies both data (track and product metadata, territorial rights, pricing, etc.) and media to the service provider (e.g. Spotify). The process is to sign the contract with the music company, then the company ships all of the data to the provider to ingest into their systems. In the beginning, each music company sent metadata in a different format.. before electronic distribution, they would send hard drives that contained the media and metadata. The distribution formats are now driven by a standards-body.. but iTunes still has its own format.
cmollis··on Thoughts on Rust after six months
I also came to Rust most recently from Scala. The type constructions, functional capabilities intertwined with async, optionals, pattern matching, etc reminds me a lot of Scala. You do have to be cognizant of memory, ownership, stack, heap, etc, but the results are so much better. I also agree that the compiler is an impressive feat of engineering. SBT (lol).. I still use it, but really just the minimum set of build features.. Scala (and all it's third-party packages and libs) tend to get so complicated that figuring out what to do is just so painful.. Rust is a much smaller surface.. a smaller number of ways to do something, consistency among crate implementations, is really just great. Using tokio recently and that's been awesome also.. I'm hoping that other toolsets like datafusion and ballista mature.. would love to see more data management toolsets written in rust.
cmollis··on The pool of talented C++ developers is running dry
oh and the last time I wrote in C++, I was using gmake.. all those compiler and linker switches.. header and linker search paths.. ugh.. I felt like I was launching a rocket to the moon just getting some of that to build. don't miss that.. chasing down memory corruption in threads with gdb.. also painful. I get that C++ is much better now, but I haven't really used it in a long time so can't comment.
cmollis··on The pool of talented C++ developers is running dry
I agree.. I've been writing in Rust for about 2 months and I find it to be a much easier surface than C++.. getting over the borrow checker isn't as bad as some make it out to be.. in fact, if it compiles it largely works.. you might be cloning one too many strings as a newbie, but you get the hang of it quickly.. when I wrote a lot of C++, I used a really small feature set.. but that was like 20 years ago.. now (apparently) it's a lot better.. with Rust, you need to think about memory, stack, and heap, but it's not ridiculous. The type system is really great. Granted, I'm not writing a database, but so far, I see a lot of really good libraries that integrate really easily, and it's just fun to use. The functional features and futures feel a lot like scala... and it's fast.
cmollis··on What you’re so passionate about, that you can give a lecture without preparing?
data processing with spark.
cmollis··on Quiet Quitting Is a Fake Trend
right.. completely fake trend. If you want to call people doing a minimum amount of work at a job where no one that they work for: (1) actually knows what they're doing (2) cares about what they're doing (3) pays any attention to where they are (home, out walking the dog, etc)

then yeah, give it a click-bait sounding name and write a bunch of articles about it. I call it the same thing it always was : people working for a companies that make enough money in other areas so they don't have to care about what every single employee does. This has happened since the advent of large companies, working from home simply exacerbated this trend because you don't have to feel like you're working, just because you traveled to your workplace..even though you end up doing the exactly the same nothing.

cmollis··on Byte Magazine: The C Programming Language (1983)
How I miss bookstores.. I realize that they still exist, but for me as a (mostly average) comp sci student, the bookstore was the place that I could find the code snippets and algorithm solutions for my classes. I spent hours just reading programming books, magazine articles (like Byte)..taking notes..remembering techniques.. couldn't wait to try them out. Pretty nerd-y now that I look back on it. I actually found it kind of fun.. although this is the first time I've admitted it (taking the first step is the hardest). Now it is stack overflow and google, as we all know. good times.
cmollis··on American workers need lots and lots of robots
i agree with this 100%. Anything else is protectionist claptrap that makes zero economic sense. The funny thing about these (counter) arguments (to the above) is that despite all of their blabbering is that this will just happen anyway. Companies will make the investments that they deem justified (in robots, for example) and everything will (eventually) adjust to whatever that specific reality brings (e.g. birth rates, re-education, taxes, etc, etc). Most of what anyone ever hears is generally governed by who's trying to win the next election.
cmollis··on Velox: An open-source unified execution engine
I think it's more like Databricks' photon.. a rewrite of the execution engine that can be plugged into existing spark deployments.
cmollis··on Ask HN: Why does the C K&R Book not talk about threads?
Because they didn’t exist at the time that book was written. I took a Unix/c class as a comp sci elective (yes, you read that right). However this was 1988 so no Linux. We worked mostly on pc’s which was pretty progressive for the time and mainframes. We had a small mini computer (can’t remember from who.. dec? That doesn’t sound right..). Anyway, forked processes, no threads. In fact, I didn’t know what a thread was until the windows nt announcement in the early 90s. The irony is evident.
cmollis··on 'Too many employees, but few work': Pichai, Zuckerberg sound the alarm
'too many employees, but few work'.. this is misleading.. given the spin, you might think this indicates that they hired these people to do specific line-of-business things, and they didn't get done. However, what actually happened was they hired a bunch of people to do.. something.. but they weren't sure what.. all they were told is that they need to hire them.. then they realized they might have 'a down quarter or two'.. apple's killing their advertising business, and they're thinking.. 'hey wait a minute.. our headcount's gone up.. no one in middle-management seems to know what they're doing (which is actually our fault.. but we can't say that), so we'll call the people we hired lazy unmotivated clowns and get rid them that way.' Cue the high-fives.
cmollis··on Alex Jones must pay $4M in damages for Sandy Hook hoax claims
I can attest that it's not (a big deal). My ex-wife lied repeatedly in written court certifications about money she was receiving from her parents which I ultimately proved were lies. This, I assumed, was tantamount to perjury (given that these were supposedly 'sworn statements' with all the requisite mumbo jumbo about 'penalties'). Guess what? nothing happened. thanks for paying all of that extra money in alimony that you didn't have to...You lied to the Court.. and me, for years.. eh, no big deal. thanks for playing our super-fun anachronistic, ceremonial scamfest. I believe lying is actually encouraged by the Court system because the onus is the adversary to prove it and, even if you do, nothing really happens. Threats of 'contempt' are just that.. threats. Contempt of Court, contempt of Congress..perjury.. yawn. On another note, getting some rain today..really need it.
cmollis··on Why programmers are not paid in proportion to their productivity (2009)
I think what I was trying to say is that the best performers attempt to understand the problem domain more holistically than, say, more average performers. What are the forces driving all of this and how do I deal with those forces in the most efficient way. Obviously, a dramatically more productive engineer also has deep experience is probably many toolsets, languages, etc., and that experience informs many of the decisions that they make when crafting a solution. However, I would argue that they have forgotten many of the picayune details of each, and only retain the most useful conceptual capabilities of those experiences so they can apply them quickly to some new and (seemingly) unrelated problem.
cmollis··on Why programmers are not paid in proportion to their productivity (2009)
true.. adequate programmers code exactly what you tell them to..and even then it may not be great. Great engineers step back and ask 'why are you asking me to do this?'..(probably silently).. which inevitably leads to a more refined solution, or none at all when they realize you don't actually understand the actual problem, more likely just a symptom of it. Nobody remembers what didn't happen and they certainly don't pay you more for that.

This is usually a function of experience, but not necessarily. Productive developers are constantly mapping each development requirement into a larger context of the 'system processes' at large, cross-referencing their (usually deeper) understanding of the technical, business, and political issues involved (all involving some acquisition or expenditure of 'energy' in the general sense). Their productivity is more a function of their understanding of economics writ large, than their recall of algorithms or specific toolsets. It's the main reason senior development is so difficult to hire for..

cmollis··on Supreme Court Overturns Roe vs. Wade
When I was a child in the Catholic Church (70s and 80s) there was NEVER any political discussion that entered into the service (“..render unto caesar what is caesar’s..” or ‘separation of church and state’. Or, more probable, perhaps it was felt that it simply was not the forum for present-day politics. I don’t know). Since lapsed, A few years ago I was encouraged by a priest, as he enjoyed his fourth old fashioned, to attend a Mass. He noted that I might find it more ‘enlightening’ than I had in the past so I agreed (albeit reluctantly). What I witnessed was no less than a 45 minute diatribe on the dangers of abortion, casting various aspersions (ad hominem) on any political leader not on board with new political agenda of the Catholic Church. Frankly very little else. I hypocritically thought to myself ‘would Jesus be proud of this? Perhaps. But I certainly wasn’t. The addtional twisted irony was that the person I was with actually had an abortion. She sat quietly listening to this without seemingly the slightest bit of concern. She said that’s how all services are now.

It occurred to me that all of this must have been carefully planned at the highest levels of both the church and political/financial benefactors that support it. A long and patient process put in motion years ago. I realize This is somewhat anecdotal but speaks to perhaps the planning that culminated in todays decision. This is about power and control operating under the auspices of religion. SCOTUS are just run-of-the-mill sycophants playing along.

← PreviousPage 2 of 8Next →