HNHacker News
TopNewBestAskShowJobs

gengstrand

157 karma · joined October 24, 2008

Advising 12 factor cloud native architectures with less complexity and more scalability for improved performance, lower cloud bills, lower maintenance costs, faster time to market, and more secure.

Current interests include AI (both predictive and generative), distributed consensus, and open source.

Currently exploring how LLMs can enhance and augment the developer experience.

You can contact me at media at glennengstrand.info

submissionscomments
gengstrand··on Kong Raises $43M in Series C Funding
The load test would call kong which would proxy each request to the service being tested. Kong would be configured with the http-log plugin where performance data would get sent to another service that would collect that data then update elasticsearch in bulk.

Last August, I tested the Dropwizard service with this setup which recorded about 20,000 RPM on GKE. This year, the same setup sent about 4,000 RPM to the Dropwizard service and the http-log plugin sent only about 200 RPM to the other service.

gengstrand··on Kong Raises $43M in Series C Funding
It is easy to repro this issue as I have open sourced the kubernetes manifests. There are instructions on https://github.com/gengstrand/clojure-news-feed/blob/master/... for how to provision the cluster on either Amazon or Google's cloud and spin up the services and the load test application. Be sure to create the kong service (commented out) instead of the proxy service (which replaced it) and use the feed3-deployment.yaml instead of the feed-deployment.yaml manifest.
gengstrand··on Kong Raises $43M in Series C Funding
I used to like Kong a lot but I noticed that it started under performing when they released version 1. I blogged about that in http://glennengstrand.info/software/performance/springboot/d...
gengstrand··on Why I Switched from Python to Clojure (2016)
When comparing programming languages / tech stacks, I am also more interested in the full picture (libraries, complexity, performance) than just differences in syntactic sugar. I use https://github.com/gengstrand/clojure-news-feed as a test bed for such evaluations. There, you will find almost feature identical microservices in clojure using ring with the jetty adaptor and python 3 on flask.

The clojure service was in 13 files with a total of 710 Lines of Code. The python service was in 33 files with a total of 1561 LoC.

I also have published load test results of these microservices at http://glennengstrand.info/software/performance/eks/gke where you will find the per minute average throughput for these two microservices to be about the same but the clojure version was about twice as slow as the python version.

gengstrand··on Ask HN: How do you keep track of your creative thoughts?
yes, absolutely. I also use xmind too.
gengstrand··on Ask HN: How to incorporate machine learning into day job?
It would not be incorporating ML into your app's code base directly but one way that I incorporate ML is to use it to analyze application performance data in hopes of learning how to improve it.

http://glennengstrand.info/software/architecture/msa/ml

gengstrand··on Ask HN: How can I improve the performance of this Node.js app?
Thanks. That did improve the node.js performance. It now has comparable latency and only 16% lower throughput.
gengstrand··on Why Functional Programming Matters (1984) [pdf]
It appears that your claim "Scala or Clojure that don't have real tail recursion because of the JVM" is in error.

http://stackoverflow.com/questions/1677419/does-scala-suppor...

http://clojure.org/reference/special_forms#recur

gengstrand··on Micro-Services: Scala vs. Clojure
A micro-service is written in two different Functional Programming languages for the JVM. Both services are load tested on AWS and the performance results are compared.
gengstrand··on 2016 will be the year of concurrency on the web
I have run into the same "multi-threading is hard" attitude among younger programmers. I believe that kind of attitude to be a career limiting mistake. In the interests of scalability, you may have to accommodate multi-process oriented concurrency anyway with such as techniques as message brokering, or CAS style counters available in various databases; however, it is always going to be cheaper to manage a pool of threads in a single process than to manage a pool of processes. In the data center, most bare metal servers have lots of cores where multi-threading really shines. I have noticed a trend in AWS to offer more single vCPU EC2 instance types for those unwilling to learn the joys of thread pool executors and linked blocking queues.
gengstrand··on Micro-Services: Clojure vs. Scala
I agree with your intentions; however, when comparing two languages, you need some quantifiable basis for comparison. "Better fit" is very ambiguous and hard to measure whereas code size is very specific and repeatable. I believe I used something like this.

wc `find ~/git/clojure-news-feed/server/feed/src -type f -name '.clj' -print | xargs`

wc `find ~/git/clojure-news-feed/server/feed/test -type f -name '.clj' -print | xargs`

wc `find ~/git/clojure-news-feed/server/feed2/src -type f -name '*.scala' -print | xargs`

I used code size because you hear about that alot but I agree that it is a very imperfect basis. Less code doesn't necessarily mean fewer bugs. When I coded these two services, I wasn't thinking of code size at all.

gengstrand··on Micro-Services: Clojure vs. Scala
What do you mean by the term "mindset?" To me, that term usually implies a kind of groupthink.
gengstrand··on Clojure 2014 Year in Review
I am surprised that no one here has yet mentioned Clojure in connection with Big Data. At OSCON 2014 ( see http://glennengstrand.info/analytics/fp ), I was first introduced to Cascalog which allows you to write Hadoop map reduce jobs in Clojure. Both Cloudera and Hortonworks support it.
gengstrand··on Clojure 2014 Year in Review
Scala does have more support for OO than Clojure with traits, case classes and pattern matching, and generics but Clojure does have enough support for OO for basic service creation. See https://github.com/gengstrand/clojure-news-feed as an example where Clojure's defprotocol, defrecord, defmulti, and defmethod are used to implement a basic CRUD style RESTful API for 4 entities in about 300 lines of code.
gengstrand··on Ask HN: How much time on average do you spend a week reading technical books?
Assuming you mean books in the traditional sense and not just online material, about 2.5 hours.
gengstrand··on Chinese Investors Fuel California Housing Bubble
Last year, I purchased a house in the Bay Area which has a very competitive real estate market that favours the seller. The mortgage broker, whom I worked with, claimed that of the thirty clients that he represented, 2 were able to win a bid and usually had to bid on many houses before winning. They weren't losing to higher bids, he said. They were losing to all cash offers from Chinese investors.
gengstrand··on Lock-free Data Structures: Atomicity and Atomic Primitives
I don't know why lock free concurrency control is so fashionable these days. I realize that deadlock and livelock are hard to debug but STM and software implemented CAS is a CPU hog that gets worse as load increases.
gengstrand··on Map Reduce: A simple introduction (2010)
I could not agree more. That is why I published an introductory example of map reduce that is still simple enough for educational purposes yet of a more real world nature.

glennengstrand.info/analytics/oss

Here you will see a blog, paper, and github repo of some map reduce jobs that take openly available San Francisco crime data and load it into an OLAP cube.

gengstrand··on Clojure 1.6 released
For a non-trivial example of a web application, check out http://www.dynamicalsoftware.com/software/architecture/oss/c... which documents the making of a news feed service that is written in clojure and combines lots of other open source technology such as postgresql, cassandra, solr, redis, and kafka.
gengstrand··on Building a Scalable News Feed Web Service in Clojure
This is a blog of a recent learning project where I constructed a news feed web service using clojure, postgresql, cassandra, solr, redis, and kafka. Then I set that up on AWS, ran a load test on it, then analyzed the results.
gengstrand··on Where do you find the time for side projects?
Great discussion here. I particularly like the debate over whether of not there is merit to the notion of conservation of mental energy. I did a side project https://github.com/gengstrand/clojure-news-feed over the winter holiday. It was not exhausting to me because it was a learning project so I found it to be fun instead of tiring.
gengstrand··on Poor man's dependency injection in Clojure
A chapter from the O'Reilly book covers this subject pretty well. With Clojure's java interop, you can still use Spring. Thanks to the homoiconicity of the language, support for higher order functions, and with some clever use of Clojure's load-file function in core, you kind of get DI baked into the language for free.
gengstrand··on Tools for the data science craftsman: R, Python, Clojure and Julia
About 8 months ago, I blogged about http://www.dynamicalsoftware.com/analytics/oss using hadoop and R for open source data science. I found R to be very useful, especially if you want to graph large data sets.

Since then, I have been playing with clojure with regards to data science. What I liked about clojure was that the programs looked more like transforming data sets with map, reduce, into, filter, merge-with, join, difference, union. You get more than just lists. You have maps, vectors, and sets too. The code looks like you are loading a lot of data into memory but with lazy sequences you are really processing these collections one element at a time. The so called threading macros (nothing to do with multi-threading) keeps the number of parenthesis down.

gengstrand··on Ask HN: What are the best ways to find freelance dev gigs?
I can tell you where not to go. Elance and GAC are two marketplaces where the technologically challenged hope to pay the least amount of money for unrealistic expectations so it's a race to the bottom both in terms of price and quality.
gengstrand··on Do things, write about it
I find that the weekend coding project can become very good fodder for a blog. http://www.dynamicalsoftware.com/analytics/oss is such an example of some hands on exploration of map reduce and is currently my top blog post.
gengstrand··on 3 Ways to Customize Solr 4
There has been a lot of blogs comparing elasticsearch to solr but I haven't seen anything yet that compares how they can be extended. This blog is about how Java developers can subclass solr classes in order to enhance its search capabilities. Is elasticsearch designed in such a way as to accommodate that kind of customization?
gengstrand··on Netflix on Ubuntu Is Here
You can stream video on Ubuntu on Hulu right now without having to set up some custom wine/silverlight anything. Just point your web browser to Hulu and start watching.
gengstrand··on What Programmers Want Is Less Stupid And More Programming
What's up with this attitude that any activity that isn't coding is stupid? Why is planning your coding work so uncomfortable to most programmers? I worked on a SDLC based project management tool http://www.dynamicalsoftware.com/analysis/code-roller and what I learned is that this attitude is prevalent in a lot of dev shops.
gengstrand··on The Highs and Lows of Side Projects
I used side projects mostly for idea validation. For example, I am working on an MDSD system that takes a UML or RDFS model and generates a web 2.0 app written in Google Closure and using XMPP to interact with the application layer. All of these technologies show great promise but none of them have really taken off. http://www.dynamicalsoftware.com/mdsd/closure is where I have documented some of my findings so far in exploring the merit of these three technologies.
gengstrand··on The Cloud Wars
Did anybody here attend any of this conferences? What was your impression?
← PreviousPage 3 of 5Next →