welliman's comments

Not really. The research seems to be relatively novel, not a watered down version of a different study being repeated by children as your comment would suggest. My point was that the research just wasn't overly prestigious.

That study looks like it was done by an undergrad and isn't peer reviewed. It is interesting, but probably should be taken with a grain of salt.

IPUMS, Univserity of Minnesota | Minneapolis, MN | Backend Web Developer | Full-time | Onsite | https://ipums.org/

IPUMS (https://www.ipums.org/) is a leader in the field of quantitative social science research and the largest disseminator of census and demographic data to the world’s academic research community. Or, to put it another way - we’re on a mission to gather, process, link and publish billions of records spanning hundreds of years and more than 100 countries so that demographers, historians, economists, environmental scientists, journalists, policymakers, and others around the globe can use the data to do amazing research and make the world a better place.

The position functions as a member of the data dissemination team and will have responsibility for design, implementation and support of software systems, including enhancing and adding new features to the IPUMS web applications and APIs as well as building standalone software systems. This position will report to the lead developer of the team. This position involves daily interaction with the rest of ISRDI IT, the ISRDI research staff, and other user communities.

Required Qualifications

  * Bachelor’s degree. Two years of work experience in application/web/systems development with a related bachelor’s degree or four years of work experience in application/web/systems development with a non-related bachelor’s degree.
  * API design and implementation
  * Databases (relational or NoSQL)

Preferred Qualifications

  * Containerization technologies such as Docker
  * Service (or microservice) based architectures
  * Developing applications in a Linux environment
  * Working with and transforming large amounts of data
  * The Ruby on Rails Framework
  * Application server technologies such as NGINX and Passenger
  * Message queues such as RabbitMQ and Kafka
  * Elasticsearch
  * Data Analytics and B.I. experience

Go to https://hr.myu.umn.edu/jobs/ext/334356 to apply.

IPUMS, Univserity of Minnesota | Minneapolis, MN | Backend Web Developer | Full-time | Onsite | https://ipums.org/

IPUMS (https://www.ipums.org/) is a leader in the field of quantitative social science research and the largest disseminator of census and demographic data to the world’s academic research community. Or, to put it another way - we’re on a mission to gather, process, link and publish billions of records spanning hundreds of years and more than 100 countries so that demographers, historians, economists, environmental scientists, journalists, policymakers, and others around the globe can use the data to do amazing research and make the world a better place.

The position functions as a member of the data dissemination team and will have responsibility for design, implementation and support of software systems, including enhancing and adding new features to the IPUMS web applications and APIs as well as building standalone software systems. This position will report to the lead developer of the team. This position involves daily interaction with the rest of ISRDI IT, the ISRDI research staff, and other user communities.

Required Qualifications

  * Bachelor’s degree. Two years of work experience in application/web/systems development with a related bachelor’s degree or four years of work experience in application/web/systems development with a non-related bachelor’s degree.
  * API design and implementation
  * Databases (relational or NoSQL)

Preferred Qualifications

  * Containerization technologies such as Docker
  * Service (or microservice) based architectures
  * Developing applications in a Linux environment
  * Working with and transforming large amounts of data
  * The Ruby on Rails Framework
  * Application server technologies such as NGINX and Passenger
  * Message queues such as RabbitMQ and Kafka
  * Elasticsearch
  * Data Analytics and B.I. experience

Go to https://hr.myu.umn.edu/jobs/ext/334356 to apply.

The decisions you are trying to make seem to be based more off of anxiety and/or fear rather than a passion for what you want to be doing with your life. Try to find out what you would enjoy doing with your current skillset and spend some time figuring out a way to make that happen. A MSc in CS opens doors to many industries as well academia, so you have tons of options to choose from.

You probably won't regret spending the next few years of your life doing something that you think is interesting. There is, however, a chance that you will regret spending the next few years worrying about if your future self will regret those years.

I’m not buying this. I ride the light rail in Minneapolis a fair amount and others on it don’t look or act rich at all. In fact the express bus I frequently take seems to be full of more affluent people than the light rail.

Whimsical inventiveness is the one thing that keeps me enjoying the art of programming.

There's a tension in programming between being verbosity and ingenuity. More flexible languages and programmers general favor ingenuity, while rigid ones favor verbosity. When people complain about the "magic" in Rails, it's usually because it's a pattern that is new to them, and they would have preferred an older pattern even if it was a more verbose one. Which is fine, but it is a preference amidst a large spectrum of tradeoffs. Unfortunately, many people tend to not see most tradeoffs in software engineering and try to come up with as many reasons as possible for why their way is right and the other way is trivial, stupid, cute, or useless.

It's not really my area of expertise, but from what I understand it will severely limit what policy and demographic research can be done with the data. There's a working paper on the page you linked to which has more information: https://assets.ipums.org/_files/mpc/MPC-Working-Paper-2018-6....

Blatant plug: for large scale analysis on census and survey data I'd recommend checking out nhgis.org. It lets you download the large pieces of demographic data that you may be interested in. Data harmonized across time is also available to investigate trends.

Note: We don't have the 5-year 2017 ACS data yet (it takes about 2 weeks for us to ingest the data once it comes out).

Disclosure: I'm a developer at IPUMS.

IPUMS | ipums.org | Data Engineer | Minneapolis, MN | Onsite | Full-Time

IPUMS is a leader in the field of quantitative social science research and the largest disseminator of census and demographic data to the world’s academic research community. Or, to put it another way - we’re on a mission to gather, process, link and publish billions of records spanning hundreds of years and more than 100 countries to demographers, historians, economists, environmental scientists, journalists, policymakers, and others around the globe, who then use the data to do amazing research and make the world a better place.

We are currently seeking a software developer to join our data linking team that is working on large scale data manipulation and creating highly performant distributed software systems. In this role, you will be developing software that links records representing the same individual and their family relationships across every US Census from 1850 - 1940. There are no consistent identifiers across historical censuses, so sophisticated matching algorithms will be required. You will be building on research and IT effort from the past decade to create a dataset that, once released, will enable critical new avenues of research for demographers and historians. This work will also lead to additional data linking opportunities for datasets from around the world and throughout history. You will be working in close collaboration with expert historians, demographers, and data scientists. We use Apache Spark (PySpark and SparkSQL) for a majority of our data processing, with C++ in critical areas. This is an excellent opportunity to grow your career with a cutting -edge software shop at the University of Minnesota and contribute to work that has impact around the globe.

Required Skills: BA/BS degree required. Two years of work experience in the areas of application/web/systems development with a related BA/BS degree, or four years of work experience in the areas of application/web/systems development with a non-related BA/BS degree.

This role requires technical experience and proficiency with:

- Experience developing software for high performance and/or distributed computing

- Experience with databases (relational or NoSQL)

- Large dataset manipulation

- Linux/UNIX operating systems, including command-line

See https://www.ipums.org/data-engineer for more details and instructions on how to apply.

I really like Sandi Metz as a speaker, and am pretty sure she has thought about these problems much deeper than I have. However, I often find myself wondering if most of the problems she is trying to solve would go away if programmers spent more time thinking about their code.

The case filled code that she is describing seems to be a result of the programmers not fully grasping the purpose of the code, and being unable to tell if the current abstraction is fitting. I understand that deadlines and the sunk cost fallacy play a factor, but, at least for me, finding the right abstractions / architecture is most satisfying part of coding! Shouldn’t that be what these programmers are focusing on in the first place?