big data on a less big budget...

Even if you have a proper budget for your data projects--we can all benefit from a deeper understanding of what assumptions are being made from the data we curate.

Non-proprietary data sources, at least the reputable resources will have a data dictionary of sorts. Typically it is the PDF file in the midst of your CSVs or other statistical file types.

I live in the world of real world data and rely on data generated from Census Data or more recent American Community Survey (ACS) data as well as a variety of other government sites.

---

The U.S. Census Bureau is a 10-year census but as you may or may not know, the American Community Survey continues every year--In fact some of the questions have been asked since the first survey was completed in 1790!

Many of us work quite comfortably in the raw data world but if that isn't how you earn your keep there are also tools and instructional resources--and of course--ahem, those of us willing to work with you to reach your goal. First step is to understand the variables and measures. The 2016 ACS provides Subject Definitions for your use.

---

One of the critical concerns when using data for social correlates of health might be how the measures are calculated. Especially if you are combining multiple data sources.

Census data is a good place to start and many argue poverty is more than just an income threshold.

Poverty Is More Than a Matter of Income--RAY BOSHARA The New York Times 

It's not that the government doesn't spend on the poor. It's that it spends very differently on the poor.

They are grudgingly provided barely enough income and food to get by, while better-off Americans receive generous subsidies to build assets to get ahead.

This disparity in asset accumulation shows up in data on wealth inequality -- which, not surprisingly, dwarfs income inequality and reaches well into the middle class. The top 20 percent of households earn about 56 percent of the nation's income -- but command 83 percent of our wealth.

The bottom 60 percent, the majority of the country, earns 23 percent of the nation's income -- but owns less than 5 percent of the wealth.

​And the bottom 40 percent earns 10 percent of national income but owns less than 1 percent of the wealth.

​Despite the greater magnitude of wealth inequality, however, income inequality -- like income poverty -- receives far more public attention.

Here is a quick demonstration of a population analysis interactive by Public Insight that does all of the heavy lifting for you. But you will need to be well-versed with at least an introductory level of data knowledge.

I don't share any data interactive or resource that requires a bloated budget or an "arm and a leg" to access. Some of us like doing the data cleaning and modeling in-house and are perfectly capable.

My blog is for learning about new resources for in-house data teams, finding the right data professional for collaboration (ahem), or pointing toward a tool that might be a business solution.

Here are the different ACS variables available for analyses:

• Demographic
  • Citizen and voting age
  • Age
  • Race​
• Housing
  • Heating Sources
  • Owned and Occupied Housing Units
  • Household Size and Vacancy Rates
  • Housing Values
  • Mortgage Status
  • Occupants/Room
  • Rent Levels and Rent as % of Income
  • Rooms and Average Rooms
  • Selected Dwelling Characteristics
  • Selected Owner Costs and Average Costs
  • Units in Structure
  • Vehicles
  • Year of Move-in
  • Structure Age
• Social
  • Ancestry
  • Disability
  • Education Levels
  • Fertility (Births and Births per 1k)
  • Grandparents
  • Households and Household Averages
  • Language
  • Marital Status
  • Place of Birth
  • Region of Birth
  • Family Relationships
  • Residence 1 Yr. Ago
  • School Enrollment
  • U.S. Citizenship
  • Veterans
  • Year of Entry

• Economic
  • Class of Worker
  • Commuting Methods and Times
  • Employment and Unemployment Rates
  • Health Insurance
  • Income Levels and Averages
  • Industries
  • Occupations
  • Poverty Rates

Maybe you want a just-in-time solution ready right out of the box? Check out the newly launched population analysis interactive below. It is only 10 minutes and I think Dan sounds like Jimmy Kimmel...

Population Analysis Tutorial from Public Insight on Vimeo.

Questions about Public Insight? Dan Quigg is the CEO
email: Dan.Quigg@publicinsightdata.com

Questions about your data or how to access American Community Survey Data?

​Reach me on twitter or linkedin.