Does anyone know how the Census assigns the PUMS codebook value "b" code to a text value in the downloaded (API) data?
I was looking at the LNGI "Limited English speaking household" PUMS variable. When you fetch PUMS data via the API the variable values are text fields.
It turns out that for LNGI the "b" in the codebook corresponds to the text string (in the sense of a SAS format) "b .N/A (GQ/vacant)" data value "0"
In the LNGI case,the PUMS data field contains the value "0" which it turns means N/A (GQ/vacant). You can guess this because there are no " " fields in the PUMS data and "0" value doesn't appear in the codebook. By doing a little detective work using the codebook and some downloaded data you can figure this out. However, "0" isn't used for the "b" in the code book for all variables because sometimes "0" is a valid non-missing value (i.e. not N/A).
When I asked the people at ACSO they sent me a SAS format statement for LNGI which makes everything clear in the case of this one variable. But wouldn't it be nice if the Census published their PUMS SAS format catalog so we don't have to keep guessing what data value corresponds to "N/A" Do people have another way to find out what data value corresponds to "b" in the codebook? Some PUMS variables have over 100 coded values. If I'm working late on Friday, do I have to wait until Monday to get an answer ? How about a holiday weekend ?
Any help appreciated.
Dave Dorer
Dear Tom,
I realize that when dealing with "the government" it can be frustrating at times. The last 2 sentences at the end of my initial posting expressed some of this. My comments were inappropriate…
I can't help, but I can say that all the different values for 0 or N/A etc are truly terrible. I had a conversation with Donna Daily a few weeks back and she said that data.census was a work in progress. However, it's not just that platform, regardless of the tool, there are lots of issues. I sent a follow-up email with the following text
"with with a department with hundreds of PhDs working the math, it makes me think that we're not getting our money's worth from your budget of 4-5 billion."
She was nice and upfront with acknowledging issues. However, no fire to fix all this stuff.
I'd like to get her on a zoom meeting with a few key people in this group (not me, as I'm clueless). There is a specific person in her department who is supposed to be working on these issues (I wasn't given a name). I just want all the percentages formatted with a % and have a field name with the word percent in it. (which should be low-hanging fruit).
Tom
I realize that when dealing with "the government" it can be frustrating at times. The last 2 sentences at the end of my initial posting expressed some of this. My comments were inappropriate and I am apologizing to all of the intelligent, hard working, dedicated people who work at the Census. All of my interactions with the people at the Census have been very professional and their responses prompt and detailed. Earlier in my career I spent some time at NASA. The people at NASA were the same. I've also emailed, talked with or interviewed with people at the FDA (Food and Drug Administration), the NCI (National Cancer Institute) and the CDC (Centers for Disease Control and Prevention). Even the IRS. When I get frustrated, I "take out a piece of paper," i.e. start a word processing document, and I write my two Senators and my Representative. I let my letter "sit" for a day or two. Then I end the letter with my suggestions as to how to improve the situation. I sign the letter with my name and address and then email a scan of the signed letter. Ultimately Congress is responsible for how our Federal agencies are funded and whether there is adequate staffing. I know this this reply is "off topic." But I think that it needs to be said.
Best,
Dave