I am using the 2020 1-year ACS, accessed from IPUMS. I created two variables, the AMI threshold based of HUD income cutoffs within the region of interest; and whether the household had more than 1 occupant per room (overcrowded).
I joined my clean data to the replicate weights (which in IPUMS automatically uses the experimental weights and experimental replicate weights for the year 2020). I then turn the cleaned data into a household-level survey object (h_repd) and use the srvyr package in R. I am trying to get a simple household count grouped by PUMA, AMI threshold and overcrowding. See below:
However, when I run the numbers, my standard errors are really low, indicating the data is more "reliable." But we know the data is fraught with data quality issues and should have larger standard errors.
For example, in the output below, when the unweighted sample size n is just 1, it shows a CV of 12% (line 3) or 28% (line 7).
Compare this to the results for the year 2019 (below). When n is very small such as 2, the CV is at least about 70%.
I assume it must be an error somewhere in my code, but the fact that 2019 looks correct but 2020 does not is making me wonder if others have run into similar issues.
Does anyone have any guidance on this? Should my SEs and CVs be this low? Am I forgetting a step?
Using replicate weights, in general, will result in quite low standard deviations compared to the published numbers that the Census puts out. This is especially true for income, since income is, of course…
Just as a background, the formula for the estimation of variance using replicates does not include the number of observations used to create said estimate in its denomiator. Rather, the variance is estimated…
Building off of Matthew Brault 's comment about the different weighting methodology. I remember reading this article a few months ago, and it really helped me understand what was going on with the experimental…
Building off of Matthew Brault 's comment about the different weighting methodology. I remember reading this article a few months ago, and it really helped me understand what was going on with the experimental weights: https://www.census.gov/content/dam/Census/library/working-papers/2021/acs/2021_Rothbaum_01.pdf
I feel like they may have mentioned something about the methodology they used potentially lowering the standard error or something to that effect (maybe something about efficiency on the factors that the weights were tied to?), but it was too long ago for me to be sure. I wanted to post it just in case it's helpful to you!