This page contains release notes for each of Emsi’s quarterly US dataruns from the 2017.1 datarun forward. The release notes contain information on major methodology changes included with each datarun.
To read more on Emsi data updates, see this article. To read more about each source and what Emsi uses it for, click the link in the dataset chart.
New Occupation Classification (Emsi SOC 2019)
Emsi’s occupation classification (SOC) is being updated to match the reduced level of detail available in the 2019 release of OES. This reduction in detail serves as preparation for OES adopting the official 2018 SOC (to be released spring 2022 with OES 2021 data). For more information on the timeline for the SOC 2018 transition, see Emsi’s SOC transition article. For more information on how the SOC 2018 transition affects 2019 OES data, see Question 10 of OES’s FAQ.
In addition, because of funding constraints, the OES has been reducing their survey sample size, which will reduce the accuracy of the data, but prove the need for Emsi’s modeling to make detailed estimates available.
“The OES sample has been reduced in recent survey panels. The May 2019 OES survey panel had a sample of approximately 183,000 establishments. The November 2017, May 2018, and November 2018 survey panels each had a sample of approximately 186,000 establishments. The May 2017 panel sample consisted of approximately 195,000 establishments, and the November 2016 panel sample consisted of approximately 202,000 establishments” (see the end of “Technical Notes for May 2019 OES Estimates”, from BLS).
In order to match BLS published separation rates to the new aggregate occupation codes in Emsi SOC 2019, we sum total employment and total separations for the aggregated occupations and recalculate the rate. Prior to this data release, separation rates for aggregate occupations were calculated by averaging the detailed rates. Separation rates are used in Emsi’s calculation of openings. For reference, Openings = Growth + Separations.
New Micropolitan Statistical Area
Emsi updated to the Census Bureau’s March 2020 MSA delineations. This update includes only one change, a new micropolitan statistical area: Bluffton Indiana (MSA 14160), which consists of Wells County Indiana (FIPS 18179).
Reduced Volatility in Historical Occupation Earnings
We improved the methodology for estimating suppressed occupational employment and earnings. This improvement targeted areas of low employment and volatile earnings. Previously, we used disclosed data from prior and subsequent years to form an initial estimate (seed) for suppressed values, and then allowed our algorithms to adjust those seeds to match known disclosed data. The constraints imposed by the disclosed data were not enough to keep the seeds from changing drastically and causing volatile earnings across the time series. We resolved this by adjusting the seeds to match the known national occupation change, then imposing tighter constraints on those particular seeds so our algorithms could not adjust them more than ten percent.
In short, we started with better guesses and constrained our models to stay within ten percent of that original guess. The effect of this change is a noticeable reduction in volatility for occupational earnings associated with low-confidence data points.
ZIP Breakout for State and Local Government
We fixed a bug in our ZIP code methodology that was inadvertently using total employment instead of state and local government employment to break out the state and local government industries (902999, 903999) from counties to ZIP codes.
Extensive changes to our Extended Proprietor class of worker
We extensively reviewed and revised our methodology for our Extended Proprietors class of worker, improving our unsuppression of BEA proprietors employment and earnings by using newer algorithms and by making better use of NES and QCEW to reduce the volatility present in the data and isolate earnings from income. Users of Extended Proprietors data may notice differences in how earnings are distributed between industries and areas. Accordingly, users of the Social Accounting Matrix (SAM) and Input-Output (I-O) model may notice some changes to industry multipliers.
New Datasets in Core LMI API (API Only)
IPEDS Institution Updates (API Only)
We added indicators to to IPEDS institution definitions for Historically Black Colleges/Universities (HBCU) and Hispanic Serving Institutions (HSI). The goal is to add these indicators to reports in our Analyst tools; however, at the time of this datarun release, they are only available in the API.
Bolded items indicate an update.
|Name||Source||2020.3 Datarun||2020.2 Datarun||2020.1 Datarun||2019.4 Datarun|
|Released 7/27/20||Released 4/28/20||Released 1/17/20||Released 10/11/19|
|Quarterly Census of Employment and Wages (QCEW)||BLS||2019Q4||2019Q3||2019Q2||2019Q1|
|Occupational Employment Statistics (OES)||BLS||2019||2018||2018||2018|
|National Ind/Occ Employment Matrix (NIOEM)||BLS||2018-2028||2018-2028||2018-2028||2016-2026|
|Employment Projections Tables (EP)||BLS||2018-2028||2018-2028||2018-2028||2016-2026|
|Consumer Expenditure Survey (CEX)||BLS||2018||2018||2018||2018|
|State Personal Income / Local Area Personal Income (SPI/LPI)||BEA||2017 Revised*||2017 Revised*||2017 Revised*||2017|
|Make & Use Tables (MUTs)||BEA||2018||2018||2018||2017|
|National Income and Product Accounts (NIPA)||BEA||2020Q1||2019Q4||2019Q3||2019Q1|
|Gross Domestic Product by State (GSP)||BEA||2017 Revised**||2017 Revised||2017 Revised||2017|
|American Community Survey (ACS)||Census||2018||2018||2018||2017|
|County Business Patterns (CBP)||Census||2016***||2016***||2016***||2016|
|ZIP Code Business Patterns (ZBP)||Census||2016***||2016***||2016***||2016|
|Nonemployer Statistics (NES)||Census||2018||2016||2016||2016|
|Current Population Survey (CPS)||Census||2018||2018||2018||2018|
|Sate and Local Finances (Census of Government, CoG)||Census||2017||2017||2017||2016|
|Population Estimates (PopEst)||Census||2018||2018||2018||2018|
|Origin-Destination Employment Statistics (LODES)||Census||2017||2017||2017||2017|
|Quarterly Workforce Indicators (QWI)||Census||2020Q1||2019Q4||2019Q3||2019Q2|
|Railroad Retirement Board (RRB)||Railroad Retirement Board||2018/2017||2018/2017||2018/2017||2018/2017|
|Occupational Information Network (O*NET)||US Dept. of Labor, Education & Training Administration||24.3||24.2||24.1||24.0|
|Crime By County||Federal Bureau of Investigation (FBI)||2017||2017||2017||2017|
|Completions||IPEDS||2019||2018||2018 (IPEDS corrections)||2018|
|Birth/Death Rates||Center for Disease Control (CDC)||2018 (Birth), 2017 (Death)||2015||2015||2015|
* 2018 SPI/LPI has been released; however, it is incompatible with our processes. We are investigating the cause and will incorporate 2018 SPI/LPI as soon as possible.
** 2018 and 2019 GSP data have been released with partial coverage, but will not be fully released until fall 2020. We do not use the preliminary release because the BEA drastically revises GSP numbers for the final release.
*** 2017 CBP, ZBP, and NES have been released but make use of a new Census suppression methodology which suppresses data far more heavily than in the past. Emsi is currently working on new methodology that will allow us to calculate ZIP-level employment differently.