The Unjournal · Research prioritization
Paper-specific consideration page · Top AI-related papers, rank 2

Canaries in the Gold Mine: Early Productivity Gains from Artificial Intelligence Creating Organization Capital

Think-tank use of the headline result; no extended scrutiny found
Why this page exists. This paper is on a shortlist of papers we are considering for independent evaluation. No human ratings have been submitted yet, so the score below comes from the AI scoring pass alone. Treat it as one provisional input; the team has made no prioritization decision.
79AI evaluation-priority (shifted by the Opus 5.5 re-evaluation)
84Original AI lens before the Opus shift (not used for the synthesis)
None yetHuman aggregate · no ratings submitted
Not availableHuman–AI synthesis needs at least one human rating

Why this paper is being considered

The paper asks whether recent AI investment is already raising firm productivity, and through what channel. It reports that firms with more AI-skilled employment saw faster productivity growth in recent years but not in the prior decade, and attributes this to organization capital measured from job descriptions. An evaluation would focus on identification (AI-skilled hiring is endogenous), the novel organization-capital measure, and whether the result generalises beyond listed or well-measured firms.

AI-generated criterion ratings and reasoning

Scores come from AI prioritization; the accompanying explanations include AI-assisted source checks. These are provisional judgments, separate from human ratings and commissioned evaluations.

Decision relevance

8.0/10

The paper informs whether AI adoption is translating into real productivity growth, and through what mechanism. That matters for macroeconomic forecasting, public and private AI investment policy, labour-force planning, intangible-capital measurement, tax and R&D incentives, competition policy, and philanthropic prioritization around AI's economic effects. It is less directly tied to a single intervention decision than a health or development RCT, but it addresses a central live question for governments, international organizations, and AI-governance funders: whether and how AI is changing production, firm capabilities, and the demand for skilled labour.

  • Paper claim to check A new firm-level AI-investment measure based on AI-skilled employment is associated with productivity growth in recent years, but not over the previous decade. Source abstract

Value of added scrutiny

9.0/10

The NBER paper (August 2026) has been picked up by the Information Technology and Innovation Foundation, a think tank, which used its headline finding. We found no replication or extended critique. Attention looks real but early.

Timing

9.5/10

Timing value is very high because this is an August 2026 NBER working paper and appears to be at the pre-publication stage, when independent feedback could still affect interpretation, revisions, and downstream policy uptake. The supplied targeted search did not produce relevant expert reviews, replications, author responses, or serious public debates about this specific paper; the results were mostly irrelevant pages about canaries. This does not prove no scrutiny exists, but it suggests a substantial scrutiny gap at the current stage, especially given that NBER AI-productivity findings may spread quickly through policy and media discussions.

  • Source record Publication-stage and date evidence should be checked in the linked paper record. NBER

Methodological potential

7.0/10

The central evaluation challenge is causal identification: AI-skilled hiring may proxy for managerial quality, pre-existing digital capability, industry growth, or firms already on higher productivity trajectories. The AI-investment and organization-capital measures appear to rely on job descriptions and worker classifications, so measurement error, changing job-title conventions, and endogenous reporting could matter. An evaluation would also need to separate firm-level productivity gains from broader welfare effects, since the abstract does not directly address wages, employment displacement, market concentration, consumer surplus, or distributional consequences.

  • Paper claim to check A new firm-level AI-investment measure based on AI-skilled employment is associated with productivity growth in recent years, but not over the previous decade. Source abstract

Prominence

8.5/10

The scoring model estimated prominence from the paper's venue, authors, institutional setting, and visibility. The model did not supply a criterion-specific explanation. Current public-attention status: Think-tank use of the headline result; no extended scrutiny found.

  • Think-tank use ITIF highlighted the paper's main estimate in a short public note. This shows the result is circulating in policy-facing commentary, though the note is brief and does not appraise the identification. ITIF

Likely influence

7.0/10

The scoring model estimated how far the findings could shape later research or decisions, without supplying a criterion-specific explanation. Current public-attention status: Think-tank use of the headline result; no extended scrutiny found. See public-attention evidence below.

  • Think-tank use ITIF highlighted the paper's main estimate in a short public note. This shows the result is circulating in policy-facing commentary, though the note is brief and does not appraise the identification. ITIF

What the paper says

Source abstract · Source-supplied abstract wording; HTML entities and whitespace normalized. Not independently compared with the paper PDF.

Using a new firm-level measure of AI investment based on AI-skilled employment—spanning machine learning through generative and agentic AI—we show that AI investments are associated with productivity growth in recent years, but not over the previous decade. We trace the productivity gains to the accumulation of organization capital that AI helps create: durable firm-specific knowledge acquired through learning-by-doing that enables more efficient production. We build a novel measure of organization capital based on workers’ job descriptions and document that productivity gains are driven by AI-skilled jobs that build organization capital. Overall, our findings suggest that AI investment generates productivity growth by creating organization capital.

Claims to check

  • A new firm-level AI-investment measure based on AI-skilled employment is associated with productivity growth in recent years, but not over the previous decade.
  • The productivity gains are attributed to AI helping firms accumulate organization capital, defined as durable firm-specific knowledge acquired through learning-by-doing.
  • AI-skilled jobs that build organization capital appear to drive the observed productivity gains, suggesting that AI's productivity effects may depend on complementary organizational learning rather than AI adoption alone.
Methodological or theoretical issues flagged for evaluation

The central evaluation challenge is causal identification: AI-skilled hiring may proxy for managerial quality, pre-existing digital capability, industry growth, or firms already on higher productivity trajectories. The AI-investment and organization-capital measures appear to rely on job descriptions and worker classifications, so measurement error, changing job-title conventions, and endogenous reporting could matter. An evaluation would also need to separate firm-level productivity gains from broader welfare effects, since the abstract does not directly address wages, employment displacement, market concentration, consumer surplus, or distributional consequences.

Opus 5.5 re-evaluation (experimental)

Opus raw score: 60/100
Adjusted (+15): 75/100
Opus own action: watchlist
Label from adjusted score: shortlist
Earlier score (gpt-5.5): 80/100
Shift applied to the AI score: -5

Read with care. This is an experimental re-evaluation by a different model (Claude Opus 5.5, 2026-10-01). Across a calibration sample Opus scored about 15 points lower than GPT-5.5, so 15 points are added to compare it with GPT-5.5 scores. The calibration is a small sample (n=44) and is not human-validated, and the two models disagree about the order of papers within the top group. The AI score at the top of this page is the usual evaluation-priority score shifted by the difference between the adjusted Opus score and the earlier holistic score; the synthesis uses that shifted value, and the unshifted score is shown beside it. On the dashboard you can switch the Opus scores off. Read the methods note.

Opus rationale (AI-generated)

This NBER working paper by Babina, He and Jiang extends the authors' well-known line of work, using AI-skilled employment as a firm-level measure of AI investment, to argue that AI investment now goes with productivity growth (unlike the previous decade), and that it does so by building organisation capital. That speaks directly to one of the most active economic-policy debates: whether and when AI raises productivity, and what complementary investments are needed. Fed, OECD, IMF and CBO productivity forecasters, AI-policy think tanks (Brookings, GovAI, Epoch AI) and firms deciding how to deploy AI all care about it. It is squarely in scope for Unjournal and still an unrefereed working paper, so evaluation would be timely. An evaluation could add value by scrutinising identification (selection of AI-investing firms, endogenous timing), whether the new text-based organisation capital measure is valid, and how productivity is measured, since these determine whether the 'canaries' framing is warranted. Concerns: the welfare pathway runs through rich-country firm productivity, with little direct LMIC, animal or catastrophic-risk relevance. The evidence is probably correlational, and many groups are already working on the AI-productivity question. I'd put it in the monitor zone, near the upper end, and suitable if Unjournal wants AI-economics coverage.

Dashboard details and provenance

Discovery source: NBER
Scoring model: gpt-5.5 (codex headless, xhigh)
Model holistic score: 80.0

Full AI dashboard scoring rationale

This is a prominent, very recent NBER working paper on whether AI investment is already producing measurable productivity gains through organization capital, which is directly relevant to active decisions about AI diffusion, labour-market policy, productivity forecasting, and industrial strategy. OECD, IMF, World Bank, national productivity agencies, labour departments, AI-governance funders such as Open Philanthropy, and policy research groups such as CSET and GovAI could use evidence like this when judging whether AI is mainly hype, a broad productivity accelerator, or a force that changes the returns to intangible capital and skilled labour. As a new working paper, it has not yet had external peer review, and the supplied scrutiny search found no substantive independent expert review of this specific research, so an Unjournal evaluation would add clear marginal value. The main reservation is that the headline claims appear to rest on observational firm-level associations and novel text-based measures of both AI investment and organization capital, so causal interpretation, measurement validity, and distributional implications would need close scrutiny.

AI decision-relevance rationale

The paper informs whether AI adoption is translating into real productivity growth, and through what mechanism. That matters for macroeconomic forecasting, public and private AI investment policy, labour-force planning, intangible-capital measurement, tax and R&D incentives, competition policy, and philanthropic prioritization around AI's economic effects. It is less directly tied to a single intervention decision than a health or development RCT, but it addresses a central live question for governments, international organizations, and AI-governance funders: whether and how AI is changing production, firm capabilities, and the demand for skilled labour.

AI timing assessment

Timing value is very high because this is an August 2026 NBER working paper and appears to be at the pre-publication stage, when independent feedback could still affect interpretation, revisions, and downstream policy uptake. The supplied targeted search did not produce relevant expert reviews, replications, author responses, or serious public debates about this specific paper; the results were mostly irrelevant pages about canaries. This does not prove no scrutiny exists, but it suggests a substantial scrutiny gap at the current stage, especially given that NBER AI-productivity findings may spread quickly through policy and media discussions.

Earlier public-scrutiny search

The supplied public-scrutiny search returned no materially relevant independent expert review, replication, critique, author response, or extended discussion of this paper. Most listed results were unrelated to the paper, so the evidence supports 'none found' rather than 'confirmed none'; absence of results should be treated as uncertainty, not proof that no private seminar feedback or unpublished review exists.

No supporting source links are stored.

Intake, review, and crux connections

Community crux

Against GDP as a metric for timelines and takeoff speeds · 70% match

Firm evidence on AI-driven organization capital directly informs whether GPTs produce delayed productivity gains through complementary investment.

Community crux

Conference Report: Threshold 2030 - Modeling AI Economic Futures · 52% match

Early firm productivity effects help assess whether AI impacts will appear in near-term macro variables or remain diffusion-limited.

Public attention and use

The NBER paper (August 2026) has been picked up by the Information Technology and Innovation Foundation, a think tank, which used its headline finding. We found no replication or extended critique. Attention looks real but early.

Research dissemination listing / discoverability

NBER working paper 35684 and SSRN listing

The paper is available through NBER and SSRN. These improve discoverability but are not independent scrutiny.

Source: SSRN · Relationship: bibliographic index

What the search did not establish

  • No exact-title EA Forum or LessWrong discussion surfaced in the targeted search.
  • No replication, comment paper or detailed methodological critique was found.
  • The most decision-relevant next signal is independent re-estimation using a different measure of AI investment.

Targeted search checked 2026-10-01. Search scope: Targeted exact-title searches across the open web, institutional and author pages, news and public social-media results, EA Forum/LessWrong, and policy/white-paper contexts. Evidence records distinguish commissioning or report use from independent discussion, media attention, indexing, and post-publication policy use. A search miss is reported as uncertainty, not proof of absence. Entries with check_depth "quick" rest on roughly one to two searches and should be read as especially uncertain; entries checked on 2026-10-01 were added for the shortlist of papers without human ratings.

Human feedback so far

No human ratings have been submitted for this paper yet, so there is no human aggregate or synthesis score. If you know the work, rate or discuss it on the dashboard card; the team reviews feedback before it affects prioritization.