Public Records Requests and the Modernization of Government Transparency

The federal Freedom of Information Act,¹ enacted in 1966 and substantially amended in 1996,² 2007,³ and 2016,⁴ was designed for an information environment in which requests would arrive on paper, would seek discrete records, and would be processed by clerical staff with reasonable turnaround expectations. State open-records regimes — variously titled Sunshine Acts, Public Records Acts, or Right-to-Know Laws — were modeled on similar assumptions. None of these statutory frameworks anticipated the conditions that now prevail: machine-assisted request generation, dataset-scale demands, and a community of professional requesters whose volume strains the administrative capacity of even well-staffed agencies.

The modernization question is, in this sense, less a question about the statutes themselves than about the institutional infrastructure that implements them. The text of the federal FOIA has been substantially revised three times in the past three decades; the operational practice of FOIA compliance has changed comparatively little. The resulting gap between statutory promise and administrative reality is now wide enough that informed observers across the ideological spectrum have begun calling for structural reform.

The volume problem

The most-cited federal agency reports of recent years document FOIA backlogs that have, in some agencies, grown to multi-year scale. The causes are familiar: increased request volume, the conversion of agency record systems from discrete files to continuously- updating databases, and the resource-intensive nature of the FOIA exemption analysis when applied to large electronic productions. The 2016 FOIA Improvement Act addressed some of these problems at the margins — codifying the presumption of openness, narrowing the deliberative-process exemption for older records — but it did not provide the sustained funding increases that would be required to clear the backlogs.

State open-records regimes face analogous pressures, often with fewer resources. The most successful state implementations have tended to combine three features: a clear statutory presumption of openness, a meaningful enforcement mechanism (typically attorney fees for prevailing requesters), and an institutional ombudsman empowered to mediate disputes short of litigation. The combination is rare; most state regimes lack at least one of the three elements.

Database-scale requests and the limits of records law

A recurring source of contention in modern open-records practice is the treatment of requests that seek not particular documents but the contents of an agency's databases. Many state and federal statutes were drafted in terms that contemplate a "record" as a discrete, locatable object — a memorandum, a report, a contract. The agency's response to a request for "all records of X" was understood to require the retrieval of such discrete objects, not the running of a database query that would produce an output document that did not previously exist.

The case law on this question is uneven. Several federal circuits have held that an agency is not required to create new records in response to a FOIA request; others have recognized that the line between "creating a record" and "extracting existing records" is, in the database context, conceptually thin. State courts have reached similar results with greater variability. The practical effect, in our observation, is that sophisticated requesters increasingly frame their demands in terms calculated to fall within the agency's existing query templates — a workaround that benefits institutional requesters at the expense of the public.

Open-records regimes, designed for the filing cabinet, are being asked to carry the weight of database-scale inquiry.

The investigative-records exception and its expansive use

The FOIA exemptions, particularly Exemption 7 (law enforcement records) and Exemption 5 (deliberative process), have been the subject of sustained criticism for their expansive application by agency FOIA officers. The 2016 amendments narrowed Exemption 5 by imposing a 25-year limit on the deliberative-process privilege, but Exemption 7 remains a substantial obstacle to requests touching on law-enforcement activity. The federal courts have, in recent years, shown some willingness to require agencies to substantiate their Exemption 7 claims with more particularity than the boilerplate invocations that were once common, but the pace of doctrinal correction has been slow.

Records as evidence in private litigation

It bears observation, as a related but distinct matter, that public records also play a substantial role in civil litigation. The investigative reports produced by federal regulatory bodies — the National Transportation Safety Board's accident investigations, the Federal Motor Carrier Safety Administration's compliance reviews, the National Highway Traffic Safety Administration's defect investigations — are routinely sought through FOIA or analogous mechanisms by private litigants in personal injury actions, product liability suits, and commercial vehicle accident cases. The doctrinal questions that arise in those settings — the admissibility of agency findings under Federal Rule of Evidence 803(8), the deference owed to agency conclusions, the discoverability of underlying investigative materials — are familiar to civil litigators but rarely engaged by the academic FOIA literature. The asymmetry is unfortunate; the operational use of public records by private parties supplies one of the most rigorous tests of the statutes' practical functioning.

Toward administrative renewal

The most promising reform proposals, in our reading, focus less on additional statutory revision than on the modernization of agency FOIA infrastructure: standardized request-tracking systems, machine-assisted exemption review with appropriate human oversight, and meaningful resource allocation commensurate with the volume of incoming requests. The structural changes that would be required are not technically difficult; they require institutional commitment that has, to date, been intermittent.

For related commentary, see our pieces on privacy torts in the era of persistent data and on geofence warrants and the Fourth Amendment.