wikillm

Paper · 2023-12-08 · cs.CL, cs.CY

Generative AI in Higher Education: Seeing ChatGPT Through Universities' Policies, Resources, and Guidelines

Qualitative policy analysis of public GenAI and ChatGPT policies, guidelines and resources from 104 top-ranked U.S. universities (snapshot to April 2024). Thematic coding plus a -5 to 5 stance scale and resource point counts. Most universities are open but cautious and leave decisions to instructors (54.8%); none see AI detectors as fully reliable.

LLM ethicsAI-generated text detectioneducationpolicyqualitative-analysisgenerative-ai

arXivPDFMarkdown7 min read

AI-compiled by claude-haiku-5-5 on 2026-11-03, not yet reviewed by a human. Every claim cites its source; check it when a detail matters.

In plain words

Many universities in the United States have had to decide how students and teachers may use chatbots such as ChatGPT. This paper looks at what the top 100 American universities have published on that question: their official rules, teaching guides and support resources, as they stood in April 2024.

The authors read every document, sorted what they found into categories, and counted how often each category appeared. Most universities did not ban the tools. Many left the decision to each teacher, and most offered guides, sample syllabus wording or consultations. Concerns centred on ethics, accuracy and privacy. The authors suggest that teachers accept the tools, design assignments around learning goals, and rely on several kinds of evidence rather than on AI detectors alone.

TL;DR

  • A qualitative study of official policies and resources from 104 U.S. universities in the top-100 list, collected up to April 2024 §4.1.
  • Ban was chosen by none; most universities left the decision to instructors (57 of 104) §5.1 fig. 2.
  • Resources are common, with shared articles most frequent (74 of 104) §5.2.2.
  • No university treated AI-text detectors as fully reliable §5.2.3.
  • Use it as a descriptive picture of the policy landscape, not as evidence of the effect of any policy.

Problem

Universities need to guide teachers and students on generative AI, but published research on how institutions themselves respond was limited at the time of the study §1 §2. The authors ask three questions: how U.S. universities manage and regulate ChatGPT and other GenAI tools; what resources and guidance they give teachers; and whether school ranking tier or academic specialization changes those stances and resources §3.

Method

This is a document study, not a model or an algorithm. Nothing is trained, and no computational procedure is specified beyond the counting and scoring below.

Step 1: Sample. The authors took the top 100 U.S. universities in the 2024 U.S. News Best National University Rankings, which gives n = 104 institutions §4.1. For each university they ran a search that combined keywords such as "GenAI policy" or "GenAI guidelines" with the university name §4.1.

Step 2: Inclusion. A document was kept if it came from an official university source (for example the provost's office, an academic senate, a teaching centre, or the library), and was either a university-wide policy on GenAI and academic integrity, or a guideline or resource on using ChatGPT or other GenAI in teaching, learning or research §4.1. Online news articles, blog posts, and sources from a single department or programme were excluded §4.1. The inclusion flow is shown in fig. 1.

Step 3: Coding. Thematic analysis §4.2 was used. One researcher read part of the data and proposed child codes and parent codes. The other researchers reviewed and finalized the schemes. The schemes were then applied to all the data, and the team met regularly to check the coding and resolve disagreements §4.2. Two schemes were used:

  • The policy scheme has four parent codes: University Decision, Instructor Decision, Education Purpose, and Research Purpose tab. 1.
  • The resource scheme has three parent codes: Target Audience (three child codes), Types of Resources (five child codes) and Content Analysis (seven child codes) tab. 2.

Step 4: Scoring. Each university receives a stance score from the policy it was coded with, and a resource breadth score from the resources it offers §4.3. The stance points are fixed in tab. 3. Undecided or unclear policy scores 0, and the score is meant to be neutral and open. The resource score adds one point per target audience (at most 3), one per resource type (at most 5) and one per content category (at most 7), for a maximum of 15 §4.3.

Pseudocode
# Stance score for one university  [§4.3] [tab. 3]
# Input:  coded policy decision (a key of STANCE_POINTS)
# Output: stance score in [-5, 5]

STANCE_POINTS = {
    "ban": -5,
    "undecided": 0,
    "allow_with_conditions": 5,
    "instructor_prohibition_default": 1,
    "instructor_neutral": 2.5,
    "instructor_permissibility_default": 4,
}

def stance_score(policy):
    # Look up the fixed points for the coded decision  [§4.3] [tab. 3]
    return STANCE_POINTS[policy]
Pseudocode
# Resource breadth score for one university  [§4.3] [tab. 2]
# Input:  sets of codes found in its resources
# Output: integer in [0, 15]

def resource_score(audiences, types, contents):
    # One point per distinct target audience, at most 3  [§4.3]
    score = len(audiences)
    # One point per resource type, at most 5  [§4.3]
    score += len(types)
    # One point per content category, at most 7  [§4.3]
    score += len(contents)
    return score

Step 5: Tiers and focus groups. Ranks 1 to 33 form Tier 1 (n = 34), 34 to 66 form Tier 2 (n = 32), and 67 to 100 form Tier 3 (n = 38) §5.3.1. Separately, the authors split the sample into "technology-oriented" universities (n = 24) and "comprehensive" universities (n = 80) §5.3.2. The paper does not state how a university was assigned to each group beyond these examples.

Hyperparameters

This study has no learned parameters. The table lists the numeric choices that affect the results.

NameValueWhereNotes
Sampletop 100 U.S. universities, n = 104§4.12024 U.S. News Best National University Rankings
Collection cutoffApril 2024§4.1policies changed after this date are not covered
Stance pointsban -5; undecided 0; allow with conditions 5; instructor prohibition-default 1; instructor neutral 2.5; instructor permissibility-default 4tab. 3author-chosen scale; not validated in the paper
Resource pointsaudience max 3; type max 5; content max 7§4.3 tab. 2total max 15
Ranking tiers1-33 / 34-66 / 67-100§5.3.1Tier 1 is listed as ranks 1-33 but counted as n = 34
Academic focustechnology-oriented n = 24; comprehensive n = 80§5.3.2group rule given by example only
Coding procedureone researcher induces codes, others review, regular meetings§4.2inter-coder agreement: not stated
Analysis methodcounts and percentages; no statistical test§5 fig. 4 fig. 10"no significant correlation" is stated without a test

Results

Author-reported. Setup: 104 official U.S. university sources, collected to April 2024, coded by hand. No baseline and no statistical test. Counts are as given in the text; percentages are as reported.

SettingMetricBaselineThis paperSource
Policy stanceBannone0 (0%)§5.1 fig. 2
Policy stanceInstructor decidesnone57 (54.8%)§5.1 fig. 2
Policy stanceAllow with conditionsnone10 (9.6%)§5.1 fig. 2
Policy stanceUndecided or unclearnone37 (35.6%)§5.1 fig. 2
Default under "instructor decides"Prohibition by defaultnone27 of 57 (47.4%)§5.1 fig. 3
Default under "instructor decides"Neutralnone29 of 57 (50.9%)§5.1 fig. 3
Policy purposePlagiarismnone35 (33.7%)§5.1 fig. 5
Policy purposeAttribution and citationnone38 (36.5%)§5.1 fig. 5
Policy purposeLimitations of AI toolsnone31 (29.8%)§5.1 fig. 5
Policy purposeData privacynone28 (26.9%)§5.1 fig. 5
Policy purposeIntellectual propertynone13 (12.5%)§5.1 fig. 5
Target audienceFacultynone70 (67.4%)§5.2.1 fig. 6
Target audienceStudentsnone19 (17.8%)§5.2.1 fig. 6
Target audienceGeneral audiencenone15 (14.7%)§5.2.1 fig. 6
Resource typeShared articles or blogsnone74 (71.1%)§5.2.2 fig. 7
Resource typeSyllabus templates or examplesnone65 (62.5%)§5.2.2 fig. 8
Resource typeOne-on-one consultationsnone41 (39.4%)§5.2.2
Resource typePractical workshopsnone40 (38.5%)§5.2.2 fig. 7
Resource typeDialogues and discussionsnone20 (19.2%)§5.2.2 fig. 7
ContentGeneral technical introductionnone85 (81.7%)§5.2.3 fig. 9
ContentDetection tools discussednone59 (56.7%)§5.2.3 fig. 9
ContentPrevention strategiesnone57 (54.8%)§5.2.3 fig. 9
ContentPedagogical applicationsnone56 (53.8%)§5.2.3 fig. 9
ContentLimitations of GenAInone56 (53.8%)§5.2.3 fig. 9
ContentEthical considerationsnone62 (59.6%)§5.2.3 fig. 9
ContentData privacynone38 (36.5%)§5.2.3 fig. 9
DetectorsUniversities that call detectors fully reliablenone0 (0%)§5.2.3
TiersRanking tier vs stance and resourcesnoneno significant correlation reported§5.3.1 fig. 10
FocusTechnology-oriented vs comprehensivenonetechnology-oriented universities are more cautious and have more resources; no test reported§5.3.2 fig. 11

The paper's pedagogical suggestions are in §6.1 and tab. 4. Policy suggestions are in §6.2. The conclusion summarises both §7.

Paper vs code

No official code.

The arXiv abstract and comments contain no code link. The paper links a Google Sheet with the dataset §4.1. That is data, not code, and it is not used here. There is no project page. A GitHub repository search for "genai university policies" returned several candidates, but none could be tied to the authors, so none is used.

Pitfalls

  • Counts don't add up in one place. Instructor-decides universities total 57 §5.1, but the two defaults add to 56 (27 and 29) §5.1. One university is unaccounted for.
  • Percentages differ from counts over 104. For example, 19 of 104 is 18.3%, not the 17.8% in the text, and 15 of 104 is 14.4%, not 14.7% §5.2.1. Use the counts.
  • Tier ranges disagree. Tier 1 is "top 1-33" but is counted as n = 34 §5.3.1.
  • The stance scale is the authors' own. The point values in tab. 3 are not derived or validated in the paper. Ranking by these scores is only as reliable as the coding.
  • Coding reliability is not reported. The paper describes team review but gives no agreement statistic §4.2.
  • Correlation is asserted, not tested. The paper says there is no significant correlation between rank and depth of resources §5.3.1, but reports no test. The tier comparison is descriptive.
  • Snapshot. Documents are as found up to April 2024 §4.1. Policies may have changed; the authors say so §4.1.
  • Scope. Only the top 100 U.S. universities are covered. Department-level policies were excluded §4.1, so the findings do not describe what individual courses do.
  • Dataset access. The dataset is linked as a Google Sheet §4.1. Its current availability was not checked.

Lineage

  • Builds on: thematic analysis as the coding method §4.2, cited to Braun and Clarke (2006) in the paper.
  • Compared against: none. The paper is descriptive.
  • Superseded by: not known from content in this wiki.

Source and license

Adapted from “Generative AI in Higher Education: Seeing ChatGPT Through Universities' Policies, Resources, and Guidelines” by Hui Wang, Anh Dang, Zihao Wu, Son Mac (arXiv:2312.05235), used under CC BY 4.0. Changes: condensed and restructured for implementation, with tables, equations and algorithms taken from the paper and its code, each cited to its source. Not affiliated with or endorsed by the authors.