Machine Learning

Machine Learning for ISEF Project: Complete Guide

Build a winning machine learning ISEF project with this guide to topic selection, datasets, models, experimental design, and judging strategy for students.

Andrew Martin
13 min read
Machine learning for ISEF project workflow with claymation data, model, and trophy elements in blue and purple

Ship a Baseline Before You Optimize

Train and evaluate a logistic regression or random forest baseline in week one. Every fancier model you try must beat that number to earn a place on your poster.

A machine learning project is one of the strongest ways to compete at the Regeneron International Science and Engineering Fair (ISEF), the world’s largest pre-college STEM competition. About 1,800 finalists from more than 60 countries qualify each year through over 400 affiliated regional and state fairs, according to the Society for Science. Roughly $9 million in prizes is awarded, including the $75,000 Gordon E. Moore Award.

The challenge is that “I trained a neural network” is no longer impressive on its own. Judges have seen thousands of image classifiers. What still wins is a clearly framed scientific question, a real dataset, an honest evaluation, and a project a high school student can defend out loud. This guide walks through every phase of a machine learning ISEF project — from picking a research question through judging-day strategy — using only tools and methods a motivated student can actually pull off in a four-to-six-month timeline.

What Makes a Strong Machine Learning ISEF Project

A strong machine learning ISEF project pairs a specific, measurable research question with a credible dataset, a simple-first modeling approach, and a clear comparison against a baseline. Judges score Creative Ability, Scientific Thought, Thoroughness, Skill, and Clarity. ML projects win when the science is original — not when the model is large.

How ISEF Categories Map to ML Projects

Choose the category by the scientific question, not the algorithm. The same convolutional neural network can compete in three completely different categories depending on what it is predicting.

ISEF CategoryCodeStrong ML Project Examples
Robotics and Intelligent MachinesROBOAutonomous navigation, gesture recognition, reinforcement-learning game agents
Systems SoftwareSOFTNew optimizer, compression algorithm, fairness audit framework
Computational Biology and BioinformaticsCBIOProtein structure prediction, variant calling, single-cell clustering
Translational Medical ScienceTMEDDiagnostic models on chest X-rays, ECG arrhythmia detection
Earth and Environmental SciencesEAEVWildfire spread prediction, satellite deforestation tracking
Behavioral and Social SciencesBEHABias auditing in hiring models, hate-speech detection studies
Energy: Sustainable Materials and DesignENMCBattery degradation forecasting, materials discovery via active learning

Society for Science announced ROBO as a standalone category in 2024 to handle the volume of intelligent-systems entries, and CBIO remains one of the most competitive sections every year.

The Judging Criteria — What Actually Wins

The five published ISEF judging criteria are not equal weights, but they are equal in the sense that a project must clear a bar on each. Creative Ability rewards a question nobody else has framed this way; Scientific Thought rewards a defensible experimental design; Thoroughness rewards baseline comparisons and ablations; Skill rewards code and statistics you actually understand; Clarity rewards a poster and a five-minute pitch a non-specialist judge follows.

Two patterns separate winning ML projects from the rest, according to common judging feedback published by past ISEF Grand Award winners on the Society for Science blog:

  • A clearly stated baseline. The strongest entries say “logistic regression scored 0.71 AUC; our method scored 0.86 AUC — here is the ablation showing which component contributed most.” Projects without baselines lose Thoroughness points.
  • Honest discussion of limitations. Judges trust students who say “the dataset is small, here is how I controlled for that with cross-validation” more than students who hide weaknesses.

Why “Simple Models, Strong Science” Beats “Big Models, Weak Science”

“The projects that stand out at ISEF are the ones where the student can explain every line of code and every choice on the poster. A judged interview reveals very quickly whether the student trained the model or whether ChatGPT did.” — paraphrased judging guidance from the Society for Science ISEF mentor handbook

A 200-line scikit-learn notebook with rigorous evaluation can outscore a million-parameter transformer the student cannot defend. Judges allocate roughly 6 to 12 minutes per interview, so depth of understanding matters far more than parameter count. This is also a practical truth: students rarely have the compute or labeled data to train large models from scratch, but they can absolutely run a defensible study with small models on a focused dataset.

How to Pick a Winning ML Topic and Research Question

A winning ISEF machine learning topic starts with a measurable real-world problem, finds a public dataset that addresses it, and frames a falsifiable hypothesis. Avoid generic prompts like “predict house prices” or “classify cats and dogs.” Use the four-filter framework below to narrow from a broad interest to a defensible question in about two weeks.

The Four-Filter Topic Selection Framework

Run every candidate idea through all four filters. If any filter fails, refine or move on:

  1. Personal interest — You will spend 4 to 6 months on this. Pick something you actually care about. The strongest projects often come from students solving a problem in their own community (school cafeteria food waste, local wildlife identification, regional air quality forecasting).
  2. Data accessibility — Can you legally obtain enough labeled data within your timeline? If the dataset does not exist on Kaggle, the UCI Machine Learning Repository, Hugging Face, or a government open-data portal, can you ethically collect 500 to 5,000 labeled examples yourself in 4 to 6 weeks?
  3. Compute feasibility — Can you train the model on a laptop, a free Google Colab GPU session (12-hour runtime), or Kaggle Notebooks (30 GPU hours per week)? If not, scope it down.
  4. Real-world impact — Can you write a one-sentence “so what” statement that a judge from outside ML would understand? “Detecting early-stage skin cancer from smartphone photos with 91% sensitivity” beats “training a ResNet-50 on dermatoscopic images.”

High-Yield Project Idea Categories for 2026

The following project types consistently produce ISEF finalists because they combine fresh data with under-explored questions:

  • Health and medicine — early disease detection from low-cost signals (smartphone audio for cough classification, smartwatch PPG for arrhythmia screening). Use the open MIT-BIH Arrhythmia Database or PhysioNet challenges.
  • Climate and environment — wildfire spread prediction from satellite imagery, microplastic identification, air quality nowcasting. NASA Earthdata and NOAA portals are free.
  • Accessibility — sign language recognition with Google Teachable Machine and webcam-based eye tracking. Both have strong impact narratives.
  • Fairness and transparency — auditing a deployed model (resume screener, loan approval, school discipline classifier) for demographic bias. The BEHA category rewards this work strongly because it is socially urgent and rarely well done.
  • Scientific discovery — using ML to find new patterns in physics, astronomy, or chemistry datasets. The CERN Open Data Portal and Sloan Digital Sky Survey are gold mines.

Writing a Falsifiable Research Question

Convert your topic into a single sentence of the form: “Can [model approach] predict [target] from [input] better than [baseline] on [dataset], measured by [metric]?”

GOOD:

“Can a 3-layer LSTM predict 24-hour PM2.5 concentrations from past 7-day meteorological data better than a persistence baseline on the EPA AirNow dataset, measured by RMSE and within ±5 µg/m³ accuracy?”

BAD:

“Can AI help predict air pollution?”

The good version commits to specific data, a specific baseline, and a specific metric. Judges can evaluate whether you answered it. The bad version cannot fail, which is exactly why it cannot win.

Ready to implement AI in your business? GrowthGear’s team has helped 50+ startups integrate AI solutions that drive real results. Book a Free Strategy Session to discuss your AI roadmap, and remember: the same evaluation rigor that wins ISEF wins board approval for production ML.

Data, Models, and Tools You Can Realistically Use

For an ISEF machine learning project, free public datasets and free compute tiers cover roughly 95% of competitive entries. Focus your scarce time on data cleaning and model evaluation, not on chasing exotic architectures or buying GPU credits. The stack below is what current ISEF finalists are actually using.

Free Datasets, Compute, and Libraries

ResourceWhat It ProvidesRealistic Limits
Kaggle Datasets300,000+ public datasets across domainsFree; some require sign-in
UCI ML RepositoryClassic tabular datasets with citationsFree; mostly tabular
Hugging Face DatasetsText, audio, image datasets with loadersFree; some gated
NASA Earthdata, NOAA, EPAClimate, satellite, environmental dataFree; large file sizes
Google Colab FreeT4 GPU, 12-hour sessions, JupyterDisconnects after idle
Kaggle NotebooksT4/P100 GPU, ~30 GPU hours/weekHard weekly cap
GitHub CodespacesFree 60 hours/month CPU dev environmentNo GPU
Hugging Face SpacesFree CPU demo hosting for judgesSlow inference

For most projects, scikit-learn, PyTorch, and pandas cover modeling. Add Hugging Face Transformers for any NLP project and PyTorch Lightning if you want clean training-loop boilerplate. Tools like Google Teachable Machine and TensorFlow Playground are excellent for prototyping and teaching judges the intuition behind your model — even if the final entry uses a deeper stack.

Picking the Right Model (Simple First)

The single biggest mistake students make is picking the model before understanding the data. Always train a baseline first — a one-hour scikit-learn baseline gives you a number to beat and protects you from overfitting fancy models to small datasets.

Data TypeFirst BaselineStronger Next StepWhen to Go Deeper
Tabular (≤ 10K rows)Logistic regressionRandom forest or XGBoostDeep tabular nets rarely beat XGBoost
Images (1K–10K)Pretrained ResNet-18 feature extraction + LRFine-tune small CNNOnly if you have 50K+ labeled images
Text classificationTF-IDF + logistic regressionDistilBERT fine-tuneFull transformers if data > 50K labels
Time seriesARIMA or persistence forecastXGBoost on lag featuresLSTM only if you can justify it
AudioSpectrogram + small CNNPretrained YAMNet embeddingsWhisper-style models for transcription

Follow the how-to-train-machine-learning-models-beginners checklist for the full training loop, and protect every model against overfitting by using k-fold cross-validation and a held-out test set you only touch once at the very end.

Reproducibility — The Trick Judges Love

A reproducible notebook signals serious science. Every winning ML project should ship:

  • A single notebook that runs end-to-end from raw data to final metric.
  • A requirements.txt with pinned package versions (e.g., scikit-learn==1.5.0).
  • A fixed random seed at the top of training code (np.random.seed(42); torch.manual_seed(42)).
  • A data/README.md explaining where each file came from and any license restrictions.
  • A short demo — a Hugging Face Space or Streamlit app — judges can try at the booth.

A GitHub repository with these five elements demonstrates the Skill and Thoroughness judging criteria without you having to say a word.

Designing the Experiment, Posters, and Judging Strategy

A strong ISEF machine learning project closes the loop: a clear research question, a tight experimental design that controls for confounders, a poster that communicates results in 30 seconds, and a five-minute interview the student can deliver in their sleep. This section covers all four — the parts of the project that most often separate a wall-of-honor entry from a Grand Award.

Experimental Design That Survives Judging

ML judges will probe for three specific weaknesses: data leakage, evaluation choices, and overfitting. Design your experiment to defend against each.

  • Prevent leakage — fit any preprocessing (scaling, imputation, encoders) only on the training fold inside a scikit-learn Pipeline. Use TimeSeriesSplit for any time-ordered data, and GroupKFold when multiple rows come from the same patient, user, or session.
  • Choose the right metric — accuracy is misleading on imbalanced data. For rare-class problems (fraud, disease), report precision and recall plus PR-AUC. For ranking problems, report NDCG. Always show a confusion matrix.
  • Run a real baseline — random guessing, majority class, persistence (for time series), or a published benchmark on the same dataset. Without a baseline, your headline number is meaningless.
  • Report variance, not just a point estimate — “mean F1 0.84 ± 0.03 across 5 folds” beats “F1 0.84” because it shows you understand statistical uncertainty.

A short, named statistical test is also worth its weight in gold. A McNemar test comparing your model to the baseline at p < 0.05 gives judges a sentence they can repeat to other judges: “this student showed statistically significant improvement over baseline.”

Poster and Notebook Design — The 30-Second Test

A judge walks up. You have 30 seconds before they decide whether to ask follow-up questions. Your poster must answer four questions in that time:

  1. What problem are you solving and why does it matter? (one sentence, top-left)
  2. What did you do? (one method diagram, center)
  3. What did you find? (one results figure, top-right — usually a metric vs. baseline bar chart or confusion matrix)
  4. What is the impact? (one sentence, bottom-right)

Common mistake: Students cover the poster in equations and dataset descriptions. Judges read for findings first. Move methods to a printed handout or the lower third of the poster, and reserve eye-level real estate for the question, the result, and the impact.

For the same reason posters get evaluated like winning sales presentations, the strongest ML posters open with the headline result — not the literature review. Use analytics tracking on any online demo to count visitor interactions if you launch a Hugging Face Space; it adds a measurable engagement dimension to your impact narrative.

Disclosing AI Tools and Mentor Help

ISEF Form 1A requires students to disclose all mentor contributions, lab access, and (as of the 2025-2026 cycle) generative AI assistance. The rule is simple: if it was not entirely your work, name it. Acceptable disclosure looks like:

  • “I used GitHub Copilot to write the data-loading utility in dataset.py. I wrote all model code, evaluation code, and analysis by hand.”
  • “ChatGPT (GPT-4o, accessed March 2026) generated the initial draft of the literature-review section, which I then verified and rewrote with original citations.”

Undisclosed AI assistance is a disqualification risk. Disclosed AI assistance is not — judges expect modern students to use modern tools. The disclosed version actually scores better on Skill because it demonstrates self-awareness.

Five-Minute Pitch Script Template

Memorize this five-minute structure. Practice it until you can deliver it in your sleep — then practice the 60-second compressed version for judges who are short on time:

  1. Minute 1 — The hook (problem, why it matters, who is affected).
  2. Minute 2 — The research question (state it word-for-word; show the falsifiable form).
  3. Minute 3 — The method (data source, baseline, your model, evaluation protocol).
  4. Minute 4 — The result (point at the bar chart, name the metric, name the baseline you beat).
  5. Minute 5 — Limitations and next steps (acknowledge the small dataset, the missing demographic, the next experiment).

Judges remember the limitations slide more than the headline number, because it tells them whether you understand your own work. Pair this with the broader judging context in the machine learning algorithms and applications guide so you can answer “why did you pick this algorithm over alternative X?” cleanly.


Take the Next Step

A standout machine learning ISEF project blends a real research question with the same discipline that powers production AI — clear baselines, honest evaluation, and reproducible code. Whether you are a student preparing for regionals, a teacher mentoring an ISEF team, or a business leader who wants the same rigor on your AI initiatives, GrowthGear can help map the technical and strategic gaps.

Book a Free Strategy Session →


Summary: Machine Learning ISEF Project at a Glance

PhaseKey DeliverableTime BudgetTop Pitfall
Topic and questionOne-sentence falsifiable research question2 weeksVague hypothesis
Data collectionCleaned, licensed dataset with data/README.md4–6 weeksInsufficient labels
BaselineOne-hour scikit-learn model with a metric1 daySkipping it entirely
ModelingFinal model that beats baseline6–8 weeksPremature deep nets
Evaluationk-fold CV, confusion matrix, statistical test1–2 weeksData leakage
ReproducibilityNotebook + pinned requirements.txt + seedOngoingLast-minute rerun
Poster30-second-readable layout with headline result2 weeksEquations on top
Pitch5-minute scripted talk with 60-second version2 weeksReading off poster

Sources & References

Frequently Asked Questions

Yes. Machine learning projects compete strongly in Robotics and Intelligent Machines (ROBO), Systems Software (SOFT), and Computational Biology (CBIO). Judges reward original problem framing, honest evaluation, and a real-world dataset over flashy model architectures.

Start with the simplest model that fits the data: logistic regression or random forests for tabular data, a small CNN for images, and a fine-tuned BERT or distilled transformer for text. A simple, well-evaluated model beats a black-box deep network with weak validation.

Plan for 4 to 6 months total: 4 weeks for literature review and topic refinement, 4 to 6 weeks for data collection and cleaning, 6 to 8 weeks for modeling and evaluation, and 4 weeks for writing, poster design, and judging preparation.

Most projects can run on a laptop using scikit-learn, PyTorch CPU, or Google Colab's free tier. Only computer vision and large language model fine-tuning typically require a GPU. Kaggle Notebooks and Colab give every student about 30 GPU hours per week for free.

Match the project to its scientific question, not the algorithm. A medical diagnosis model belongs in Translational Medical Science (TMED), a protein folding model in Computational Biology (CBIO), a fairness audit in Behavioral and Social Sciences (BEHA), and a new optimizer in Systems Software (SOFT).

Judges weight Creative Ability, Scientific Thought, Thoroughness, Skill, and Clarity. For ML projects, that means a novel research question, a well-justified baseline comparison, rigorous train and test splits, runnable code with reproducible results, and a poster that explains trade-offs in plain English.

Yes, but disclose it. ISEF rules let students use generative AI as a tool but require documenting which prompts produced which code, text, or analysis in the research plan and project notebook. Undisclosed AI assistance is treated the same as undisclosed mentor help.