Within Baselines
The Baseline Should Record the Detector Too
Long ordinary-sky records show not just what passes overhead, but how the detector fragments, misses, and invents tracks.
On this page
- Why false positives belong in the archive
- How track fragments can mimic unusual motion
- Using failures as calibration evidence
Page outline Jump by section
Introduction
Long-duration all-sky archives are valuable not only because they record everything that crosses the sky, but because they reveal how the observing system itself behaves over months or years. For automated instrumented UFO or unidentified anomalous phenomena (UAP) detectors, this distinction is crucial. A continuous archive accumulates thousands of examples of false alarms, missed detections, fragmented tracks and changing sensor performance. These records become evidence about the detector, not just the sky.
This is one of the main lessons emerging from modern astronomical monitoring networks and recent UAP instrumentation efforts. NASA’s independent UAP study concluded that poor calibration, incomplete sensor metadata and the absence of long-term baseline observations are major obstacles to interpreting unusual observations. Rather than treating false detections as embarrassing failures, well-designed all-sky archives preserve them because they provide the calibration history needed to judge future events. [NASA Science]science.nasa.govNASA ScienceIndependent Study Team ReportAt present, analysis of UAP data is hampered by poor sensor calibration, the lack of multiple me…
Why false positives belong in the archive
An automated detector cannot improve unless its mistakes are recorded alongside its successes. Every false trigger documents a combination of environmental conditions and sensor behaviour that caused the system to misclassify an ordinary event.
In practice, these archived mistakes often fall into recurring categories:
- insects passing close to wide-angle lenses;
- birds crossing at dawn or dusk;
- aircraft lights viewed through haze;
- cloud edges producing rapidly changing contrast;
- hot pixels and defective sensor elements;
- lens flare, internal reflections and condensation;
- compression artefacts or dropped image frames;
- transient electronic noise.
Individually these events may appear unusual. Collectively they establish a statistical picture of how frequently each failure mode occurs, under which weather conditions, at which viewing angles and during which seasons.
Meteor-surveillance projects illustrate this principle well. Networks such as the Global Meteor Network (GMN), CAMS (Cameras for Allsky Meteor Surveillance) and the Raspberry Pi Meteor Station (RMS) process enormous numbers of detections every night. Automated filtering is continually refined by comparing accepted events with rejected ones, allowing algorithms to distinguish genuine meteors from aircraft, clouds, insects and image artefacts more reliably over time. [OUP Academic+2cams.seti.org]academic.oup.comOUP AcademicThe Global Meteor Network – Methodology and first resultsby D Vida · 2021 · Cited by 126 — The Global Meteor Network (GMN) ut…
The archive therefore becomes a catalogue of detector behaviour as much as a catalogue of sky events.
How track fragments can mimic unusual motion
A particularly instructive class of sensor mistakes involves fragmented tracks. An object moving smoothly across the sky can appear to accelerate, stop, split or change direction when the recording system intermittently loses it.
Several mechanisms contribute to this effect:
- Variable sensitivity. A faint object may disappear below the detection threshold before reappearing several frames later.
- Frame loss. Missing video frames can make continuous motion appear discontinuous.
- Cloud interruption. Thin cloud may obscure only part of a trajectory.
- Tracking software limitations. Detection algorithms often reconnect separated image segments imperfectly.
- Optical distortion. Wide-angle lenses stretch apparent motion differently near the horizon than near the zenith.
When only isolated track fragments survive processing, automated software may incorrectly infer abrupt manoeuvres or inconsistent velocities.
Meteor networks have devoted considerable effort to reducing these errors because accurate trajectory reconstruction depends on stitching together many short observations. Modern systems therefore compare detections across multiple cameras, apply geometric consistency tests and estimate uncertainties rather than assuming every reconstructed path is physically correct. [ADS+2arXiv]ui.adsabs.harvard.eduWe have developed a set of methods to detect meteor light traces captured by all-sky CCD cameras. Operating at small automatic observator…
For automated UAP detection, the lesson is straightforward: unusual motion should not be accepted until investigators determine whether the apparent behaviour originated in the tracked object or in the tracking algorithm itself.
The baseline should record the detector too
A useful baseline contains considerably more than images.
Each observation benefits from accompanying records such as:
- detector temperature;
- exposure settings;
- gain changes;
- focus state;
- firmware or software version;
- camera orientation;
- weather conditions;
- timing accuracy;
- calibration history;
- known hardware faults.
Without this contextual information, later investigators may be unable to distinguish between an environmental anomaly and a sensor anomaly.
NASA’s UAP study specifically highlights sensor metadata as essential because apparent anomalies have, in some cases, proved to be sensor artefacts once calibration and metadata were examined carefully. The report argues that understanding the instrument is inseparable from understanding the observation. [NASA Science]science.nasa.govNASA ScienceIndependent Study Team ReportAt present, analysis of UAP data is hampered by poor sensor calibration, the lack of multiple me…
Modern all-sky observatories increasingly treat metadata as part of the scientific observation rather than administrative bookkeeping.
Using failures as calibration evidence
Repeated failures can become powerful calibration tools.
Suppose an all-sky camera repeatedly reports unexplained luminous objects whenever ambient temperature drops below freezing. Initially these detections may appear unrelated. Over months, however, the archive may reveal that every event coincides with a subtle focus shift caused by thermal contraction of the lens assembly.
Likewise, if false tracks consistently appear in one corner of the image after heavy rain, investigators may eventually identify moisture entering the optical housing rather than an unexplained aerial phenomenon.
This kind of diagnosis is only possible because the archive preserves both the erroneous detections and the operating conditions surrounding them.
Recent work on all-sky infrared arrays demonstrates the same philosophy. Calibration procedures extend beyond laboratory measurements to include observations of known aircraft whose positions are independently verified through Automatic Dependent Surveillance–Broadcast (ADS-B) transmissions. Comparing measured tracks with known trajectories allows systematic pointing and alignment errors to be identified and corrected before ambiguous observations are interpreted. [MDPI]mdpi.comCommissioning an All-Sky Infrared Camera Array for…by L Domine · 2025 · Cited by 11 — One of the key instruments is an all-sky inf…
Failures therefore become measurable calibration references instead of discarded noise.
Long archives expose slow changes in the instrument
Some of the most important detector problems only emerge after months or years of operation.
Examples include:
- gradual sensor ageing;
- increasing dead-pixel populations;
- optical contamination from dust or pollen;
- changing gain characteristics;
- clock drift;
- seasonal thermal expansion;
- mechanical sag in camera mounts.
None of these changes is obvious from a single night’s observations. Continuous archives reveal trends that would otherwise masquerade as changes in the sky itself.
Large meteor camera networks have shown the importance of maintaining consistent calibration across many stations, since small systematic errors accumulate into measurable biases in trajectory estimates and radiant distributions. Long-term calibration monitoring is therefore treated as an ongoing operational requirement rather than a one-time setup procedure. [Diva Portal]diva-portal.orgDiva Portal Calibration of Meteor CamerasDiva PortalCalibration of Meteor CamerasJuly 4, 2024 — by P Möllerström · 2024 · Cited by 1 — The goal is to develop a common automated c…
Why this matters for automated UFO detectors
Within an automated UAP detection system, the archive serves two parallel scientific purposes.
First, it establishes the ordinary pattern of the local sky by recording aircraft, satellites, meteors, weather and other routine phenomena over long periods.
Second—and equally importantly—it establishes the ordinary pattern of the detector itself. It records how frequently the instrument generates false positives, under what circumstances it loses tracks, how environmental conditions affect measurements and how calibration changes alter detection performance.
This dual record makes later investigations substantially stronger. Instead of asking only whether an object behaved unusually, investigators can also ask whether the instrument had ever behaved the same way before. That comparison often determines whether an apparent anomaly survives careful scrutiny or is recognised as another example of a documented sensor failure.
In this sense, the most valuable all-sky archive is not merely a catalogue of everything that flew overhead. It is a continuous history of the observing system, preserving its strengths, weaknesses and recurring mistakes with enough detail that future observations can be interpreted against a well-understood baseline rather than in isolation.
Amazon book picks
Further Reading
Books and field guides related to The Baseline Should Record the Detector Too. Use these as the next step if you want deeper reading beyond the article.
The Demon-Haunted World
Excellent fit for false positives, error traps, and disciplined interpretation of unusual claims.
How to Measure Anything
Explains measurement uncertainty, imperfect data, and practical ways to reduce ambiguity.
Thinking, Fast and Slow
Useful for understanding why people and systems overinterpret noisy or incomplete signals.
NightWatch
Grounds detector mistakes in ordinary observing realities such as haze, glare, and sky traffic.
eBay marketplace picks
Marketplace Samples
Example marketplace items related to this page. Use the search link to explore similar finds on eBay.
Endnotes
-
Source: science.nasa.gov
Link: https://science.nasa.gov/wp-content/uploads/2023/09/uap-independent-study-team-final-report.pdfSource snippet
NASA ScienceIndependent Study Team ReportAt present, analysis of UAP data is hampered by poor sensor calibration, the lack of multiple me...
-
Source: nasa.gov
Title: update nasa shares uap independent study report names director
Link: https://www.nasa.gov/news-release/update-nasa-shares-uap-independent-study-report-names-director/Source snippet
UPDATE: NASA Shares UAP Independent Study Report14 Sept 2023 — We found that NASA can help the whole-of-government UAP effort through sys...
-
Source: academic.oup.com
Link: https://academic.oup.com/mnras/article/506/4/5046/6347233Source snippet
OUP AcademicThe Global Meteor Network – Methodology and first resultsby D Vida · 2021 · Cited by 126 — The Global Meteor Network (GMN) ut...
-
Source: cams.seti.org
Title: Cameras for Allsky Meteor Surveillance (CAMS)Mission statement
Link: https://cams.seti.org/Source snippet
CAMS is an automated video surveillance of the night sky to validate the IAU Working List of Meteor Showers. [Contact].Read more...
-
Source: arxiv.org
Link: https://arxiv.org/abs/2009.01372Source snippet
High precision meteor observations with the Canadian Automated Meteor Observatory -- Data reduction pipeline and application to mete...
-
Source: mdpi.com
Link: https://www.mdpi.com/1424-8220/25/3/783Source snippet
Commissioning an All-Sky Infrared Camera Array for...by L Domine · 2025 · Cited by 11 — One of the key instruments is an all-sky inf...
-
Source: arxiv.org
Link: https://arxiv.org/abs/2411.07956Source snippet
Commissioning An All-Sky Infrared Camera Array for...by L Dominé · 2024 · Cited by 11 — Their calibration includes a novel extrinsic cal...
-
Source: diva-portal.org
Title: Diva Portal Calibration of Meteor Cameras
Link: https://www.diva-portal.org/smash/get/diva2%3A1881881/FULLTEXT01.pdfSource snippet
Diva PortalCalibration of Meteor CamerasJuly 4, 2024 — by P Möllerström · 2024 · Cited by 1 — The goal is to develop a common automated c...
Published: July 4, 2024
-
Source: science.nasa.gov
Link: https://science.nasa.gov/uap/Source snippet
nasa.govUAP9 Jun 2022 — A study team to examine unidentified anomalous phenomena (UAPs) – that is, observations of events in the sky that...
-
Source: nasa.gov
Title: to release discuss unidentified anomalous phenomena report
Link: https://www.nasa.gov/news-release/nasa-to-release-discuss-unidentified-anomalous-phenomena-report/Source snippet
NASA to Release, Discuss Unidentified Anomalous...12 Sept 2023 — NASA defines UAP as observations of events in the sky that cannot be id...
-
Source: arxiv.org
Link: https://arxiv.org/html/2506.00125v1Source snippet
1 Introduction30 May 2025 — The scientific study of Unidentified Anomalous Phenomena (UAP) is severely hindered by inadequate data collec...
Published: May 2025
-
Source: arxiv.org
Link: https://arxiv.org/abs/2507.21711Source snippet
Nighttime Cloud Detection, Tracking and Prediction with All...by S Buntin · 2025 · Cited by 2 — This paper presents a novel method for r...
-
Source: diva-portal.org
Link: https://www.diva-portal.org/smash/get/diva2%3A1978491/FULLTEXT01.pdfSource snippet
DEGREE PROJECTby O Jansson · 2025 — This thesis presents im- plementation, modification and a test result of the Raspberry Pi Meteor Stat...
-
Source: ui.adsabs.harvard.edu
Link: https://ui.adsabs.harvard.edu/abs/2017EM%26P..120..189S/abstractSource snippet
We have developed a set of methods to detect meteor light traces captured by all-sky CCD cameras. Operating at small automatic observator...
Additional References
-
Source: github.com
Link: https://github.com/CroatianMeteorNetwork/RMSSource snippet
CroatianMeteorNetwork/RMS: RPi Meteor StationThe RMS software provides a complete, automated pipeline for meteor observation. It currentl...
-
Source: hangar1publishing.com
Link: https://hangar1publishing.com/blogs/ufos-uaps-and-aliens/nasa-ufo-footage-evidence?srsltid=AfmBOooABsrfmUzMPMmXI5WhJ5epf4ZJGrDOTTtB7ftgDpMZx4kbLE2hSource snippet
NASA UFO Footage: The Shocking TruthNASA's unexplained UFO footage forces scientific scrutiny. Explore the space agency's dramatic evolut...
-
Source: managingexpectations.net
Link: https://managingexpectations.net/blog/articles/nasa-uap-study-managing-expectations.htmlSource snippet
NASA's UAP Study: What It Did — and Did Not — ConcludeThe panel said UAP analysis is hampered by “poor sensor calibration,” a lack of mul...
-
Source: globalmeteornetwork.groups.io
Link: https://globalmeteornetwork.groups.io/g/main/topics?after=1610826945948680937&page=94Source snippet
at Night magazine subscribers may have noticed a DIY Astronomy article in this month's edition explaining how to set up the RMS system to...
-
Source: avi-loeb.medium.com
Title: a new calculation on the fly to the nasa uap study 2dacaf860cac
Link: https://avi-loeb.medium.com/a-new-calculation-on-the-fly-to-the-nasa-uap-study-2dacaf860cacSource snippet
New Calculation on the Fly to the NASA UAP Study - Avi LoebThe NASA Study will examine unclassified data on UAP in an attempt to separate...
-
Source: thedebrief.org
Title: nasas unidentified anomalous phenomena report key takeaways
Link: https://thedebrief.org/nasas-unidentified-anomalous-phenomena-report-key-takeaways/Source snippet
NASA's Unidentified Anomalous Phenomena Report14 Sept 2023 — “At present, analysis of UAP data is hampered by poor sensor calibration, th...
-
Source: rev.com
Title: nasa holds first public meeting on ufos transcript
Link: https://www.rev.com/transcripts/nasa-holds-first-public-meeting-on-ufos-transcriptSource snippet
1 Jun 2023 — The UAP independent study was commissioned to create a roadmap on how to use the tools of science to evaluate and categorize...
-
Source: space.com
Title: sensor metadata, and the lack of [baseline data]({{ ‘baseline-data/’ | relative_url }}),” the report states.Read more
Link: https://www.space.com/nasa-ufo-uap-study-team-first-results-revealedSource snippet
NASA UFO report finds no evidence of 'extraterrestrial...14 Sept 2023 — "At present, analysis of UAP data is hampered by poor sensor cal...
-
Source: medium.com
Link: https://medium.com/%40omarvferro/seriously-are-all-those-blurry-dots-in-infrared-cameras-and-distant-lights-in-the-sky-the-best-8d59e3e75f74Source snippet
Seriously, Are All Those Blurry Dots in Infrared Cameras...NASA UAP Report Analysis: Evaluating Extraterrestrial Evidence, Infrared Sens...
-
Source: en.wikisource.org
Title: Page:UAP Independent Study Team Final Report
Link: https://en.wikisource.org/wiki/Page%3AUAP_Independent_Study_Team_-_Final_Report.pdf/15Source snippet
wikisource.orgPage:UAP Independent Study Team - Final Report.pdf/1512 Nov 2023 — Indeed, several apparent UAP have been demonstrated to b...
Topic Tree