Reconnaissance and OSINT
Reconnaissance gathers facts about a target before deeper security testing, while open-source intelligence turns publicly or commercially available information into findings that answer a defined question. Together they map people, domains, systems, and relationships without treating every clue as proof.
itOffensive security and application security | OpenSkills.info
Course pathWalk it in order
Look it upDip in anytime
Go furtherLeaves this page
Intro
Reconnaissance and OSINT
Reconnaissance is the deliberate collection of information about a target before deeper security testing. Open-source intelligence, or OSINT, is intelligence derived exclusively from publicly or commercially available information to address a defined requirement. In an authorized security assessment, the two overlap: reconnaissance defines what is exposed, and OSINT supplies many of the observations used to build that map.
The work is not a search-engine scavenger hunt. It is an evidence process:
Question and scope → collection → normalization → pivots → verification → preservation → assessment → report
The question controls the process. “What internet-facing systems belong to this organization?” produces different collection choices from “Is this image connected to the claimed event?” Scope defines which entities, time period, sources, and interactions are allowed. A rules-of-engagement document grants authority for specified security-testing activity; finding a public identifier does not expand that authority.
Information becomes intelligence through analysis
An observation is a recorded fact from a source. A lead is an observation worth testing. A hypothesis explains how several observations might relate. A finding is a supported answer to the investigation question, with provenance, confidence, and limits.
This distinction prevents a common failure: copying search results into a report and calling the result intelligence. Search ranking is not verification. A domain in a certificate, an address in a registry, and a name in a code repository each describe different things. The analyst must decide whether they refer to the same entity, whether the record is current, and what conclusion the evidence actually supports.
The collection surface
Continue the course
This section is part of the paid course.
See pricing to subscribe, or log in if you already have access.
Where this skill leads
Relevant careers
See how this topic contributes to broader role-level skill maps.
Sources
- https://www.odni.gov/index.php/newsroom/reports-publications/reports-publications-2024/3785-the-ic-osint-strategy-2024-2026
Supports
- Current Intelligence Community definition of OSINT
- Requirement-driven intelligence purpose
- Strategy publication on 2024-03-08 and its four focus areas
- Timeline event and beginner quiz answer
- https://www.odni.gov/index.php/what-we-do/what-is-intelligence
Supports
- Publicly available print, electronic, broadcast, database, video, graphic, and drawing sources in OSINT
- Historical placement of OSINT among intelligence disciplines
- https://csrc.nist.gov/pubs/sp/800/115/final
Supports
- Reconnaissance and discovery within technical security testing
- Planning, execution, analysis, reporting, technique benefits, and limitations
- Active assessment authorization and operational constraints
- Quiz distinction between passive sources and direct target interaction
- https://csrc.nist.gov/glossary/term/Rules_of_Engagement
Supports
- Rules of engagement as pre-established authority, guidelines, and constraints
- Scope control for active testing and mixed automation
- https://owasp.org/www-project-web-security-testing-guide/latest/4-Web_Application_Security_Testing/01-Information_Gathering/
Supports
- Information-gathering sequence for web security testing
- Search discovery, fingerprinting, entry points, execution paths, and architecture mapping
- Reference-path rationale
- https://owasp.org/www-project-web-security-testing-guide/stable/4-Web_Application_Security_Testing/01-Information_Gathering/01-Conduct_Search_Engine_Discovery_Reconnaissance_for_Information_Leakage
Supports
- Direct and indirect search-engine reconnaissance
- Discovery of exposed design and configuration information
- Search-index limits and web-content discovery
- https://owasp.org/www-project-web-security-testing-guide/latest/4-Web_Application_Security_Testing/01-Information_Gathering/04-Attack_Surface_Identification
Supports
- Attack-surface entities including applications, domains, virtual hosts, exposed services, DNS names, and certificates
- Shared infrastructure and virtual-host ambiguity
- Passive and active DNS, Certificate Transparency, and scope confirmation
- Quiz answers about shared addresses and active interaction
- https://owasp.org/www-project-web-security-testing-guide/latest/4-Web_Application_Security_Testing/01-Information_Gathering/08-Fingerprint_Web_Application_Framework
Supports
- Target-visible framework fingerprinting through headers, cookies, source, paths, and error messages
- Multiple markers for more accurate inference
- Mixed-automation quiz answer
- https://www.icann.org/en/contracted-parties/registry-operators/resources/registration-data-access-protocol
Supports
- RDAP as the standardized replacement for WHOIS
- Internationalization, secure access, authoritative service discovery, and structured responses
- Practice commands and reference rationale
- https://lookup.icann.org/en/faq
Supports
- RDAP access to domain, IP network, and ASN registration data
- Real-time registry or registrar responses and possible field variation or redaction
- Quiz answer about omitted registrant details
- https://bind9.readthedocs.io/en/latest/manpages.html#dig-dns-lookup-utility
Supports
- dig syntax, explicit record types, reverse lookup, answer display, and resolver behavior
- DNS practice commands, evidence fields, and time or vantage interpretation
- Quiz answer about conflicting DNS observations
- https://certificate.transparency.dev/
Supports
- Certificate Transparency architecture of logs, monitors, and user agents
- Certificate names as public discovery observations
- https://certificate.transparency.dev/logs/
Supports
- Logs as append-only, publicly auditable certificate ledgers
- Certificate candidate limits and related quiz answers
- https://www.ohchr.org/sites/default/files/2022-04/OHCHR_BerkeleyProtocol.pdf
Supports
- Planning, collection, verification, preservation, analysis, security, and ethical handling of digital open-source information
- Provenance, reproducibility, original-source review, and structured assessment
- Quiz answers on independent corroboration and bounded claims
- https://searchlibrary.ohchr.org/record/30334?ln=en
Supports
- Berkeley Protocol authorship, publication identity, and 2022 edition
- https://www.bellingcat.com/resources/2024/04/25/oshit-seven-deadly-sins-of-bad-open-source-research/
Supports
- Original-source tracing, archiving, corroboration, transparent methods, and tool limits
- Reference-path rationale and reporting disciplines
- https://www.bellingcat.com/resources/2021/11/01/a-beginners-guide-to-social-media-verification/
Supports
- Contextual verification, reverse-image checks, critical review, and tool limitations
- Media-verification workflow
- https://curl.se/docs/manpage.html
Supports
- curl fail, silent, show-error, output, and header-capture command behavior
- Practice commands for RDAP, certificate search, and authorized web capture
- https://exiftool.org/exiftool_pod2.html
Supports
- Reading metadata from files and producing structured JSON
- Preservation of originals and metadata practice commands
- ExifTool Awesome Links rationale
- https://www.gnu.org/software/coreutils/manual/html_node/sha2-utilities.html
Supports
- SHA-256 checksum generation for saved evidence
- https://github.com/jivoi/awesome-osint
Supports
- Discovery of Amass, SpiderFoot, Hunchly, ExifTool, TinEye, and Wayback Machine
- Placement of tools in DNS, automation, web capture, image analysis, image search, and web history categories
- https://owasp-amass.github.io/docs/
Supports
- Amass data collection, network mapping, OSINT, and attack-surface relationships
- Amass Awesome Links rationale and Landscape placement
- https://owasp.org/www-project-amass/
Supports
- Open-source external asset discovery and network mapping
- OWASP Amass product homepage and Landscape placement
- https://github.com/smicallef/spiderfoot
Supports
- Modular OSINT automation for threat intelligence and attack-surface mapping
- SpiderFoot open-source edition, Awesome Links rationale, and Landscape placement
- https://hunch.ly/
Supports
- Web capture for online investigations
- Hunchly Awesome Links rationale and evidence-preservation Landscape placement
- https://hunch.ly/pricing
Supports
- Free and paid Hunchly access options
- Hunchly proprietary freemium classification
- https://help.tineye.com/article/265-tineye-tutorial
Supports
- Reverse-image matching, result comparison, indexed coverage, and no-match limits
- Quiz answer and Awesome Links rationale
- https://help.tineye.com/article/233-how-does-tineye-work
Supports
- Image fingerprint comparison and matching of cropped, edited, or resized copies
- TinEye Landscape placement
- https://help.tineye.com/article/248-what-does-tineye-first-found-on-mean
Supports
- Limits of first-found dates as crawler observations rather than first publication dates
- https://archivesupport.zendesk.com/hc/en-us/articles/360004651732-Using-The-Wayback-Machine
Supports
- Historical URL captures, citation, capture gaps, and missing assets
- Wayback Machine Awesome Links rationale
- https://archivesupport.zendesk.com/hc/en-us/articles/360001513491-Save-Pages-in-the-Wayback-Machine
Supports
- Save Page Now behavior and its single-page limitation
- Web-preservation practice boundaries
- https://www.maltego.com/maltego-faq/
Supports
- Graph-based OSINT investigation and Community Edition
- Maltego Landscape placement and proprietary freemium classification
- https://book.shodan.io/getting-started/platform/
Supports
- Internet exposure search, APIs, monitoring, and product tiers
- Shodan Landscape placement and proprietary freemium classification
- https://docs.censys.com/docs/platform-quickstart-guide
Supports
- Structured hosts, web properties, certificates, searches, and entity lookups
- Censys Landscape placement
- https://censys.com/resources/pricing
Supports
- Censys paid and limited-access product tiers
- Proprietary freemium classification
- https://www.babelstreet.com/platform
Supports
- Enterprise multilingual public and commercial data collection and analysis
- Babel Street proprietary paid Landscape placement
- https://github.com/lanmaster53/recon-ng
Supports
- Open-source modular reconnaissance workspaces, data storage, modules, and reporting
- Recon-ng Landscape placement and free open-source classification
- https://www.cia.gov/stories/story/intelligence-in-a-digital-world-inside-cias-directorate-of-digital-innovation/
Supports
- Foreign Broadcast Monitoring Service creation in February 1941
- Early focus on foreign print and radio
- Timeline event
- https://www.cia.gov/legacy/museum/artifact/russian-atlas-procured-by-fbis/
Supports
- FBIS transition in 1946
- Open Source Center transition in 2005
- Open Source Enterprise transition in 2015
- Timeline events
- https://home.cern/world-wide-web-35/
Supports
- March 1989 web proposal and early implementation
- Timeline event
- https://home.cern/science/computing/the-birth-of-the-web/
Supports
- Public-domain release of World Wide Web software on 1993-04-30
- Timeline event
- https://blog.google/company-news/inside-google/company-announcements/marking-20ish-years-google/
Supports
- Google incorporation on 1998-09-04
- Timeline event
- https://www.bellingcat.com/about/who-we-are
Supports
- Bellingcat founding in 2014
- Independent collective and verifiable open-source research methods
- Timeline event
