O

OSINT.science

Federated Open-Source Intelligence Search Engine

What is OSINT.science?

OSINT.science is a federated open-source intelligence (OSINT) search engine that aggregates results from over 80 different sources across multiple categories. It provides researchers, investigators, and analysts with a unified interface to search across academic databases, news outlets, government records, security databases, and heritage archives simultaneously.

Unlike traditional search engines that rely on a single index, OSINT.science queries multiple specialized sources in real-time, providing comprehensive coverage across different domains and languages.

Key Features

S

Federated Search

Query 80+ sources simultaneously with real-time streaming results via Server-Sent Events (SSE).

C

Category-Based

Organize searches by category: News, Science, Government, Security, Genealogy, and more.

AI

AI Analysis

Built-in Claude AI integration for summarization, entity extraction, and network visualization.

E

Export Options

Export results in JSON, CSV, Excel, or BibTeX formats for further analysis.

R

Resilience

Circuit breakers and rate limiting ensure reliable operation even when sources fail.

M

Multilingual

Search across sources in English, French, Hebrew, Arabic, and German.

Source Categories

News: CNN, Le Monde, Ynet, Le360, TelQuel, L'Orient-Le Jour, GDELT, RSS feeds from 28+ sources
Science & Academic: arXiv, PubMed, Google Scholar, Semantic Scholar, CrossRef, NASA
Government & Law: SEC EDGAR, Companies House, EUR-Lex, CanLII, USPTO, FBI Wanted, Federal Register
Security & OSINT: CVE Database, URLhaus, PhishTank, Wayback Machine, IP Geolocation
Forums & Social: HackerNews, Reddit, StackExchange, GitHub, GitLab
Reference: Wikipedia, Open Library, Internet Archive, Project Gutenberg, Anna's Archive
Genealogy & Heritage: Yahasra.org (Moroccan Jewish Cemetery DB), Dafina.net, MyTzadik
Statistics & Data: Our World in Data, World Bank, ECDC

Architecture

OSINT.science is built with a modular adapter-based architecture. Each data source is implemented as an independent adapter with its own parsing logic, rate limiting, and error handling. The system uses asynchronous Python (asyncio/aiohttp) for concurrent requests and Flask with Gunicorn for the web layer.

Python 3.9 Flask asyncio/aiohttp BeautifulSoup4 Gunicorn Nginx Claude AI D3.js Server-Sent Events

Developer

OSINT.science was designed and developed by Dr. Yohanan Ouaknine, a researcher specializing in digital heritage preservation and open-source intelligence tools.

This project is part of a broader ecosystem of heritage and research tools, including Yahasra.org (Moroccan Jewish Cemetery Database) and related genealogical research platforms.

Open Source

OSINT.science is built on open-source principles. The federated search approach allows integration of both open APIs and web scraping adapters, ensuring access to the widest possible range of information sources.

For questions, feature requests, or collaboration opportunities, please use the contact form.