Sources Requiring API Keys

These sources need API keys to function. Add keys to /home/ec2-user/osintscience/.env

Brave Search Favorites / The Web
⚠ Key Missing
BRAVE_SEARCH_API_KEY
Whoogle Favorites / The Web
✓ Configured
WHOOGLE_INSTANCE_URL

Free Sources (No API Key Required)

These sources work without API keys

DuckDuckGo
DuckDuckGo News
DuckDuckGo Images
DuckDuckGo Videos
SearXNG
FreeMetasearch
FreeMetasearch Images
Mojeek
Presearch
Wikipedia
Open Library
Free Dictionary
Datamuse
Open Food Facts
MusicBrainz
TVmaze
Open Trivia DB
Genderize
Nationalize
Agify
Quotable
D&D 5e SRD
PokeAPI
Project Gutenberg
Anna's Archive
Internet Archive
Hacker News
Reddit
Stack Exchange
GitHub
GitLab
arXiv
PubMed
CrossRef
NASA Images
NASA TechPort
USGS Earthquakes
SpaceX
GBIF
ITIS
Semantic Scholar
Wayback Machine
NVD CVE
URLhaus
PhishTank
IP-API
SEC EDGAR
UK Companies House
EUR-Lex
CanLII
USPTO Patents
data.gouv.fr
OpenCorporates
FBI Wanted
Federal Register
Data.gov
Our World in Data
World Bank Data
ECDC
CoinGecko
GDELT
Nominatim (OSM)
Dafina.net
Yahasra Cemetery DB
MyTzadik
Le360 Morocco
TelQuel
Bladi.net
Le Monde
L'Orient-Le Jour
Intelligence Online
Ynet Israel
CNN
Facebook (via Google)
LinkedIn (via Google)
X/Twitter (via Google)
Google Scholar
Ynet
Globes
Kan News
Haaretz
Maariv
Le Monde
France 24 FR
Liberation
Le Figaro
Hespress
Le360 Morocco
Al Jazeera
Al Arabiya
France 24 AR
Der Spiegel
Deutsche Welle
BBC News
CBC News
The Guardian
Reuters
TechCrunch
Ars Technica
The Verge
Wired
The Register
PR Newswire
Business Wire
GlobeNewswire
AP News
UPI
AFP (French)
NPR
PBS
ProPublica
The Intercept
ABC News
Sky News
France 24 (English)
France 24 (Français)
RFI (Français)
Deutsche Welle (English)
Euronews
Politico EU
EUobserver
El País (English)
The Local (France)
The Local (Germany)
The Local (Italy)
The Local (Spain)
The Local (Sweden)
SWI swissinfo.ch
Al Jazeera (English)
الجزيرة (Arabic)
Middle East Eye
The National (UAE)
Arab News
Times of Israel
The Jerusalem Post
i24NEWS (English)
Morocco World News
Hespress (English)
Hespress (Français)
هسبريس (Arabic)
Médias24
Le Desk
Jeune Afrique
Egypt Independent
Daily Star Lebanon
Globe and Mail
Buenos Aires Times
South China Morning Post
The Hindu
The Straits Times
ABC Australia
Radio New Zealand
BBC World (RSS)
BBC Technology (RSS)
Reuters World (RSS)
Al Jazeera (RSS)
France 24 EN (RSS)
France 24 FR (RSS)
Deutsche Welle (RSS)
NPR News (RSS)
The Guardian (RSS)
Haaretz EN (RSS)
bioRxiv
medRxiv
SSRN
PhilPapers
OSF Preprints
CORE
BASE (Bielefeld)
HAL (France)
DOAJ
SciELO
Érudit
DART-Europe E-Theses
theses.fr
Dimensions (free)
DBLP
INSPIRE-HEP
NASA ADS
Lens.org
OpenAlex
J-STAGE (Japan)
HUDOC (ECHR)
Légifrance
BAILII (UK/Ireland)
AustLII (Australia)
UK Legislation
GovInfo (US)
Regulations.gov
Knesset Legislation
Google Patents
Espacenet
WIPO Patentscope
Lens.org Patents
Companies House (UK)
GLEIF (LEI Search)
OpenSanctions
UN Security Council Sanctions
TED (EU Tenders)
SAM.gov (US)
Eurostat
INSEE (France)
data.gov (US)
data.gov.uk
data.gov.il
UN Data
OECD Data
Statistics Canada
ONS (UK)
BLS (US Labor Statistics)
US Census Bureau
HCP.ma (Morocco Statistics)
FBI Most Wanted
AbuseIPDB
AlienVault OTX
ThreatFox
MalwareBazaar
Shodan (free search)
Censys Search
crt.sh (SSL Certificates)
who.is
DNSdumpster
Have I Been Pwned
ICIJ Offshore Leaks
WikiLeaks
Yad Vashem Names Database
USHMM Collections
Arolsen Archives
JewishGen
Geneanet
Find a Grave
BillionGraves
WikiTree
FamilySearch
National Library of Israel
CAHJP (Central Archives for Jewish History)
Europeana
DPLA (Digital Public Library)
Trove (Australia)
Mémoire des Hommes
JRI-Poland
BNRM (Bibliothèque Nationale du Maroc)
Wikipedia (English)
Wikipedia (Français)
ויקיפדיה (Hebrew)
ويكيبيديا (Arabic)
Wikipedia (Deutsch)
Wikipedia (Español)
Wikipedia (Português)
Википедия (Russian)
Wiktionary
Wikisource
Wikiquote
Wikidata
Wikimedia Commons
Stanford Encyclopedia of Philosophy
Internet Encyclopedia of Philosophy
Larousse
WorldCat
HathiTrust
BnF Catalogue
Library of Congress
British Library
Stack Overflow
Super User
Server Fault
Academia (SE)
History (SE)
Information Security (SE)
Data Science (SE)
Cross Validated (Stats SE)
Law (SE)
Genealogy (SE)
Open Source (SE)
Politics (SE)
Skeptics (SE)
Worldbuilding (SE)
Linguistics (SE)
Mi Yodeya (Judaism SE)
Lobsters
Slashdot
Snopes
PolitiFact
FactCheck.org
AFP Fact Check
Full Fact (UK)
CheckNews (Libération)
GeoNames
Overpass API (OSM)
NOAA
EPA (US)
USGS Earthquake
GBIF (Biodiversity)
Copernicus Climate
Crunchbase (free)
Flickr (CC Licensed)
WHO
ClinicalTrials.gov
MIT OpenCourseWare
Khan Academy
TED Talks
Internet Archive TV News
Chronicling America (LOC)
Persée
Cairn.info
Xinhua (English)
TASS (English)
Kyodo News
Yonhap News (Korea)
PTI (India)
USA Today
New York Times
Washington Post
Los Angeles Times
Chicago Tribune
Boston Globe
San Francisco Chronicle
Dallas Morning News
Denver Post
Seattle Times
Miami Herald
The Telegraph
The Independent
Daily Mirror
Daily Express
Evening Standard
The Scotsman
Irish Times
Libération
Le Parisien
L'Obs
L'Express
Le Point
Ouest-France
La Dépêche
FAZ
Süddeutsche Zeitung
Die Zeit
El País (Español)
El Mundo
ABC (Spain)
La Vanguardia
Corriere della Sera
La Repubblica
La Stampa
South China Morning Post
The Straits Times
Japan Times
Bangkok Post
Hindustan Times
Times of India
Dawn (Pakistan)
Sydney Morning Herald
NZ Herald
Daily Nation (Kenya)
Mail & Guardian (SA)
Daily Maverick (SA)
Guardian Nigeria
Punch (Nigeria)
The New Times (Rwanda)
Folha de São Paulo
O Estado de S.Paulo
Clarín (Argentina)
La Nación (Argentina)
El Universal (Mexico)
El Tiempo (Colombia)
Haaretz (English)
Jerusalem Post
Daily Star (Lebanon)
Gulf News
Khaleej Times
DOAJ
CORE
BASE (Bielefeld)
OpenAlex
Zenodo
ORCID
Dimensions (Free)
ResearchGate
bioRxiv
medRxiv
SSRN
PhilPapers
IEEE Xplore
ACM Digital Library
DBLP
Springer Link
JSTOR
ERIC (Education)
Europe PMC
INSPIRE-HEP
ADS (Astrophysics)
GovInfo (US)
Congress.gov
Regulations.gov
CourtListener
Legislation.gov.uk
BAILII (UK Courts)
Légifrance
OpenGov EU
Bundestag (Germany)
Knesset (Israel)
WIPO (Patents)
Espacenet (EPO)
USPTO TESS
AlienVault OTX
MITRE ATT&CK
Exploit-DB
Vulners
GreyNoise
Intelligence X
HIBP (Breach Search)
DeHashed (Free)
ThreatMiner
BuiltWith
SecurityTrails
ViewDNS
DNSdumpster
Find A Grave
BillionGraves
Geni.com
WikiTree
Ancestry (Free)
MyHeritage (Free)
JewishGen
JRI-Poland
Yad Vashem Names
USHMM (Holocaust Museum)
FamilySearch
Geneanet
Filae
Encyclopaedia Britannica
Scholarpedia
Stanford Encyclopedia of Philosophy
Wiktionary
Merriam-Webster
Cambridge Dictionary
Thesaurus.com
IMDB
Goodreads
WorldCat
HathiTrust
Europeana
DPLA
Library of Congress
Gallica (BnF)
Wikidata
DBpedia
WaPo Fact Checker
AP Fact Check
Reuters Fact Check
BBC Reality Check
Les Décodeurs (Le Monde)
CORRECTIV
Maldita.es
Pagella Politica
BOOM Live (India)
Africa Check
Bloomberg (Free)
Financial Times (Free)
WSJ (Free)
Forbes
Fortune
Business Insider
MarketWatch
Yahoo Finance
VentureBeat
Product Hunt
Coursera
edX
Udemy
Skillshare
YouTube EDU
Academic Earth
Open Yale Courses
WIRED
Engadget
ZDNet
CNET
Mashable
Gizmodo
TechRadar
Slashdot
RFI (Radio France Internationale)
TV5Monde
France Info
RTBF (Belgian Radio)
Swissinfo
DutchNews.nl
The Local Sweden
The Local Germany
The Local France
The Local Italy
The Local Spain
ANSA (Italian Wire)
Kathimerini
Cyprus Mail
Malta Today
Bangkok Post
Vietnam News
Philippine Star
Taipei Times
Jakarta Globe
New Straits Times
Jerusalem Post
Ynet News
Middle East Eye
The New Arab
Daily Star Lebanon
Daily Nation (Kenya)
Daily Maverick
Punch Nigeria
ThisDay Nigeria
El Tiempo (Colombia)
El Comercio (Peru)
La Tercera (Chile)
El Universo (Ecuador)
La Prensa (Panama)
Library of Congress
Digital Public Library of America
Trove (National Library Australia)
Gallica (BnF)
Deutsche Digitale Bibliothek
Hispana (Spanish Digital Library)
JewishGen
Yizkor Book Project
Yad Vashem Names Database
Arolsen Archives (ITS)
Ancestry Public Trees
MyHeritage Search
FamilySearch Wiki
Nature Research
Science Magazine
IEEE Xplore
ACM Digital Library
SpringerLink
Wiley Online Library
JSTOR
ResearchGate
Academia.edu
UK Legislation
Federal Register of Legislation (AU)
Indian Kanoon
CourtListener
Oyez (Supreme Court)
VirusTotal
URLScan.io
Censys Search
Pulsedive
IntelligenceX
GreyNoise
DEV Community
Hashnode
Medium (Technology)
Lobste.rs
Hacker News Search
MarketWatch
CNBC
Barron's
Investopedia
Seeking Alpha
Morningstar
Mongabay
Grist
Climate Home News
Carbon Brief
Treehugger
Medscape
WebMD
Medical News Today
Healthline
STAT News
Politico Fact Check
Lead Stories
Truth or Fiction
Full Fact (UK)
Check Your Fact
OpenStreetMap Nominatim
GeoNames
what3words
Bloomberg Law
LexisNexis News
ProPublica
ICIJ (International Consortium)
Bellingcat
OCCRP (Organized Crime)
Follow The Money
Electronic Frontier Foundation
Access Now
Citizen Lab
Krebs on Security
Schneier on Security

Quick Setup

# Edit the .env file:
sudo nano /home/ec2-user/osintscience/.env

# Add your API keys:
BRAVE_SEARCH_API_KEY=your_key_here
NEWSAPI_KEY=your_key_here

# Restart the service:
sudo systemctl restart osintscience

Recommended Free APIs