Offline Database

Locally hosted domain categorization database

Our offline database is perfect for customers who require a local option for domain categorization. Typical use cases include hardware/product integrations, custom applications or internal use at an Enterprise organization with high request volume



In addition to flexible pricing options for production uses, we offer affordable pricing for startups or organizations looking to prototype or bring a product.

View Pricing

Offline Database Features

security icon
Billions of websites, organized
Using advanced machine learning, we categorize billions of web pages, keeping the categorization database one of the most accurate in the industry.
global dns network
Wide Range of Applications
Our domain categorization allows you to easily provide services such as internet filtering, subscriber analytics, advertising networks, and fraud prevention.
content filtering icon
Data Firehose
Need access to the raw data stream of everything as its being categorized? We provide a real-time data firehose via HTTP, Amazon S3, or Amazon SQS.
ai dns
Developer-friendly Responses
Every API response is returned as JSON, which can be easily read and implemented into your product.
network protection
Easily Block Threats and/or Inappropriate Content
You can easily block bad content within your application, appliance or company network. Simply query our API with the requested URL and reject if the category is not part of your “approved” list.
dns protection icon
Top Tier Support
Your happiness is our success. Our support team is comprised of real engineers, here to help with any challenge or need.
ai dns
Advanced Algorithms
Our technology categorizes content found on URLs, as well as entire websites and IP addresses – perfect for security devices that may not have access to the full URL.
network protection
Always Up to Date
Our web crawlers are constantly visiting and classifying new and existing websites, providing real-time results and keeping the database always up to date.

dns protection icon
Infinitely Scalable
Running on Amazon Web Services, our APIs are easily scalable to support your growth today and tomorrow.

Available Formats

The Webshrinker database is typically provided in JSON format, and updates are able to be downloaded directly from Amazon S3 as JSON files as often as desired.

    "_id": "ceb243bac6752229b65acc3d0443d7bb7306343d5818d4c1bb9f681f9dec2df7",
    "categories": [

Alternative delivery methods include an HTTPs URL callback, or immediate delivery to an Amazon SQS of your choice. These incremental updates may be applied via the database back end of your choosing, with most customers importing into MongoDB, Postgres or MySQL.

Book A Demo


Get Started with a Free Trial

test your first 100 domains