2022-08-28 15:16:58 +02:00
2022-08-28 15:16:58 +02:00
2022-08-28 15:16:58 +02:00
2022-08-28 15:26:54 +02:00
2022-08-28 15:16:58 +02:00

This is the result of merging and cleaning up a bunch of porn-blocking lists I've found scattered through the web. It currently has 3.701.606 unique domains and a redirect to the "Safe Browsing" versions of Google, DuckDuckGo, Bing and YouTube.

The list is split into 90MB chunks to avoid GitHub's file size limit. Here are the raw links to all parts of the list:

https://raw.githubusercontent.com/columndeeply/hosts/main/hosts00 https://raw.githubusercontent.com/columndeeply/hosts/main/hosts01

If you need a single file list it can be found on the releases page. I'll be updated once a month.

Contributing

Since this list is just a fused version of other lists and the domains aren't manually checked it'll probably have false positives. If a site is listed here and you think it shouldn't please let me know by opening a new issue or making a pull request. The same goes if you think a site should be added to the list. In both cases please use the appropriate tag on the issue/PR title: [Addition Request] or [Removal Request].

By making an issue

If you're submitting more than a couple dozen domains please make a pull request or use a pastebin site. If it's just a few domains then just paste them on the issue. If you took the domains from another list please say so and leave a link to their page so it can be added to the "Sources" table below.

By making a pull request

When making a pull request you should add a file on the "contributions" directory with your domains. I'll then merge your pull request and merge the file into the main list. Please do not make changes directly to the main list. If you're not sure how to list the domains take a look at the example.

Invalid/Inactive domains

I'm not removing these from the list. Please do not submit domains for removal just because they are no longer active. Removing them would mean having to check every X months to see if they are back. I'll only whitelist domains that are active and point to a non-pornography related site.

Scripts

I've added the two scripts I use to maintain this list to the repository. Feel free to use them anyway you want. Also, if you know a way to make them more clean (not have to use .tmp files would be nice) or any general improvements please let me know.

cleanup.sh

Give it a list of files with domains and it'll try to clean them a bit. It removes all empty lines, comments, multiple whitespaces, tabs, trailing whitespaces and some more stuff. Once that's done it'll replace any IP at the beginning of each line with 127.0.0.1 (or add it if there isn't one). Then it removes any domain that exists in the whitelist, removes any duplicates and sorts the resulting list.

merger.sh

Used to merge clean lists with the main one. Should be run like this sh merger.sh "*_clean" to make sure it only adds the lists created by the cleanup.sh script. It merges all given files with the main one, removes duplicates, sorts the merged list and once that's done it splits it into 90MB chunks.

Sources

Repos

Link Last update Comments
11201010's list 2020/08/03 Forked from 4skinSkywalker's list, looks abandoned.
1boii's list 2022/03/11
4skinSkywalker's list 2022/05/29
Bon-Appetit's list 2021/12/24
EnergizedProtection's lists 255,621 / 51,065 Using the "HOSTS RAW" list for "Porn" and "Porn Lite Extension".
My Privacy DNS's list 2021/12/03
Sinfonietta's list 2022/08/24 Seems to pull from StevenBlack's list.
StevenBlack's list 2022/08/26
blocklistproject's list 2022/06/21
cbuijs's list 2022/08/28
chadmyfield's list 2020/09/11 Archived.
clefspeare13's list 2022/04/06
mrvivacious's list 2022/04/04 Split by first letter of domain. cat * > merged to fuse.
thisisu's list 2022/08/28
tiuxo's list 2020/12/06 Looks abandoned.

Random lists

Languages
Shell 100%