TheCloneArmy/Unified_Porn_Blocklist
1
0
Fork 0
mirror of https://github.com/columndeeply/hosts.git synced 2025-10-28 12:01:08 -04:00
Code Issues Actions Packages Projects Releases Wiki Activity

Check whitelist on merger.sh

Browse Source
This commit is contained in:
columndeeply
2022-09-02 20:16:20 +02:00
parent 5c5ece45c3
commit ebb506fc2b
1 changed files with 7 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
scripts/merger.sh
View File

@ -4,6 +4,9 @@
## sh merger.sh "*_clean" ## sh merger.sh "*_clean"
# #
# If no parameters given exit
[ $# -eq 0 ] && exit
# Remove temp file from previous runs if needed # Remove temp file from previous runs if needed
rm -f merged.tmp rm -f merged.tmp
@ -21,6 +24,10 @@ rm -f ../hosts*
# Remove duplicates # Remove duplicates
sort < merged.tmp | uniq > merged sort < merged.tmp | uniq > merged
# Check whitelist and remove matches
comm -2 -3 merged ../whitelist > merged2
mv merged2 merged
# Split the merged file into 90MB chunks to avoid GitHub's limit # Split the merged file into 90MB chunks to avoid GitHub's limit
split merged hosts -C 90MB -d split merged hosts -C 90MB -d