Categories and Schedule for Blocklists:
The use of categorized lists is currently in beta test
Categorized lists
Service provider's clickstream is used to categorize lists in order to obtain more precise information on domain lists and IP addresses used by subscribers. Clickstream data is available on request and technical capability. The list of categories is accurate to the domain or IP.
Getting a list and making a sublist to use
Downloading from Cloud:
wget --no-check-certificate https://catalog.vasexperts.ru/catlist/outcat.lst.dic.gz wget --no-check-certificate https://catalog.vasexperts.ru/catlist/outcat.lst.gz gzip -d outcat.lst*
Contents:
outcat.lst.dic - categories description outcat.lst - domain lists by categories
Example: getting a combined list of 4,5 categories:
grep -P '4\t|5\t' outcat.lst | awk -F '\t' '{print $2}'
Examples of list activation
Blocking social networks and video hostings for corporate clients
Block resources from the category "porn"
List of categories to which the access will be blocked:
9 porno_sex
Form a list of the received files:
zcat outcat.lst.gz | awk -F '\t' '{if ($1=="9") {print $2 "\n*." $2}}'| url2dic porno_block.bin
fdpi_ctrl load profile --service 4 --profile.name 1_black --profile.json '{"url_list": "/root/porn/porno_block.bin", "sni_list": "/root/porn/porno_block.bin", "redirect": "http://vasexperts.ru/block", "federal": true} '
fdpi_ctrl load --service 4 --profile_name 1_black --ip 10.64.66.100
The task is to block social networks and other resources not required for work in the organization.
the list of categories to be blocked:
9 porno_sex
12 music_sites
13 game_sites
16 social_networks
27 miners_pools_curs_etc
38 forex
43 gambling
Form the list of received files:
mkdir /home/lst; cd /home/lst
grep -P '9\t|12\t|13\t|16\t|27\t|38\t|43\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_block.bin
Create a profile:
fdpi_ctrl load profile --service 4 --profile.name 1_black --profile.json '{ "url_list" : "/home/lst/1_block.bin" , "sni_list" : "/home/lst/1_block.bin", "redirect" : "http://mysite.ru/block", "federal" : true }'
here,
http://mysite.ru/block - redirect page.
Assign to subscriber:
fdpi_ctrl load --service 4 --profile_name 1_black --ip 192.168.0.1
Providing access only to certain sites categories
The task is to limit subscriber access by only certain categories of sites.
the list of categories to which the access will be provided:
4 school
19 goverment
25 museum
26 medicina_hostitals
32 child_sites
Form the list of the received files:
mkdir /home/lst;cd /home/lst
grep -P '4\t|19\t|25\t|26\t|32\t' outcat.lst | awk -F '\t' '{print $2}' | url2dic 1_white.bin
Create profile:
fdpi_ctrl load profile --service 5 --profile.name 1_white --profile.json '{ "url_list" : "/home/lst/1_white.bin" , "sni_list" : "http:///home/lst/1_white.bin", "redirect" : "mysite.ru/block" }'
here,
http://mysite.ru/block - redirect page.
Assign to subscriber:
fdpi_ctrl load --service 5 --profile.name 1_white --ip 192.168.0.1
Questions
- How often is the list updated? - Once a day. We plan to reduce the update period.