SSG changelog and update
DPI/BNG Versions Update
If you have version of CentOS 6.x or CentOS 8.x installed, switch the repository once with the command:
sed -i -e '/^mirrorlist=http:\/\//d' -e 's/^# *baseurl=http:\/\/mirror.centos.org/baseurl=http:\/\/vault.centos.org/' /etc/yum.repos.d/CentOS-*.repo
Then run updates as usual:
yum update fastdpi
Module yaml error
appears during the upgrade, you should upgrade the module dnf upgrade libmodulemd
.
After updating, restart the DPI:
service fastdpi restart
and other dependent procoesses (PCRF/Radius), but only if they are actually used and their configuration is valid:
service fastpcrf restart service fdpi_radius restart
You can update the operating system components Do not update the kernel version and its dependent utilities!
For CentOS 6.x:
yum --exclude=kernel*,util-linux-ng,libuuid,libblkid update
For CentOS 8.x:
yum update
Note for users running the DPI in a virtual environment, using old CPU (release of 2009) and AMD CPU:
Run the following command before the update:
touch /etc/dpi/noprioadj
and it causes the DPI process to be launched with normal priority (not the realtime), thus significantly reducing the consumption of CPU system (sys) resourses, but slightly increasing the latency on the platform.
DPI platform update to version 13.0 Congo
13.0 Congo 1)
You can check the current installed version with the command:
yum info fastdpi
Rollback to 12.4:
yum downgrade fastdpi-12.4-0 fastpcrf-12.4-0
After an update or version change, a restart of the service is required:
service fastdpi restart
If PCRF and/or Radius are used, they should also be restarted. The following order is preferred for restarting PCRF:
service fastdpi stop service fastpcrf restart service fastdpi start
Do not perform Linux kernel upgrades. Newer versions of the kernel may break binary compatibility with the Kernel ABI and the network driver will not load after the upgrade. If you do upgrade, set the GRUB boot loader to load the previous version of the kernel: set the default=1
parameter in the /etc/grub.conf
file while the problem is being resolved.
If the update displays a message that the update was not found or there are dependency issues, run the command before updating:
yum clean all
Changes in version 13.0
DPI
- On-stick support for LAG/LACP. Description
- Transition to DPDK 23.11
- Modified: for QUIC and QUIC_IETF: if no SNI is detected - check by AS
- Modified: when analyzing STUN, AS from Facebook is checked - define FACEBOOK_VIDEO, not WHATSAPP_VOICE
- Setting RSS hash flags for UDP and TCP
- Modified: openvpn protocol definition
- Fixed: SIGHUP processing only if fastDPI is fully initialized. Possible crash if SIGHUP is received during fastDPI startup process
- Trace/debug packet recording moved to new API
- Added: wechat protocol support for UDP
- Prioritize SNI detection in custom signatures for autonomous systems marked as
mark1
. Description - Prioritize more specific custom SNI signatures.
Example: for hosta.b.c.d
, if the signatures*.d
,*.c.d
and*.b.c.d
are present, the protocol defined by the signature*.b.c.d
will be selected works only for signatures with*
. Description - Support for hard locks (despite hostname/SNI) - set in an additional field in the address blacklist, example:
1.1.1.1 443 hard
. Description - Improved detection of YOUTUBE, SIGNAL
- Added the DPITUNNEL protocol, which includes traffic anomalies commonly used for DPI traversal
- Updating dpiutils
- New protocols VK_CDN_VIDEO, META_CHAT
- Improved signatures of FACEBOOK_VIDEO, META_CALLS protocols
- Fixed protocol name VK_CDN_VIDEO
- Fixed: SNI decoding in QUIC IETF and possibility of crusting in exceptional cases
- Fixed: clearing search structures when deleting CUSTOM protocols
- Added protocols QUIC_UNKNOWN - QUIC without SNI and QUIC_UNKNOWN_MARKED - QUIC without SNI and AS labeled MARK2. Description
- Fixed: stun character definition for TCP
- Modified: if the stun packet viewing limit is reached - set this protocol with AS in mind
- Updated utilities to support new protocols
- Improvements in QUIC_UNKNOWN, QUIC_UNKNOWN_MARKED, SIGNAL, DpiTunnel protocols
- SNI/HOST embedded protocol definitions are cloud-based, SNI/IP prioritization is supported
- Modified: SNI comparison is case-insensitive
- Added LANTERN_WEAK protocol signature
- Improved IMAP protocol recognition
- Corrects LPM when selecting channel by IP/CIDR
- Added: to DNS text file record format - format vchnl - virtual channel number.
- Added: to the IPFIX data transfer template for DNS channel number. Description
- Fixed: crash on DNS trace
- Improved VIBER_VSTREAMS protocol definition
- Fixed: fastDPI does not accept or process any ctl requests during fastDPI stop process
- Added SSTP protocol (49296)
- Added ANYDESK protocol (54273)
- LANTERN recognition improved
BRAS
- Added: accounting of DHCP packets from subscriber in billing statistics: subscriber CPE (i.e. Wi-Fi router) without clients (e.g. at night) - sends only license renewal requests. Since these requests were intercepted by BRAS and were not included in the accounting, the session was terminated by idle timeout
- Corrected: actions when QinQ/VLAN is changed for a subscriber
- Fixed:
framed-pool renew
In some cases, incorrect DHCP responses were generated. Added trace to DHCP packets log forframed-pool renew
. - Fixed: receiving packets from relay. Previously it was checked that relay was on the fc::/7 network. Now this check is unnecessary and has been removed - relay can have any address.
- Fixed: DHCPv6 options parsing from Radius
- The
subs prop show active
command has been added. The command outputs a dump of L2 properties of all active (not-expired) subscribers. Description - Modified: Prohibit calling CLI commands while stopped
- Fixed: idle-timeout for session. For PPPoE sessions idle timeout should be taken from the
bras_ppp_idle_timeout
setting if not explicitly set in the authorization response (Idle-Timeout attribute). - Added priority forwarding with DSCP translation. Description
- Corrected: Adding unnecessary option 61 (Client-Id) to fastDPI response when distributing address from Framed-Pool
- Fixed: Logging of DHCP server IP addresses
- Fixed: Enabling services with profiles. The `VasExperts-Service-Profile` attribute (service profile name, implicitly enables the service) has higher priority than `VasExperts-Enable-Service` (enabling/disabling a service without specifying a profile).
- Added
ping inet
command on behalf of subscribers through the entire BRAS/NAT/ROUTER processing chain. The prompt isfdpi_cli ping inet ?
. Description - Fixed: call of subscriber IP address deanounce when acct idle. Added new flag to router option
router_subs_announce
:0x10000
- deanounce L3 subscriber at acct idle (closing acct session by idle timeout). Description - Added support for specifying the profile of service 18 during authorization. Enabling service 18 in the Access-Accept Radius response is set in the usual way for a service with a mandatory profile (here
serv18
is the profile name):VasExperts-Service-Profile = "18:serv18"
- A search by
MAC
andsubs_id
has been added to thesubs prop show
command. The result of a search byMAC
orsubs_id
can be multi-valued - several different entries for the sameMAC
/subs_id
. The result of thesubs prop show active
command has been changed, which may be critical when parsing the command's json wiggle. Description - Fixed: setting link up/down flag for ports that do not support link up/down interrupts (e.g. af_packet)
- The return code of the uptime command. The CLI command
uptime
can be used to check if fastDPI is fully started: it returnsresult=0
(Success) only when fastDPI is fully initialized and all worker threads are started. Upon receiving a response from fastDPI to thefdpi_cli uptime
command, the fdpi_cli utility itself checks the result of the execution and ifresult!=0
- sets a non-zero return code. - Corrected: If VRF (service 254) was present in Access-Accept, the packet was incorrectly logged as invalid.
- Restoring UDR operation after calling a command with a large number of parameters
NAT
- Added a
checknat
utility to check the distribution of white addresses. Description - Fixed online change of
nat_private_cidr
parameter
Load Balancer
- Added L2 traffic balancer mode. This enhancement allows to use SCAT as a traffic balancer based on IP addresses owned by AS and defined as
local
inasnum.dscp
. Description - Added mqrx_lb_engine, which is activated when dpdk_engine=2. Description
Router
- Mempool allocation for emit packets: we do not allow the pool to be completely exhausted, there should be at least 256 free elements in the pool
- The error of route deletion
errno=3
(No record found) has been moved to TRACE to avoid clogging the log - Fixed the order of router components termination
- Changed: system error when clearing route tables. Cleaning of route tables (deleting all entries added by SCAT) is done at stop and start of fastDPI. During cleaning process EBUSY error may occur, which is fatal for netlink socket, socket should be closed.
- Fixed: TAP link down in LAG. If a port enters a lag, TAP this port to Link down state only when ALL LAG ports are down.
- Fixed: control of selfgen mempool exhaustion
- Optimization of data readout from TAP
- Fixed LAG+On-stick: put TAP in link down state. TAP is set to link down only when all ports in LAG are in down state. If there is at least one port in Up state - TAP should be in Link Up state.
- Corrected: Traffic diversion in router for on-stick device in LAG. When forming VRF topology, it was not taken into account that the LAG includes the base (physical) device, and the on-stick (virtual) device is specified in the router description.
- Fixed: Read all data from TAP device. At fastDPI startup there were possible situations when router is not fully initialized yet and TAP is already monitored but not read out.
- The router_subs_announce option is made hot (hot)
- Fixed: mbuf leak on fastDPI startup
SDS
- The
storage_tag
value is set based on directional priority or protocol priority
Radius
- Added the ability to work with standard linux interfaces using
libpcap
. Description
Changes in Version 13.1
idle_timeout
expires.The fix is planned for the next release.
DPI
- Global code refactoring - discontinued support for
pf_ring
- Added: service 19 - DNS response substitution. Description
- Modified: minimum PCAP file size to 100 MB. PCAP file rotation on reload Description
- Modified: improved DROP event tracing
- Fixed: erroneous ERROR level message appearing for certain
fdpi_ctrl
requests - Fixed: incorrect TLS (SNI) parsing when multiple 'ALPN Protocols' are specified
- Modified: mechanism for updating AS and IP compliance lists. Description
BRAS
- Fixed: subscriber activity control via unicast ARP Request. Previously, it was a broadcast ARP Request, which is not optimal for the network. Description
- Added: SHCV (Subscriber Host Connectivity Verification) — DHCP subscriber activity control. Considered scenario for an already "closed" record to prevent repeated SHCV trigger and increase in the 'SHCV: session closed by inactivity' counter. Description
- Added: ARP Proxy for known routes (router mode only). This feature is applied only if the ARP request initiator is a known subscriber. A new flag - 0x0004 has been added to the
bras_arp_proxy
option. Description - Fixed: help() for IPv6 addresses in the
subs prop show
command - Fixed: error in parsing parameters for the
subs prop del
command, which resulted in the inability to delete properties by IP with the errorERROR: Result code=9: No subscriber IP address
- Added: CLI command
dhcp disconnect
. This is a CLI analog of CoA Disconnect. The disconnect mode is set by thebras_dhcp_disconnect
option.dhcp disconnect all
- disconnect all DHCP sessionsdhcp disconnect [ mac=X | ip=X ]
- disconnect specified session
- Fixed: sending L3 reauth for L2 subscriber in advance, not waiting for session timeout
- Added: number of sessions closed due to inactivity (SHCV) in the
dhcp show stat
CLI command - Fixed: error in intercepting and processing ICMPv6 packets, checksum not recalculated in some cases when modifying ICMPv6 packet
NAT
- Modified: tracing in
vdpi_new_flow_nat_ipv4
is always output - Fixed: based on the value of
nat_exclude_private
, additionally checking the pair CHECK_AS_LOCAL or CHECK_AS_PEER for AS in local interconnect
Router
- Added: ARP management. Description
- Fixed: port selection for recording in a pass-through LAG. If LAG passes through fastDPI, port selection for recording from TAP should consider the Link Up/Down state of both bridge sides of the port
- Fixed: announcing NAT profile subnets upon addition
- Added: CLI command
router vrf dump
. The command outputs the list of VRFs set in the system and their properties - Fixed: do not consider term by AS when announcing NAT subnets. The
term_by_AS
mode applies to subscribers, not to NAT profiles, hence it should not be considered when announcing a NAT subnet - Fixed: order of packet interception from the general processing pipeline
- Fixed: increased number of
mbuf
inselfgen mempool
if router enabled: if router disabled:mempool size=512 * number_of_slaves_in_cluster
, if router enabled:mempool size=8 * 1024 * number_of_slaves_in_cluster
LAG
- Fixed: zeroing the array when building a new list of active ports. The error leads to array overflow and memory corruption
- Added: logging of the "no mbuf" error when sending LACP