Support Punycode encoding for the url and hostname fields in flow inspection logs 7.4.2

Punycode encoding is supported in the url and hostname fields in flow mode web filter UTM logs. This caters to domain names containing non-ASCII characters, such as internationalized domain names (IDNs). Is also aligns the functionality of flow and proxy modes, offering a more unified and improved user experience.

config webfilter profile
    edit <name>
        set web-flow-log-encoding {utf-8 | punycode}
    next
end

Example 1: UTF-8 encoding

To configure the web filter profile:

config webfilter profile
    edit "webfilter_flowbase"
        set web-flow-log-encoding utf-8 
    next
end

Sample log:

1: date=2023-10-30 time=11:34:07 eventtime=1698690847433106658 tz="-0700" logid="0316013056" type="utm" subtype="webfilter" eventtype="ftgd_blk" level="warning" vd="vdom1" policyid=1 poluuid="fc514aae-745e-51ee-d867-15932507e437" policytype="policy" sessionid=15525 srcip=10.1.100.33 srcport=46982 srccountry="Reserved" srcintf="port2" srcintfrole="undefined" srcuuid="22387062-7397-51ee-fa1e-c6f3f4ae1b8a" dstip=172.16.200.36 dstport=443 dstcountry="Reserved" dstintf="port1" dstintfrole="undefined" dstuuid="22387062-7397-51ee-fa1e-c6f3f4ae1b8a" proto=6 httpmethod="GET" service="HTTPS" hostname=".jp" agent="curl/7.80.0-DEV" profile="webfilter_flowbase" action="blocked" reqtype="direct" url="https://.jp/about/" sentbyte=91 rcvdbyte=0 direction="outgoing" msg="URL belongs to a denied category in policy" ratemethod="domain" cat=52 catdesc="Information Technology"

Example 2: Punycode encoding

To configure the web filter profile:

config webfilter profile
    edit "webfilter_flowbase"
        set web-flow-log-encoding punycode 
    next
end

Sample log:

1: date=2023-10-30 time=11:36:25 eventtime=1698690984163852468 tz="-0700" logid="0316013056" type="utm" subtype="webfilter" eventtype="ftgd_blk" level="warning" vd="vdom1" policyid=1 poluuid="fc514aae-745e-51ee-d867-15932507e437" policytype="policy" sessionid=15552 srcip=10.1.100.33 srcport=42428 srccountry="Reserved" srcintf="port2" srcintfrole="undefined" srcuuid="22387062-7397-51ee-fa1e-c6f3f4ae1b8a" dstip=172.16.200.36 dstport=443 dstcountry="Reserved" dstintf="port1" dstintfrole="undefined" dstuuid="22387062-7397-51ee-fa1e-c6f3f4ae1b8a" proto=6 httpmethod="GET" service="HTTPS" hostname="xn--wgv71a119e.jp" agent="curl/7.80.0-DEV" profile="webfilter_flowbase" action="blocked" reqtype="direct" url="https://xn--wgv71a119e.jp/about/" sentbyte=91 rcvdbyte=0 direction="outgoing" msg="URL belongs to a denied category in policy" ratemethod="domain" cat=52 catdesc="Information Technology"