- 收集指定的pod日志
如果是多个container，可以通过添加annotation过滤container，例如：kubectl annotate deploy demo vector.dev/exclude-containers=”c1,c2”
代码语言：javascript复制 sources:
kubernetes_logs:
type: kubernetes_logs
extra_label_selector: "component=metrics-collector"- 将日志转发到prometheus remote write
需要将日志先装换成metric类型。
代码语言：javascript复制 sinks:
prometheus_remote_write:
type: prometheus_remote_write
inputs:
- log_to_metric_id
endpoint: https://localhost:1234/receive
default_namespace: metric_name_prefix
tls:
ca_file: /tlscerts/ca/ca.crt
crt_file: /tlscerts/certs/tls.crt
key_file: /tlscerts/certs/tls.key- 将日志打印到终端
stdout:
type: console
inputs:
- log_to_metric_id
encoding:
codec: json- 解析日志键值对
transforms:
remap_id:
type: remap
inputs:
- kubernetes_logs
source: . = parse_key_value!(.message)- 过滤特定的日志
filter_id:
type: filter
inputs:
- remap_id
condition: .level != "debug"- 将日志转换成metric
log_to_metric_id:
type: log_to_metric
inputs:
- filter_id
metrics:
- type: set
field: msg
tags:
cluster: ssli-aks-cluster
msg: ""
level: ""- 解析常见日志格式
parse_nginx_log!(.message, "combined")
parse_apache_log!(.message, "combined")
parse_common_log!(.message)
parse_syslog!(.message)
parse_klog!(.message)- 调试vrl
$ k exec -it vector-9hbq6 -- vector vrl
$ match("GET /api/v2/metrics/ HTTP/1.1", r'GET /api/v2/metrics[/]? HTTP/1.1')
true- vrl错误列表
https://vector.dev/docs/reference/vrl/errors/- vrl函数列表
https://vector.dev/docs/reference/vrl/functions/- vrl示例
https://vector.dev/docs/reference/vrl/examples/:) 未完待续……
LEo at 00:12
