Fluent-bit unable to find parser event if define in config file

7/27/2020

I want to create a parser in fluent-bit to parse the logs, which are sent to a elastic search instance but filter is unable to pick parser even when it is created.

Here are the logs:

Fluent Bit v1.0.4
Copyright (C) Treasure Data
[2020/07/27 07:06:03] [ info] [storage] initializing...
[2020/07/27 07:06:03] [ info] [storage] in-memory
[2020/07/27 07:06:03] [ info] [storage] normal synchronization mode, checksum disabled
[2020/07/27 07:06:03] [ info] [engine] started (pid=1)
[2020/07/27 07:06:03] [ info] [filter_kube] https=1 host=kubernetes.default.svc port=443
[2020/07/27 07:06:03] [ info] [filter_kube] local POD info OK
[2020/07/27 07:06:03] [ info] [filter_kube] testing connectivity with API server...
[2020/07/27 07:06:03] [ info] [filter_kube] API server connectivity OK
[2020/07/27 07:06:03] [error] [filter_parser] requested parser 'simple_json_with_time' not found
[2020/07/27 07:06:03] [error] [filter_parser] Invalid "parser"
[2020/07/27 07:06:03] [error] Failed initialize filter parser.1

Parser:

		    Name        simple_json_with_time
		    Format      json
		    Time_Key    time
		    Time_Format %Y-%m-%d %H:%M:%S,%L
		    Time_Keep   On
		    Decode_Field_As   escaped_utf8    log    do_next
		    Decode_Field_As   json       log
   

Filter:

		    Name                parser
		    Match               core-test*
		    Parser              simple_json_with_time
		    Key_Name            log
		    Reserve_Data        On
		    Preserve_Key        On

Don`t know why it's not picking the parser, can anyone help me to resolve the above error ?

-- Aman Kumar Soni
devops
fluent-bit
kubernetes
logging

1 Answer

8/27/2021

What version fluentbit u used, let check some issues related.

in my case problem soled after i remove custome parser mongodb which is defined in fluentbit

-- Vu Manh
Source: StackOverflow