Page History

...

For supported runners, you can set the log level of Java transforms by adding the corresponding pipeline option as a local pipeline option in Python side. For example, to suppress all logs from Java package org.apache.kafka you can do following.

1. Add the a Python PipelineOption that represents the corresponding Java PipelineOption available here. This can be simply added to your Python program that starts up the Beam job.

   
   

   Code Block
   language py
   class JavaLoggingOptions(PipelineOptions):   @classmethod   def _add_argparse_args(cls, parser):     parser.add_argument(         '--sdkHarnessLogLevelOverrides',         default={},         type=json.loads,         help=(           'Java log level overrides'))

   
   

2. Specify the additional pipeline option PipelineOption as a parameter when running the Beam pipeline.

...